-- Logs begin at Tue 2022-05-10 20:04:28 UTC, end at Tue 2022-05-10 21:54:43 UTC. -- May 10 20:59:57.197865 dv-cinder-828807-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 10 20:59:57.208191 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 20:59:57.210080 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 20:59:57 2022] *** May 10 20:59:57.210080 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 20:59:57.210080 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 20:59:57.210080 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: nodename: dv-cinder-828807-2-iscsi May 10 20:59:57.210080 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: machine: x86_64 May 10 20:59:57.210080 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: clock source: unix May 10 20:59:57.210080 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: pcre jit disabled May 10 20:59:57.210080 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: detected number of CPU cores: 4 May 10 20:59:57.210080 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: current working directory: / May 10 20:59:57.210694 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: detected binary path: /usr/bin/uwsgi-core May 10 20:59:57.210694 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: your processes number limit is 47680 May 10 20:59:57.210694 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: your memory page size is 4096 bytes May 10 20:59:57.210694 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: detected max file descriptor number: 2048 May 10 20:59:57.210694 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: lock engine: pthread robust mutexes May 10 20:59:57.210694 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: thunder lock: enabled May 10 20:59:57.210694 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 20:59:57.210694 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 20:59:57.255083 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: Python main interpreter initialized at 0x5580a83909c0 May 10 20:59:57.255083 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: python threads support enabled May 10 20:59:57.255083 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: your server socket listen backlog is limited to 100 connections May 10 20:59:57.255083 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: your mercy for graceful operations on workers is 90 seconds May 10 20:59:57.255419 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: mapped 403077 bytes (393 KB) for 2 cores May 10 20:59:57.255493 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: *** Operational MODE: preforking *** May 10 20:59:57.255760 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: *** uWSGI is running in multiple interpreter mode *** May 10 20:59:57.255760 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: spawned uWSGI master process (pid: 103357) May 10 20:59:57.255947 dv-cinder-828807-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 10 20:59:57.256480 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: spawned uWSGI worker 1 (pid: 103358, cores: 1) May 10 20:59:57.256819 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: spawned uWSGI worker 2 (pid: 103359, cores: 1) May 10 20:59:57.256989 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 20:59:58.452141 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 20:59:58.460001 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 20:59:59.181070 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 20:59:59.181070 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: from cryptography.utils import int_from_bytes May 10 20:59:59.181467 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 20:59:59.181467 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: from cryptography.utils import int_from_bytes May 10 20:59:59.184002 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 20:59:59.184002 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: from cryptography.utils import int_from_bytes May 10 20:59:59.184329 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 20:59:59.184329 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: from cryptography.utils import int_from_bytes May 10 21:00:01.769443 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 21:00:01.770012 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 21:00:01.770364 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 21:00:01.770452 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 21:00:01.770544 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 21:00:01.770633 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 21:00:01.770719 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 21:00:01.770812 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 21:00:01.770899 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 21:00:01.770991 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 21:00:01.771214 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.771351 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.771549 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.771677 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.771876 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.771989 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.772196 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.772294 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.772531 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.772623 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.772850 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.772937 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.773183 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.773291 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.773512 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.773616 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.773843 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.773936 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.774101 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.774187 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.774416 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.774509 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.774738 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828807-2-iscsi {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.774824 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828807-2-iscsi {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.775055 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.775171 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.775390 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.775533 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.775702 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.775807 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.776020 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.776121 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.776324 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.776426 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.776643 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.776743 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.776946 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.777038 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.777442 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.777551 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.778558 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.778672 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.778672 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.778813 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.778891 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.778959 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.779025 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.779097 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.779207 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.779292 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.779421 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.779620 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.779745 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.779838 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.780057 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.780156 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.780375 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.780466 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.780683 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.780769 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.781076 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828807-2-iscsi {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.781165 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828807-2-iscsi {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.781393 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.781484 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.781705 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.781794 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.782015 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.782192 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.782421 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.782522 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.782730 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.782824 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.783069 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.783258 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.783625 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.783734 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.784071 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.784155 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.784386 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.784473 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.784714 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.784799 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.785033 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.785124 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.785355 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.785464 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.785678 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.785776 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.785975 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.786069 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.786282 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.786369 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.786588 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.786680 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.786905 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.786999 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.787229 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.787318 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.787533 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.787619 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.787781 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.787881 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.788087 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.788174 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.788407 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.788493 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.788728 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.788822 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.789047 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.789136 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.789297 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.789394 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.789545 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.789633 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.789861 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.789954 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.790177 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.790272 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.790481 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.790567 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.790787 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.790875 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.791090 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.791207 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.791418 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.791503 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.791721 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.791806 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.792025 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.792246 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.792332 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.792411 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.792618 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.792711 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.792935 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.793028 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.793248 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.793335 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.793574 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.793721 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.793879 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.793964 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.794196 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.794281 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.794587 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.794673 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.794835 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.794922 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.795157 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.795341 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.795495 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.795582 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.795816 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.795922 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.796121 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.796218 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.796436 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.796537 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.796763 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.796849 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.797076 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.797163 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.797388 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.797489 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.797700 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.797793 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.798024 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.798119 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.798346 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.798439 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.799210 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.799310 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.799473 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.799548 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.799805 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.799900 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.800120 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.800206 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.800446 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.800531 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.800759 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.800863 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.801074 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.801168 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.801381 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.801475 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.801681 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.801774 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.801988 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.802075 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.802296 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.802385 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.802598 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.802683 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.802904 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.803299 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.803485 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.803582 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.803789 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.803894 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.804093 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.804179 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.804398 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.804483 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.804703 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.804790 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.805020 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.805115 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.805338 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.805433 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.805644 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.805740 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.805949 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.806053 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.806250 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.806347 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.806556 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.806656 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.806873 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.806958 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.807202 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.807307 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.807508 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.807595 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.807827 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.807912 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.808132 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.808219 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.808435 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.808522 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.808751 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.808844 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.809056 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.809158 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.809358 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.809445 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.809672 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.809758 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.809968 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.810062 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.810272 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.810359 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.810586 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.810672 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.810891 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.810986 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.811219 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.811307 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.811526 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.811613 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.811831 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.811932 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.812135 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.812221 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.812437 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.812523 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.812739 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.812825 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.813046 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.813129 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.813343 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.813433 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.813659 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.813747 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.813979 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.814076 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.814883 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.815023 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.815190 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.815332 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.815537 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.815632 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.815871 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.815973 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:00:01.816217 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.816322 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.816552 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.816639 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.816901 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.816995 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.817212 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.817297 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.817544 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.817632 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.817874 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.817970 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.818191 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.818277 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.818502 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.818589 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.818817 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.818918 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.819159 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.819260 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.819474 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.819560 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.819786 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.819873 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.820097 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.820183 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.820416 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.820513 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.820733 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.820846 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.821059 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.821147 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.821375 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.821462 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.821690 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.821792 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.822009 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.822108 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.822323 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.822408 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.822638 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.822724 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.822968 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.823060 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.823311 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.823398 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.823622 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.823710 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.823966 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.824081 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.824314 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.824409 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.824629 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.824732 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.824952 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.825045 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.825272 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.825364 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.825583 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.825676 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.825893 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.825985 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.826205 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.826311 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.826530 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.826622 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.826867 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.826958 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.827197 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.827303 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.827517 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.827619 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.827830 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.827926 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.828141 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.828237 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.828456 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.828541 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.828767 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.828851 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.829079 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.829174 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.829416 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.829502 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.829763 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.829853 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.830106 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.830253 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.830428 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.830573 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.830753 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.830894 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.831072 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.831257 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.831429 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.831529 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.831747 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.831841 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.832059 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.832146 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.832371 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.832457 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.832683 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.832778 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.832998 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.833086 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.833301 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.833392 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.833620 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.833706 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.833948 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.834036 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.834256 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.834344 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.834588 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.834688 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.834894 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.834980 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.835228 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.835329 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.835542 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.835637 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.835853 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.835946 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.836158 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.836251 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.836468 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.836570 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.836778 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.836866 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.837082 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.837177 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.837406 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.837505 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.837717 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.837804 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.838022 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.838115 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.838343 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.838430 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.838647 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.838732 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.838951 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.839038 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.839284 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.839373 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.839597 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.839691 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.839907 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.839994 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.840216 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.840304 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.840525 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.840610 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.840847 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.840948 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.841157 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.841251 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.841470 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.841558 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.841802 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.841902 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.842132 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.842219 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.842435 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.842521 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.842762 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.842907 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.843084 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.843194 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.843422 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.843517 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.843726 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.843888 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.844035 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.844123 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.844337 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.844423 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.844639 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.844734 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.844941 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.845029 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.845249 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.845335 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.845582 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.845736 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.845885 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.845989 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.846168 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.846255 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.846471 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.846569 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.846770 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.846858 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.847088 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.847220 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.847418 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.847506 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.847719 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.847806 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.848021 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.848107 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.848323 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.848410 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.848662 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.848749 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.848965 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.849064 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.849303 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.849391 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.849636 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.849729 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.849949 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.850048 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.850269 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.850356 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.850578 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.850671 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.850893 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.850992 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.851223 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.851314 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.851535 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.851622 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.851843 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.851944 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.852152 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.852238 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.852471 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.852557 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.852786 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.852871 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.853100 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.853184 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.853410 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.853496 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.853730 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.853865 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.854038 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.854124 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.854353 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.854450 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.854656 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.854743 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.854970 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.855055 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.855375 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.855469 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.855662 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.855756 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.855975 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.856062 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.856294 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.856389 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.856608 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.856706 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.856920 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.857014 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.857228 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.857323 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.857536 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.857629 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.857845 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.857931 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.858153 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.858297 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.858468 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.858562 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.858784 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.858871 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.859109 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.859228 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.859448 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.859536 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.859778 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.859863 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.860088 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.860187 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.860405 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.860493 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.860708 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.860794 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.861529 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.861622 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.861858 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.861940 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.862191 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.862278 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.862499 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.862587 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.862810 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.862944 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.863151 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.863241 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.863466 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.863554 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.863773 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.863866 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.864083 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.864176 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.864394 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.864523 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.864708 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.864802 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.865015 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.865110 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.865327 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.865414 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.865637 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.865723 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.865944 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.866042 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.866246 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.866344 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.866559 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.866702 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.866865 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.866968 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.867191 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.867277 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.867495 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.867579 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.867805 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.867900 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.868124 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.868210 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.868433 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.868526 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.868752 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.868840 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.869070 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.869163 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.869371 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.869457 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.869673 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.869760 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.869991 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.870077 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.870298 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.870385 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.870599 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.870686 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.870901 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.870993 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.871229 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.871329 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.871567 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.871653 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.871877 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.871964 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.872181 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.872276 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.872497 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.872590 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.872817 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.872904 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.873131 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.873332 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.873429 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.873509 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.873742 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.873842 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.874050 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.874150 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.874369 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.874457 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.874681 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.874770 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.874990 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.875085 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.875322 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.875422 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.875632 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.875726 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.875941 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.876036 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.876250 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.876336 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.876571 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.877251 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.877398 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.877554 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.877726 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.877812 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.878041 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.878135 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.878351 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.878443 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.878668 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.878755 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.878993 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.879080 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.879584 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.879720 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.879915 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.880001 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.880228 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.880327 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.880544 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.880630 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.880860 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.880947 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.881177 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.881273 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.881504 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.881598 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.881829 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.881917 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.882167 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.882267 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.882471 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.882566 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.882776 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.882864 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.883086 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.883258 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.883413 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.883513 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.883724 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.883821 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.884029 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.884115 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.884333 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.884428 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.884635 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.884722 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.884944 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.885031 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.885247 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.885341 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.885549 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.885636 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.885850 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.885938 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.886154 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.886248 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.886465 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.886553 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.886767 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.886854 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.887076 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.887192 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.887402 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.887497 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.887723 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.887817 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.888031 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.888126 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.888333 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.888420 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.888635 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.888721 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.888935 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.889032 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.889275 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.889370 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.889579 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.889672 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.889913 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.890009 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.890241 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.890328 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.890580 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.890675 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.890883 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.890980 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.891206 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.891299 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.891529 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.891629 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.891832 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.891932 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.892135 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.892222 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.892466 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.892559 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.892784 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.892861 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.893099 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.893223 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.893408 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.893503 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.893727 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.893815 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.894032 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.894118 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.894343 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.894437 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.894649 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.894739 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.894948 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.895034 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.895277 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.895366 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.895580 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.895667 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.895890 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.895976 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.896197 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.896284 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.896500 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.896586 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.896800 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.896894 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.897110 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.897197 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.897415 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.897502 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.897716 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.897873 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.898023 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.898110 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.898328 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.898413 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.898642 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.898739 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.898945 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.899031 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.899269 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.899371 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.899575 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.899676 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.899885 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.899978 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.900190 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.900284 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.900491 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.900587 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.900810 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.900896 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.901118 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.901204 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.901418 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.901506 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.901720 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.901806 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.902028 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.902113 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.902327 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.902414 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.902629 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.902716 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.902935 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.903029 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.903278 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.903368 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.903594 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.903680 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.903896 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.903992 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.904203 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.904290 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.904503 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.904590 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.904805 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.904946 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.905104 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.905194 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.905408 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.905495 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.905706 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.905805 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.906005 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.906099 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.906302 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.906389 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.906600 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.906695 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.906900 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.906988 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.907244 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.907333 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.907553 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.907651 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.907854 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.908458 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.908687 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.908784 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.908991 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.909088 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.909328 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.909415 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.909631 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.909717 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.909985 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.910082 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.910288 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.910384 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.910601 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.910687 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.910917 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.911004 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.911253 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.911341 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.911565 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.911649 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.911877 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.911965 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.912180 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.912266 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.912493 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.912585 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.912800 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.912888 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.913111 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.913205 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.913411 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.913506 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.913717 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.913803 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.914033 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.914118 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.914343 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.914439 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.914649 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.914744 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.914966 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.915052 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.915307 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.915410 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.915630 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.915730 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.915933 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.916094 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.916240 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.916548 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.916634 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.916855 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.917160 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.917244 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.917466 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.917691 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.917777 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.918079 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.918220 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.918389 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.918698 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.918783 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.919006 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.919209 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.919332 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.919539 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.919639 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.919865 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.919951 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.920188 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.920274 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.920509 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.920605 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.920820 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.920911 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.921121 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.921207 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.921427 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.921517 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.921728 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.921813 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.922033 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.922121 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.922334 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.922421 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.922659 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.922753 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.922978 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.923064 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.923321 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.923423 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.924218 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.924369 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.924570 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.924723 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.924884 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.924998 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.925134 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.925295 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.925470 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.925615 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.925775 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.925929 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.926204 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.926292 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.926513 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.926610 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.926822 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.926911 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.927152 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.927243 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.927486 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.927589 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.927786 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.927919 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.928344 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.928492 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.928663 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.928829 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.928963 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.929114 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.929263 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.929424 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.929562 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.929732 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.929879 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.930046 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.930179 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.930374 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.930495 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.930682 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.930907 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.931000 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.931242 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.931343 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.931549 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.931637 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.931919 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.932005 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.932244 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.932330 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.932556 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.932666 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.932873 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.932984 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.933192 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.933287 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.933518 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.933704 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.933818 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.934022 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.934129 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.934343 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.934438 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.934671 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.934778 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.934998 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.935085 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.935351 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.935442 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.935661 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.935749 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.935961 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.936047 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.936281 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.936373 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.936601 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.936696 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.936910 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.936997 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.937226 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.937319 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.937543 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.937636 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.937853 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.937946 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.938181 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.938282 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.938509 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.938596 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.938827 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.938914 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.939180 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.939394 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.939541 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.939689 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.939823 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.940077 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.940163 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.940380 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.940469 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.940701 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.940795 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.941003 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.941090 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.941311 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.941398 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.941618 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.941705 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.941925 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.942020 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.942229 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.942323 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.942531 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.942619 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.942849 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.942944 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.943174 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.943266 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.943494 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.943594 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.943805 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.943899 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.944118 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.944210 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.944434 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.944521 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.944735 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.944830 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.945053 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.945140 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.945359 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.945443 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.945659 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.945746 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.945960 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.946047 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.946259 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.946346 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.946601 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.946689 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.946903 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.946989 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.947246 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.947347 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.947561 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.947654 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.947873 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.947962 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.948183 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.948277 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.948489 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.948576 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.948826 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.948911 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.949133 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.949227 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.949446 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.949531 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.949768 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.949861 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.950070 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.950166 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.950371 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.950510 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.950679 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.950766 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.950982 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.951079 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.951308 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.951396 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.951621 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.951707 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.951929 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.952028 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.952227 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.952318 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.952527 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.952613 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.952828 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.952916 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.953146 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.953234 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.953447 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.953535 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.953768 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.953900 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.954075 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.954163 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.954375 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.954461 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.954676 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.954766 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.955001 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.955140 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.955366 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.955474 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.955672 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.955785 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.956002 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.956096 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.956322 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.956417 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.956643 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.956731 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.956966 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.957054 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.957278 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.957379 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.957600 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.957687 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.957916 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.958002 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.958229 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.958327 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.958541 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.958635 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.958852 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.958939 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.959186 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.959289 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.959502 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.959597 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.959816 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.959903 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.960125 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.960213 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.960437 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.960560 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.960750 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.960837 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.961065 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.961152 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.961384 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.961599 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.961707 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.961931 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.962027 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.962249 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.962349 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.962566 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.962654 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.962882 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.962977 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.963220 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.963310 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.963543 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.963789 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.963887 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.964122 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.964209 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.964448 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.964543 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.964757 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.964857 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.965073 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.965166 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.965391 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.965513 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.965707 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.965802 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.966024 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.966113 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.966343 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.966429 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.966657 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.966744 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.966970 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.967056 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.967306 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.967401 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.967660 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.967747 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.967974 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.968058 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.968280 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.968442 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.968594 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.968692 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.968908 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.968995 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.969222 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.969318 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.969532 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.969620 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.969839 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.969927 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.970152 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.970248 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.971029 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.971274 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.971364 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.971441 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.971703 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.971794 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.972018 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.972114 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.972331 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.972418 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.972656 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.972743 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.972990 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.973079 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.973311 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.973406 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.973624 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.973711 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.973937 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.974022 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.974252 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.974347 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.974570 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.974772 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.974903 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.975091 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.975269 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.975449 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.975597 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.975776 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.975917 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.976102 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.976237 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.976420 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.976561 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.976737 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.977064 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.977149 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.977372 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.977467 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.977676 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.977768 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.977987 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.978074 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.978298 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.978387 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.978601 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.978695 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.978921 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.979008 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.979253 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.979344 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.979558 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.979645 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.979875 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.979962 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.980186 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.980275 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.980505 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.980715 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.980802 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.981061 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.981157 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.981377 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.981465 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.981701 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.981788 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.982024 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.982113 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.982342 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.982427 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.982645 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.982883 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.982979 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.983264 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.983355 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.983581 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.983666 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.983894 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.983994 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.984216 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.984304 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.984522 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.984616 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.984824 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.984913 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.985133 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.985222 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.985443 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.985531 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.985747 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.985844 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.986625 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.986757 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.986934 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.987049 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.987443 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.987545 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.987752 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.987839 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.988071 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.988156 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.988387 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.988473 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.988699 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.988784 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.989004 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.989102 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.989310 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.989397 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.989616 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.989703 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.989920 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.990015 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.990230 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.990317 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.990535 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.990622 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.990846 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.990941 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.991177 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.991285 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.991476 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.991562 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.991778 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.991873 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.992088 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.992181 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.992407 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.992495 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.992717 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.992805 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.993033 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.993121 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.993335 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.993428 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.993651 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.993738 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.993961 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.994047 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.994276 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.994368 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.994586 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.994673 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.994897 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.995034 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.995263 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.995353 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.995579 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.995673 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.995902 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.996114 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.996202 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.996444 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.996533 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.996762 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.996901 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.997094 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.997181 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.997424 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.997518 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.997729 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.997816 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.998033 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.998320 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.998426 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.998646 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.998732 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.998955 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.999042 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.999288 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.999457 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.999602 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.999690 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:01.999912 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.000007 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.000222 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.000311 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.000532 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.000619 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.000839 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.000926 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.001149 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.001235 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.001458 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.001544 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.002282 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.002383 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.002599 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.002727 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.002917 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.003039 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.003259 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.003362 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.003579 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.003717 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.003896 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.004038 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.004211 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.004360 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.004539 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.004675 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.004856 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.004989 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.005177 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.005298 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.005498 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.005606 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.005844 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.005931 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.006168 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.006256 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.006491 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.006578 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.006813 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.006900 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.007158 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.007249 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.007454 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.007541 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.007767 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.007872 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.008081 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.008178 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.008393 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.008480 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.008715 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.008815 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.009050 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.009145 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.009369 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.009463 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.009680 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.009776 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.010002 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.010096 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.010324 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.010412 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.010634 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.010729 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.010960 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.011046 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.011321 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.011410 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.011648 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.011736 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.011970 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.012064 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.012273 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.012361 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.012577 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.012665 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.012879 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.012965 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.013186 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.013272 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.013502 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.013590 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.013808 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.013896 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.014111 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.014205 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.014418 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.014551 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.014728 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.014815 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.015029 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.015146 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.015355 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.015453 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.015655 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.015743 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.015956 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.016056 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.016265 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.016352 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.016565 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.016652 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.016877 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.016972 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.017180 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.017850 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.018029 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.018151 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.018335 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.018565 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.018652 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.018885 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.018972 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.019230 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.019338 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.019544 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.019632 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.019843 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.019928 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.020147 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.020247 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.020452 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.020547 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.020759 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.020844 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.021068 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.021164 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.021385 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.021511 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.021695 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.021782 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.022005 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.022094 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.022313 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.022402 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.022619 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.022704 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.022925 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.023020 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.023267 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.023355 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.023583 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.023670 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.023891 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.023987 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.024227 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.024315 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.024539 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.024625 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.024849 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.024937 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.025169 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.025254 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.025499 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.025598 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.025806 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.025900 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.026112 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.026200 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.026434 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.026529 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.026755 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.026848 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.027057 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.027172 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.027403 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.027501 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.027716 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.027809 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.028031 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.028116 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.028343 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.028430 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.028652 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.028740 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.028980 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.029067 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.029290 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.029380 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.029599 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.029687 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.029910 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.029997 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.030218 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.030306 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.030524 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.030612 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.030836 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.030930 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.031164 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.031255 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.031489 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.031613 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.031803 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.031910 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.032120 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.032208 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.032439 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.032535 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.032755 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.032851 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.033150 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.033237 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.033495 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.033592 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.033814 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.033915 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.034126 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.034212 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.034444 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.034531 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.034750 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.034845 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.034990 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 21:00:02.035105 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.035494 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.035815 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.036164 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.036502 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.036823 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.037140 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.037451 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:00:02.037698 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 21:00:02.058765 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_db.sqlalchemy.engines [None req-79e34e38-aec6-46a1-ad95-b51920d813f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103359) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:00:02.060508 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG oslo_db.sqlalchemy.engines [None req-7b05d730-8f76-4c90-bc30-26b85bd609d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:00:02.121521 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.context [None req-79e34e38-aec6-46a1-ad95-b51920d813f9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a9a66363-11d1-480a-8132-cac751fafba9(cell1) {{(pid=103359) load_cells /opt/stack/nova/nova/context.py:464}} May 10 21:00:02.124443 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.context [None req-7b05d730-8f76-4c90-bc30-26b85bd609d0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a9a66363-11d1-480a-8132-cac751fafba9(cell1) {{(pid=103358) load_cells /opt/stack/nova/nova/context.py:464}} May 10 21:00:02.125765 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_concurrency.lockutils [None req-79e34e38-aec6-46a1-ad95-b51920d813f9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:00:02.127735 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_concurrency.lockutils [None req-79e34e38-aec6-46a1-ad95-b51920d813f9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:00:02.128522 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_concurrency.lockutils [None req-79e34e38-aec6-46a1-ad95-b51920d813f9 None None] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:00:02.128784 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG oslo_concurrency.lockutils [None req-7b05d730-8f76-4c90-bc30-26b85bd609d0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:00:02.130359 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG oslo_concurrency.lockutils [None req-7b05d730-8f76-4c90-bc30-26b85bd609d0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:00:02.130472 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_concurrency.lockutils [None req-79e34e38-aec6-46a1-ad95-b51920d813f9 None None] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:00:02.131185 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG oslo_concurrency.lockutils [None req-7b05d730-8f76-4c90-bc30-26b85bd609d0 None None] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:00:02.133118 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG oslo_concurrency.lockutils [None req-7b05d730-8f76-4c90-bc30-26b85bd609d0 None None] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:00:02.141897 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_db.sqlalchemy.engines [None req-79e34e38-aec6-46a1-ad95-b51920d813f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103359) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:00:02.144772 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_db.sqlalchemy.engines [None req-79e34e38-aec6-46a1-ad95-b51920d813f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103359) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:00:02.148310 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG oslo_db.sqlalchemy.engines [None req-7b05d730-8f76-4c90-bc30-26b85bd609d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:00:02.151732 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG oslo_db.sqlalchemy.engines [None req-7b05d730-8f76-4c90-bc30-26b85bd609d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:00:02.304854 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG oslo_db.sqlalchemy.engines [None req-79e34e38-aec6-46a1-ad95-b51920d813f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103359) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:00:02.312695 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG oslo_db.sqlalchemy.engines [None req-7b05d730-8f76-4c90-bc30-26b85bd609d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:00:02.734226 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: WARNING keystonemiddleware.auth_token [None req-79e34e38-aec6-46a1-ad95-b51920d813f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 21:00:02.742279 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: WARNING keystonemiddleware.auth_token [None req-79e34e38-aec6-46a1-ad95-b51920d813f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 21:00:02.746214 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: WARNING keystonemiddleware.auth_token [None req-7b05d730-8f76-4c90-bc30-26b85bd609d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 21:00:02.753510 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: WARNING keystonemiddleware.auth_token [None req-7b05d730-8f76-4c90-bc30-26b85bd609d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 21:00:03.094122 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: WARNING keystonemiddleware.auth_token [None req-79e34e38-aec6-46a1-ad95-b51920d813f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 21:00:03.096007 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: WARNING keystonemiddleware.auth_token [None req-7b05d730-8f76-4c90-bc30-26b85bd609d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 21:00:03.100285 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: WARNING keystonemiddleware.auth_token [None req-79e34e38-aec6-46a1-ad95-b51920d813f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 21:00:03.102047 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: WARNING keystonemiddleware.auth_token [None req-7b05d730-8f76-4c90-bc30-26b85bd609d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 21:00:03.106422 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5580a83909c0 pid: 103359 (default app) May 10 21:00:03.108065 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5580a83909c0 pid: 103358 (default app) May 10 21:00:03.108502 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-79e34e38-aec6-46a1-ad95-b51920d813f9 None None] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:00:03.109665 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-79e34e38-aec6-46a1-ad95-b51920d813f9 None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001724 May 10 21:00:03.110071 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Tue May 10 21:00:03 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:01:24.448768 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-7b05d730-8f76-4c90-bc30-26b85bd609d0 None None] Calling method '>' {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:01:24.449984 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-7b05d730-8f76-4c90-bc30-26b85bd609d0 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001966 May 10 21:01:24.450385 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 930 bytes} [Tue May 10 21:01:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:01:24.874190 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-269a9508-4697-452c-86b9-0c49a246f8a3 admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:01:24.904481 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-269a9508-4697-452c-86b9-0c49a246f8a3 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.447952 May 10 21:01:24.905094 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 2/3] 10.222.0.49 () {60 vars in 1291 bytes} [Tue May 10 21:01:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:01:27.189973 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-7b05d730-8f76-4c90-bc30-26b85bd609d0 None None] Calling method '>' {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:01:27.190881 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-7b05d730-8f76-4c90-bc30-26b85bd609d0 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 May 10 21:01:27.191472 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 2/4] 10.222.0.49 () {54 vars in 930 bytes} [Tue May 10 21:01:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:01:27.259602 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-e1f7fd70-6ca9-4aed-b328-7cb5e943989d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 256, "name": "cirros256", "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:01:27.282432 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 21:01:27.282432 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: warnings.warn(msg) May 10 21:01:27.391404 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-e1f7fd70-6ca9-4aed-b328-7cb5e943989d admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.193817 May 10 21:01:27.392260 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 3/5] 10.222.0.49 () {64 vars in 1282 bytes} [Tue May 10 21:01:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:01:27.620328 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-73357ee5-e158-4a3e-8ff9-b7f0d0e6d8f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:01:27.622832 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 21:01:27.622832 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: warnings.warn(msg) May 10 21:01:27.725955 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-73357ee5-e158-4a3e-8ff9-b7f0d0e6d8f5 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.325530 May 10 21:01:27.726794 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 3/6] 10.222.0.49 () {64 vars in 1335 bytes} [Tue May 10 21:01:27 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:01:30.025886 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-e1f7fd70-6ca9-4aed-b328-7cb5e943989d admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:01:30.026910 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-e1f7fd70-6ca9-4aed-b328-7cb5e943989d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 May 10 21:01:30.027346 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 4/7] 10.222.0.49 () {54 vars in 930 bytes} [Tue May 10 21:01:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:01:30.139542 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-18f2542d-c993-4cdc-9d0f-f4b8f7f9d787 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "swap": 0, "ram": 512, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds512M", "id": "d1"}} {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:01:30.158360 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 21:01:30.158360 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: warnings.warn(msg) May 10 21:01:30.262257 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-18f2542d-c993-4cdc-9d0f-f4b8f7f9d787 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.228637 May 10 21:01:30.262738 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 4/8] 10.222.0.49 () {64 vars in 1282 bytes} [Tue May 10 21:01:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:01:30.275330 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-630c432f-b66b-4fc9-acdd-f73135cd865e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:01:30.276842 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 21:01:30.276842 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: warnings.warn(msg) May 10 21:01:30.403303 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-630c432f-b66b-4fc9-acdd-f73135cd865e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131729 May 10 21:01:30.404029 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 5/9] 10.222.0.49 () {64 vars in 1335 bytes} [Tue May 10 21:01:30 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:01:32.670839 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-18f2542d-c993-4cdc-9d0f-f4b8f7f9d787 admin admin] Calling method '>' {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:01:32.672446 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-18f2542d-c993-4cdc-9d0f-f4b8f7f9d787 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 May 10 21:01:32.673087 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 930 bytes} [Tue May 10 21:01:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:01:32.737469 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-a374fff6-2c6e-4330-9825-857c496f60af admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d2", "name": "ds1G", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 1024, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:01:32.811923 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-a374fff6-2c6e-4330-9825-857c496f60af admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.132815 May 10 21:01:32.812925 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 6/11] 10.222.0.49 () {64 vars in 1282 bytes} [Tue May 10 21:01:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:01:32.825656 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-46f3c355-5e7a-4774-a4c6-80f17aef77dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:01:32.902729 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-46f3c355-5e7a-4774-a4c6-80f17aef77dc admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080731 May 10 21:01:32.903540 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 6/12] 10.222.0.49 () {64 vars in 1335 bytes} [Tue May 10 21:01:32 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:01:35.198060 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-a374fff6-2c6e-4330-9825-857c496f60af admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:01:35.199079 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-a374fff6-2c6e-4330-9825-857c496f60af admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 May 10 21:01:35.199558 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 7/13] 10.222.0.49 () {54 vars in 930 bytes} [Tue May 10 21:01:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:01:35.258269 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-d84d1141-6915-440e-b4e3-b611eec01019 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "disk": 10}} {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:01:35.341132 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-d84d1141-6915-440e-b4e3-b611eec01019 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135659 May 10 21:01:35.341661 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 7/14] 10.222.0.49 () {64 vars in 1282 bytes} [Tue May 10 21:01:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:01:35.354293 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-9de06637-1a02-4409-a6ef-67d413bee3a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:01:35.436646 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-9de06637-1a02-4409-a6ef-67d413bee3a7 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083567 May 10 21:01:35.436646 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 8/15] 10.222.0.49 () {64 vars in 1335 bytes} [Tue May 10 21:01:35 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:01:37.710679 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-d84d1141-6915-440e-b4e3-b611eec01019 admin admin] Calling method '>' {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:01:37.711765 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-d84d1141-6915-440e-b4e3-b611eec01019 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 May 10 21:01:37.712170 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 8/16] 10.222.0.49 () {54 vars in 930 bytes} [Tue May 10 21:01:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:01:37.772443 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-1206ef57-a293-4651-a62b-a04a0a3ce9d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "name": "ds4G", "vcpus": 4, "id": "d4", "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:01:37.843268 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-1206ef57-a293-4651-a62b-a04a0a3ce9d5 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.125333 May 10 21:01:37.845587 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 9/17] 10.222.0.49 () {64 vars in 1282 bytes} [Tue May 10 21:01:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:01:37.857500 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-004e7077-debd-420c-bb9c-d924b0fd42cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:01:37.969110 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-004e7077-debd-420c-bb9c-d924b0fd42cd admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114651 May 10 21:01:37.969758 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 9/18] 10.222.0.49 () {64 vars in 1335 bytes} [Tue May 10 21:01:37 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:01:40.292486 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-1206ef57-a293-4651-a62b-a04a0a3ce9d5 admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:01:40.293498 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-1206ef57-a293-4651-a62b-a04a0a3ce9d5 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 10 21:01:40.293900 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 10/19] 10.222.0.49 () {54 vars in 930 bytes} [Tue May 10 21:01:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:01:40.357418 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-a4b829a9-49a5-44af-8cb8-0679e7783e7a admin admin] Calling method '>' {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:01:40.381860 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-a4b829a9-49a5-44af-8cb8-0679e7783e7a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080619 May 10 21:01:40.382786 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 10/20] 10.222.0.49 () {60 vars in 1291 bytes} [Tue May 10 21:01:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:01:42.837626 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-1206ef57-a293-4651-a62b-a04a0a3ce9d5 admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:01:42.838998 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-1206ef57-a293-4651-a62b-a04a0a3ce9d5 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001959 May 10 21:01:42.839632 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 11/21] 10.222.0.49 () {54 vars in 930 bytes} [Tue May 10 21:01:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:01:42.911971 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-60c473cf-d357-4b18-92cd-4d9b828cd9a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "name": "m1.tiny", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "1", "ram": 512}} {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:01:42.996246 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-60c473cf-d357-4b18-92cd-4d9b828cd9a4 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.148275 May 10 21:01:42.996806 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 11/22] 10.222.0.49 () {64 vars in 1282 bytes} [Tue May 10 21:01:42 2022] POST /compute/v2.1/flavors => generated 402 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:01:43.010667 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-3131e2e7-d17c-4e95-a16e-861b93150771 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:01:43.086132 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-3131e2e7-d17c-4e95-a16e-861b93150771 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079852 May 10 21:01:43.086703 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 12/23] 10.222.0.49 () {64 vars in 1332 bytes} [Tue May 10 21:01:43 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:01:45.613772 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-60c473cf-d357-4b18-92cd-4d9b828cd9a4 admin admin] Calling method '>' {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:01:45.614791 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-60c473cf-d357-4b18-92cd-4d9b828cd9a4 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 May 10 21:01:45.615216 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 12/24] 10.222.0.49 () {54 vars in 930 bytes} [Tue May 10 21:01:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:01:45.673405 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-485bb752-566d-481c-8ebb-ebe58a0d291e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "ram": 2048, "id": "2", "rxtx_factor": 1.0}} {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:01:45.755625 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-485bb752-566d-481c-8ebb-ebe58a0d291e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.134541 May 10 21:01:45.756190 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 13/25] 10.222.0.49 () {64 vars in 1282 bytes} [Tue May 10 21:01:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:01:45.768413 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-b5dd8b6c-88ad-40e6-bc83-32d475493807 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:01:45.845704 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-b5dd8b6c-88ad-40e6-bc83-32d475493807 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081396 May 10 21:01:45.848930 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 13/26] 10.222.0.49 () {64 vars in 1332 bytes} [Tue May 10 21:01:45 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:01:48.110617 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-485bb752-566d-481c-8ebb-ebe58a0d291e admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:01:48.111673 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-485bb752-566d-481c-8ebb-ebe58a0d291e admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 May 10 21:01:48.112074 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 14/27] 10.222.0.49 () {54 vars in 930 bytes} [Tue May 10 21:01:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:01:48.169387 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-589a6e8a-c22a-4f8b-8eb8-6edf140f27ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "vcpus": 2, "name": "m1.medium", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:01:48.252994 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-589a6e8a-c22a-4f8b-8eb8-6edf140f27ba admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.134780 May 10 21:01:48.253571 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 14/28] 10.222.0.49 () {64 vars in 1282 bytes} [Tue May 10 21:01:48 2022] POST /compute/v2.1/flavors => generated 406 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:01:48.265468 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-153aac9c-fd75-46e6-abdf-70fe60b62348 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:01:48.347376 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-153aac9c-fd75-46e6-abdf-70fe60b62348 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085682 May 10 21:01:48.348036 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 15/29] 10.222.0.49 () {64 vars in 1332 bytes} [Tue May 10 21:01:48 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:01:50.627238 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-589a6e8a-c22a-4f8b-8eb8-6edf140f27ba admin admin] Calling method '>' {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:01:50.628316 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-589a6e8a-c22a-4f8b-8eb8-6edf140f27ba admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002525 May 10 21:01:50.628722 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 15/30] 10.222.0.49 () {54 vars in 930 bytes} [Tue May 10 21:01:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:01:50.687699 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-d10d7f2f-52a0-4a08-b64e-7a1a7d8017b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "id": "4", "vcpus": 4, "disk": 80, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:01:50.763135 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-d10d7f2f-52a0-4a08-b64e-7a1a7d8017b8 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.128481 May 10 21:01:50.763696 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 16/31] 10.222.0.49 () {64 vars in 1282 bytes} [Tue May 10 21:01:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:01:50.775487 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-eb477b7b-83d5-4004-b7ba-42fed3ee9a57 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:01:50.858004 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-eb477b7b-83d5-4004-b7ba-42fed3ee9a57 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086385 May 10 21:01:50.858862 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 16/32] 10.222.0.49 () {64 vars in 1332 bytes} [Tue May 10 21:01:50 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:01:53.153602 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-d10d7f2f-52a0-4a08-b64e-7a1a7d8017b8 admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:01:53.155150 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-d10d7f2f-52a0-4a08-b64e-7a1a7d8017b8 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 May 10 21:01:53.160348 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 17/33] 10.222.0.49 () {54 vars in 930 bytes} [Tue May 10 21:01:53 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:01:53.220811 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-3e9c5d5b-907b-41bd-9b76-d7c179903d81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "5", "swap": 0, "name": "m1.xlarge", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "ram": 16384, "disk": 160}} {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:01:53.283625 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-3e9c5d5b-907b-41bd-9b76-d7c179903d81 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.122183 May 10 21:01:53.284176 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 17/34] 10.222.0.49 () {64 vars in 1282 bytes} [Tue May 10 21:01:53 2022] POST /compute/v2.1/flavors => generated 408 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:01:53.295885 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-0268aa55-35c4-4a6d-ad78-8b83ae6ae473 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:01:53.396124 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-0268aa55-35c4-4a6d-ad78-8b83ae6ae473 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103936 May 10 21:01:53.396711 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 18/35] 10.222.0.49 () {64 vars in 1332 bytes} [Tue May 10 21:01:53 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:02:17.792437 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-3e9c5d5b-907b-41bd-9b76-d7c179903d81 admin admin] Calling method '>' {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:02:17.793439 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-3e9c5d5b-907b-41bd-9b76-d7c179903d81 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 10 21:02:17.793857 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 18/36] 10.222.0.49 () {54 vars in 930 bytes} [Tue May 10 21:02:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:02:17.850799 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-808e48ac-1a9f-4fd2-bd18-ae34827a3320 admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:02:17.867646 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-808e48ac-1a9f-4fd2-bd18-ae34827a3320 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067901 May 10 21:02:17.868187 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 19/37] 10.222.0.49 () {60 vars in 1291 bytes} [Tue May 10 21:02:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:02:18.867621 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-3e9c5d5b-907b-41bd-9b76-d7c179903d81 admin admin] Calling method '>' {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:02:18.868603 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-3e9c5d5b-907b-41bd-9b76-d7c179903d81 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 May 10 21:02:18.868994 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 19/38] 10.222.0.49 () {56 vars in 1074 bytes} [Tue May 10 21:02:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:02:19.066434 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-56e49682-f609-41f2-9e51-900cc151897c admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:02:19.071950 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.wsgi [None req-56e49682-f609-41f2-9e51-900cc151897c admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 21:02:19.075187 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-56e49682-f609-41f2-9e51-900cc151897c admin admin] Request method failure captured: May 10 21:02:19.075187 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 21:02:19.075187 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: Accept: application/json May 10 21:02:19.075187 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: Accept-Encoding: gzip, deflate May 10 21:02:19.075187 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: Connection: keep-alive May 10 21:02:19.075187 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: Content-Length: 0 May 10 21:02:19.075187 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: Host: 10.222.0.49 May 10 21:02:19.075187 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: Openstack-Api-Version: compute 2.90 May 10 21:02:19.075187 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: Openstack-System-Scope: None May 10 21:02:19.075187 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: User-Agent: python-novaclient May 10 21:02:19.075187 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Auth-Token: gAAAAABietLaQ3gcGz6_PEa7OZYXDVfQJ1F9ZQUbiKo3V-mVaGBdb4ZOJ2symATTKjaHR8oliDQ7m8MaVFzhAIatM4RJR9Y_wOGT20tg_iTwEFeqFHHc_Xfv91nKs5zzZhql4IXthM-jex4CgiOBOwFczv7MHR_i_uOcME5An87CG8DPkOP9bdM May 10 21:02:19.075187 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Domain-Id: None May 10 21:02:19.075187 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Domain-Name: None May 10 21:02:19.075187 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Identity-Status: Confirmed May 10 21:02:19.075187 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Is-Admin-Project: True May 10 21:02:19.075187 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Openstack-Nova-Api-Version: 2.90 May 10 21:02:19.075187 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Project-Domain-Id: default May 10 21:02:19.075187 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Project-Domain-Name: Default May 10 21:02:19.075187 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Project-Id: 0505b6fc7edf412485d1ca7159b626ae May 10 21:02:19.075187 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Project-Name: admin May 10 21:02:19.075187 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Role: member,reader,admin May 10 21:02:19.075187 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Roles: member,reader,admin May 10 21:02:19.076860 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0505b6fc7edf412485d1ca7159b626ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0505b6fc7edf412485d1ca7159b626ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0505b6fc7edf412485d1ca7159b626ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0505b6fc7edf412485d1ca7159b626ae", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:02:19.076860 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Tenant: admin May 10 21:02:19.076860 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Tenant-Id: 0505b6fc7edf412485d1ca7159b626ae May 10 21:02:19.076860 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Tenant-Name: admin May 10 21:02:19.076860 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-User: admin May 10 21:02:19.076860 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-User-Domain-Id: default May 10 21:02:19.076860 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-User-Domain-Name: Default May 10 21:02:19.076860 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-User-Id: b4075d4b32a74f3abd78c38a5335cfb6 May 10 21:02:19.076860 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-User-Name: admin May 10 21:02:19.076860 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: method: > May 10 21:02:19.076860 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: exception: Flavor 42 could not be found. May 10 21:02:19.076860 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: action_args: {'id': '42'} May 10 21:02:19.076860 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:02:19.076860 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:02:19.078555 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 21:02:19.078555 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 21:02:19.078555 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 21:02:19.078555 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 21:02:19.078555 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 21:02:19.078555 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 21:02:19.078555 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 21:02:19.078555 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 21:02:19.078555 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 21:02:19.078555 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:02:19.078555 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 21:02:19.078555 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 21:02:19.078555 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 21:02:19.078555 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi May 10 21:02:19.078555 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:02:19.078555 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi May 10 21:02:19.078555 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:02:19.078555 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:02:19.078555 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:02:19.079998 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:02:19.079998 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:02:19.079998 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:02:19.079998 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:02:19.079998 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 21:02:19.079998 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 21:02:19.079998 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 21:02:19.079998 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi May 10 21:02:19.079998 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:02:19.079998 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi May 10 21:02:19.079998 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:02:19.079998 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:02:19.079998 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:02:19.079998 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:02:19.079998 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:02:19.079998 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 21:02:19.079998 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi May 10 21:02:19.079998 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-56e49682-f609-41f2-9e51-900cc151897c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103359) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:02:19.081364 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-56e49682-f609-41f2-9e51-900cc151897c admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061757 May 10 21:02:19.081364 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 20/39] 10.222.0.49 () {60 vars in 1190 bytes} [Tue May 10 21:02:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 21:02:19.086717 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-1446682d-4a29-40d4-b544-e64bf31d2f80 admin admin] Calling method '>' {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:02:19.107656 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-1446682d-4a29-40d4-b544-e64bf31d2f80 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024446 May 10 21:02:19.108184 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 20/40] 10.222.0.49 () {60 vars in 1210 bytes} [Tue May 10 21:02:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:02:19.123332 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-85e8cf03-9515-4a65-88c2-b28d5a6a6059 admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:02:19.145539 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-85e8cf03-9515-4a65-88c2-b28d5a6a6059 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025735 May 10 21:02:19.146101 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 21/41] 10.222.0.49 () {60 vars in 1210 bytes} [Tue May 10 21:02:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:02:19.156314 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-88f8f2b5-ca8a-4fd6-bc5d-0c295e9d9317 admin admin] Calling method '>' {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:02:19.161920 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.wsgi [None req-88f8f2b5-ca8a-4fd6-bc5d-0c295e9d9317 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 21:02:19.165381 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-88f8f2b5-ca8a-4fd6-bc5d-0c295e9d9317 admin admin] Request method failure captured: May 10 21:02:19.165381 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 21:02:19.165381 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: Accept: application/json May 10 21:02:19.165381 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: Accept-Encoding: gzip, deflate May 10 21:02:19.165381 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: Connection: keep-alive May 10 21:02:19.165381 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: Content-Length: 0 May 10 21:02:19.165381 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: Host: 10.222.0.49 May 10 21:02:19.165381 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: Openstack-Api-Version: compute 2.90 May 10 21:02:19.165381 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: Openstack-System-Scope: None May 10 21:02:19.165381 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: User-Agent: python-novaclient May 10 21:02:19.165381 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Auth-Token: gAAAAABietLaQ3gcGz6_PEa7OZYXDVfQJ1F9ZQUbiKo3V-mVaGBdb4ZOJ2symATTKjaHR8oliDQ7m8MaVFzhAIatM4RJR9Y_wOGT20tg_iTwEFeqFHHc_Xfv91nKs5zzZhql4IXthM-jex4CgiOBOwFczv7MHR_i_uOcME5An87CG8DPkOP9bdM May 10 21:02:19.165381 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Domain-Id: None May 10 21:02:19.165381 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Domain-Name: None May 10 21:02:19.165381 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Identity-Status: Confirmed May 10 21:02:19.165381 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Is-Admin-Project: True May 10 21:02:19.165381 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Openstack-Nova-Api-Version: 2.90 May 10 21:02:19.165381 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Project-Domain-Id: default May 10 21:02:19.165381 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Project-Domain-Name: Default May 10 21:02:19.165381 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Project-Id: 0505b6fc7edf412485d1ca7159b626ae May 10 21:02:19.165381 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Project-Name: admin May 10 21:02:19.165381 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Role: member,reader,admin May 10 21:02:19.165381 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Roles: member,reader,admin May 10 21:02:19.166917 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0505b6fc7edf412485d1ca7159b626ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0505b6fc7edf412485d1ca7159b626ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0505b6fc7edf412485d1ca7159b626ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0505b6fc7edf412485d1ca7159b626ae", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:02:19.166917 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Tenant: admin May 10 21:02:19.166917 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Tenant-Id: 0505b6fc7edf412485d1ca7159b626ae May 10 21:02:19.166917 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Tenant-Name: admin May 10 21:02:19.166917 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-User: admin May 10 21:02:19.166917 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-User-Domain-Id: default May 10 21:02:19.166917 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-User-Domain-Name: Default May 10 21:02:19.166917 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-User-Id: b4075d4b32a74f3abd78c38a5335cfb6 May 10 21:02:19.166917 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-User-Name: admin May 10 21:02:19.166917 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: method: > May 10 21:02:19.166917 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: exception: Flavor 42 could not be found. May 10 21:02:19.166917 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: action_args: {'id': '42'} May 10 21:02:19.166917 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:02:19.166917 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:02:19.167926 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 21:02:19.167926 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 21:02:19.167926 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 21:02:19.167926 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 21:02:19.167926 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 21:02:19.167926 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 21:02:19.167926 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 21:02:19.167926 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 21:02:19.167926 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 21:02:19.167926 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:02:19.167926 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 21:02:19.167926 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 21:02:19.167926 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 21:02:19.167926 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi May 10 21:02:19.167926 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:02:19.167926 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi May 10 21:02:19.167926 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:02:19.167926 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:02:19.167926 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:02:19.169207 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:02:19.169207 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:02:19.169207 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:02:19.169207 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:02:19.169207 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 21:02:19.169207 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 21:02:19.169207 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 21:02:19.169207 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi May 10 21:02:19.169207 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:02:19.169207 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi May 10 21:02:19.169207 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:02:19.169207 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:02:19.169207 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:02:19.169207 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:02:19.169207 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:02:19.169207 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 21:02:19.169207 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi May 10 21:02:19.169207 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-88f8f2b5-ca8a-4fd6-bc5d-0c295e9d9317 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:02:19.170438 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-88f8f2b5-ca8a-4fd6-bc5d-0c295e9d9317 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014805 May 10 21:02:19.170438 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 21/42] 10.222.0.49 () {60 vars in 1190 bytes} [Tue May 10 21:02:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 21:02:20.053026 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-85e8cf03-9515-4a65-88c2-b28d5a6a6059 admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:02:20.054047 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-85e8cf03-9515-4a65-88c2-b28d5a6a6059 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 10 21:02:20.054447 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 22/43] 10.222.0.49 () {56 vars in 1074 bytes} [Tue May 10 21:02:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:02:20.246723 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-543266b3-8879-45e6-adc4-fd7757b847db admin admin] Calling method '>' {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:02:20.252742 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.wsgi [None req-543266b3-8879-45e6-adc4-fd7757b847db admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 21:02:20.254236 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-543266b3-8879-45e6-adc4-fd7757b847db admin admin] Request method failure captured: May 10 21:02:20.254236 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 21:02:20.254236 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: Accept: application/json May 10 21:02:20.254236 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: Accept-Encoding: gzip, deflate May 10 21:02:20.254236 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: Connection: keep-alive May 10 21:02:20.254236 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: Content-Length: 0 May 10 21:02:20.254236 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: Host: 10.222.0.49 May 10 21:02:20.254236 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: Openstack-Api-Version: compute 2.90 May 10 21:02:20.254236 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: Openstack-System-Scope: None May 10 21:02:20.254236 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: User-Agent: python-novaclient May 10 21:02:20.254236 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Auth-Token: gAAAAABietLcf8HaTg-_vR9tZ_IJPrkwiFSRyKC7rOcmUl1uMgjBJKLSJnvsY5M3o6Qe_c1wxOly-PkAzFBeVzaDvj4eTZib2VTkr2B6MHuQBaUaIvN-p-CzZY7wUJYmKGWzfcqZ5qApd84x1HoNHpPCUBGD1xMDc55Ni2b3IbFYY-tAbysQKkM May 10 21:02:20.254236 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Domain-Id: None May 10 21:02:20.254236 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Domain-Name: None May 10 21:02:20.254236 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Identity-Status: Confirmed May 10 21:02:20.254236 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Is-Admin-Project: True May 10 21:02:20.254236 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Openstack-Nova-Api-Version: 2.90 May 10 21:02:20.254236 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Project-Domain-Id: default May 10 21:02:20.254236 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Project-Domain-Name: Default May 10 21:02:20.254236 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Project-Id: 0505b6fc7edf412485d1ca7159b626ae May 10 21:02:20.254236 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Project-Name: admin May 10 21:02:20.254236 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Role: member,reader,admin May 10 21:02:20.254236 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Roles: member,reader,admin May 10 21:02:20.255889 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0505b6fc7edf412485d1ca7159b626ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0505b6fc7edf412485d1ca7159b626ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0505b6fc7edf412485d1ca7159b626ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0505b6fc7edf412485d1ca7159b626ae", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:02:20.255889 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Tenant: admin May 10 21:02:20.255889 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Tenant-Id: 0505b6fc7edf412485d1ca7159b626ae May 10 21:02:20.255889 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Tenant-Name: admin May 10 21:02:20.255889 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-User: admin May 10 21:02:20.255889 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-User-Domain-Id: default May 10 21:02:20.255889 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-User-Domain-Name: Default May 10 21:02:20.255889 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-User-Id: b4075d4b32a74f3abd78c38a5335cfb6 May 10 21:02:20.255889 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-User-Name: admin May 10 21:02:20.255889 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: method: > May 10 21:02:20.255889 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: exception: Flavor 84 could not be found. May 10 21:02:20.255889 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: action_args: {'id': '84'} May 10 21:02:20.255889 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:02:20.255889 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:02:20.256818 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 21:02:20.256818 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 21:02:20.256818 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 21:02:20.256818 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 21:02:20.256818 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 21:02:20.256818 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 21:02:20.256818 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 21:02:20.256818 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 21:02:20.256818 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 21:02:20.256818 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:02:20.256818 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 21:02:20.256818 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 21:02:20.256818 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 21:02:20.256818 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi May 10 21:02:20.256818 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:02:20.256818 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi May 10 21:02:20.256818 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:02:20.256818 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:02:20.256818 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:02:20.258129 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:02:20.258129 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:02:20.258129 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:02:20.258129 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:02:20.258129 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 21:02:20.258129 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 21:02:20.258129 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 21:02:20.258129 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi May 10 21:02:20.258129 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:02:20.258129 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi May 10 21:02:20.258129 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:02:20.258129 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:02:20.258129 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:02:20.258129 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:02:20.258129 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:02:20.258129 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 21:02:20.258129 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi May 10 21:02:20.258129 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-543266b3-8879-45e6-adc4-fd7757b847db admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:02:20.259557 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-543266b3-8879-45e6-adc4-fd7757b847db admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061280 May 10 21:02:20.259557 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 22/44] 10.222.0.49 () {60 vars in 1190 bytes} [Tue May 10 21:02:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 21:02:20.265800 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-faad161f-fa2a-4ff0-8e84-f67e95100901 admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:02:20.279032 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-faad161f-fa2a-4ff0-8e84-f67e95100901 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016994 May 10 21:02:20.279580 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 23/45] 10.222.0.49 () {60 vars in 1210 bytes} [Tue May 10 21:02:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:02:20.288989 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-e8065d72-3bd3-4aac-a3e8-f82c3103089b admin admin] Calling method '>' {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:02:20.302856 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-e8065d72-3bd3-4aac-a3e8-f82c3103089b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017333 May 10 21:02:20.303401 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 23/46] 10.222.0.49 () {60 vars in 1210 bytes} [Tue May 10 21:02:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:02:20.315948 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-8fb37093-2ba0-4749-844b-e0975f481116 admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:02:20.321151 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.wsgi [None req-8fb37093-2ba0-4749-844b-e0975f481116 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 21:02:20.322623 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-8fb37093-2ba0-4749-844b-e0975f481116 admin admin] Request method failure captured: May 10 21:02:20.322623 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 21:02:20.322623 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: Accept: application/json May 10 21:02:20.322623 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: Accept-Encoding: gzip, deflate May 10 21:02:20.322623 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: Connection: keep-alive May 10 21:02:20.322623 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: Content-Length: 0 May 10 21:02:20.322623 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: Host: 10.222.0.49 May 10 21:02:20.322623 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: Openstack-Api-Version: compute 2.90 May 10 21:02:20.322623 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: Openstack-System-Scope: None May 10 21:02:20.322623 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: User-Agent: python-novaclient May 10 21:02:20.322623 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Auth-Token: gAAAAABietLcf8HaTg-_vR9tZ_IJPrkwiFSRyKC7rOcmUl1uMgjBJKLSJnvsY5M3o6Qe_c1wxOly-PkAzFBeVzaDvj4eTZib2VTkr2B6MHuQBaUaIvN-p-CzZY7wUJYmKGWzfcqZ5qApd84x1HoNHpPCUBGD1xMDc55Ni2b3IbFYY-tAbysQKkM May 10 21:02:20.322623 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Domain-Id: None May 10 21:02:20.322623 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Domain-Name: None May 10 21:02:20.322623 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Identity-Status: Confirmed May 10 21:02:20.322623 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Is-Admin-Project: True May 10 21:02:20.322623 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Openstack-Nova-Api-Version: 2.90 May 10 21:02:20.322623 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Project-Domain-Id: default May 10 21:02:20.322623 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Project-Domain-Name: Default May 10 21:02:20.322623 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Project-Id: 0505b6fc7edf412485d1ca7159b626ae May 10 21:02:20.322623 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Project-Name: admin May 10 21:02:20.322623 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Role: member,reader,admin May 10 21:02:20.322623 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Roles: member,reader,admin May 10 21:02:20.324233 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0505b6fc7edf412485d1ca7159b626ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0505b6fc7edf412485d1ca7159b626ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0505b6fc7edf412485d1ca7159b626ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0505b6fc7edf412485d1ca7159b626ae", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:02:20.324233 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Tenant: admin May 10 21:02:20.324233 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Tenant-Id: 0505b6fc7edf412485d1ca7159b626ae May 10 21:02:20.324233 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Tenant-Name: admin May 10 21:02:20.324233 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-User: admin May 10 21:02:20.324233 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-User-Domain-Id: default May 10 21:02:20.324233 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-User-Domain-Name: Default May 10 21:02:20.324233 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-User-Id: b4075d4b32a74f3abd78c38a5335cfb6 May 10 21:02:20.324233 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-User-Name: admin May 10 21:02:20.324233 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: method: > May 10 21:02:20.324233 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: exception: Flavor 84 could not be found. May 10 21:02:20.324233 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: action_args: {'id': '84'} May 10 21:02:20.324233 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:02:20.324233 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:02:20.325170 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 21:02:20.325170 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 21:02:20.325170 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 21:02:20.325170 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 21:02:20.325170 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 21:02:20.325170 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 21:02:20.325170 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 21:02:20.325170 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 21:02:20.325170 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 21:02:20.325170 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:02:20.325170 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 21:02:20.325170 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 21:02:20.325170 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 21:02:20.325170 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi May 10 21:02:20.325170 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:02:20.325170 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi May 10 21:02:20.325170 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:02:20.325170 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:02:20.325170 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:02:20.326412 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:02:20.326412 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:02:20.326412 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:02:20.326412 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:02:20.326412 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 21:02:20.326412 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 21:02:20.326412 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 21:02:20.326412 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi May 10 21:02:20.326412 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:02:20.326412 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi May 10 21:02:20.326412 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:02:20.326412 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:02:20.326412 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:02:20.326412 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:02:20.326412 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:02:20.326412 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 21:02:20.326412 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi May 10 21:02:20.326412 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-8fb37093-2ba0-4749-844b-e0975f481116 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103359) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:02:20.327715 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-8fb37093-2ba0-4749-844b-e0975f481116 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012330 May 10 21:02:20.327715 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 24/47] 10.222.0.49 () {60 vars in 1190 bytes} [Tue May 10 21:02:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 10 21:02:21.208594 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-e8065d72-3bd3-4aac-a3e8-f82c3103089b admin admin] Calling method '>' {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:02:21.209593 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-e8065d72-3bd3-4aac-a3e8-f82c3103089b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 May 10 21:02:21.209995 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 24/48] 10.222.0.49 () {56 vars in 1074 bytes} [Tue May 10 21:02:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:02:21.396716 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-8589b969-73cc-4a63-b8dc-89d0eb4b3bcb admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:02:21.402272 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.wsgi [None req-8589b969-73cc-4a63-b8dc-89d0eb4b3bcb admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 21:02:21.403794 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-8589b969-73cc-4a63-b8dc-89d0eb4b3bcb admin admin] Request method failure captured: May 10 21:02:21.403794 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 21:02:21.403794 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: Accept: application/json May 10 21:02:21.403794 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: Accept-Encoding: gzip, deflate May 10 21:02:21.403794 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: Connection: keep-alive May 10 21:02:21.403794 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: Content-Length: 0 May 10 21:02:21.403794 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: Host: 10.222.0.49 May 10 21:02:21.403794 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: Openstack-Api-Version: compute 2.90 May 10 21:02:21.403794 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: Openstack-System-Scope: None May 10 21:02:21.403794 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: User-Agent: python-novaclient May 10 21:02:21.403794 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Auth-Token: gAAAAABietLdOoQFgheSiCVj_wTBBB8olgK854hzJGcjSTjhbOZLAPGR-cHR_2e9S6DHvj4Fho_4ObHFzVGqLcK7RuPDerdh4BCr7MKeiYOYYgxRL_kJKVvH_Ij-FeikJYa73QyGOaTzuiHE4C9mYVkaNDlddznnvmM3nN-dDbq8pIhZ--bsSeg May 10 21:02:21.403794 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Domain-Id: None May 10 21:02:21.403794 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Domain-Name: None May 10 21:02:21.403794 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Identity-Status: Confirmed May 10 21:02:21.403794 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Is-Admin-Project: True May 10 21:02:21.403794 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Openstack-Nova-Api-Version: 2.90 May 10 21:02:21.403794 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Project-Domain-Id: default May 10 21:02:21.403794 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Project-Domain-Name: Default May 10 21:02:21.403794 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Project-Id: 0505b6fc7edf412485d1ca7159b626ae May 10 21:02:21.403794 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Project-Name: admin May 10 21:02:21.403794 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Role: member,reader,admin May 10 21:02:21.403794 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Roles: member,reader,admin May 10 21:02:21.405970 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0505b6fc7edf412485d1ca7159b626ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0505b6fc7edf412485d1ca7159b626ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0505b6fc7edf412485d1ca7159b626ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0505b6fc7edf412485d1ca7159b626ae", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:02:21.405970 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Tenant: admin May 10 21:02:21.405970 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Tenant-Id: 0505b6fc7edf412485d1ca7159b626ae May 10 21:02:21.405970 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-Tenant-Name: admin May 10 21:02:21.405970 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-User: admin May 10 21:02:21.405970 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-User-Domain-Id: default May 10 21:02:21.405970 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-User-Domain-Name: Default May 10 21:02:21.405970 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-User-Id: b4075d4b32a74f3abd78c38a5335cfb6 May 10 21:02:21.405970 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: X-User-Name: admin May 10 21:02:21.405970 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: method: > May 10 21:02:21.405970 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: exception: Flavor 451 could not be found. May 10 21:02:21.405970 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: action_args: {'id': '451'} May 10 21:02:21.405970 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:02:21.405970 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:02:21.406947 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 21:02:21.406947 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 21:02:21.406947 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 21:02:21.406947 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 21:02:21.406947 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 21:02:21.406947 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 21:02:21.406947 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 21:02:21.406947 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 21:02:21.406947 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 21:02:21.406947 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:02:21.406947 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 21:02:21.406947 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 21:02:21.406947 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 21:02:21.406947 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi May 10 21:02:21.406947 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:02:21.406947 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi May 10 21:02:21.406947 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:02:21.406947 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:02:21.406947 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:02:21.408358 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:02:21.408358 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:02:21.408358 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:02:21.408358 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:02:21.408358 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 21:02:21.408358 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 21:02:21.408358 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 21:02:21.408358 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi May 10 21:02:21.408358 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:02:21.408358 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi May 10 21:02:21.408358 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:02:21.408358 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:02:21.408358 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:02:21.408358 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:02:21.408358 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:02:21.408358 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 21:02:21.408358 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: ERROR nova.api.openstack.wsgi May 10 21:02:21.408358 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-8589b969-73cc-4a63-b8dc-89d0eb4b3bcb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103359) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:02:21.409586 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-8589b969-73cc-4a63-b8dc-89d0eb4b3bcb admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059277 May 10 21:02:21.409586 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 25/49] 10.222.0.49 () {60 vars in 1193 bytes} [Tue May 10 21:02:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 21:02:21.415882 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-5d1c53f1-40c5-4332-8ffd-e3aa63f5290e admin admin] Calling method '>' {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:02:21.430800 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-5d1c53f1-40c5-4332-8ffd-e3aa63f5290e admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018459 May 10 21:02:21.431316 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 25/50] 10.222.0.49 () {60 vars in 1210 bytes} [Tue May 10 21:02:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:02:21.441084 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-a39cbca4-3ead-4b72-ab5d-c2f9f627ad4a admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:02:21.455224 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-a39cbca4-3ead-4b72-ab5d-c2f9f627ad4a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018101 May 10 21:02:21.455756 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 26/51] 10.222.0.49 () {60 vars in 1210 bytes} [Tue May 10 21:02:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:02:21.470714 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-0bae6cc2-6dcc-4a89-b367-3d1616bd7330 admin admin] Calling method '>' {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:02:21.476113 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.wsgi [None req-0bae6cc2-6dcc-4a89-b367-3d1616bd7330 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 21:02:21.477670 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-0bae6cc2-6dcc-4a89-b367-3d1616bd7330 admin admin] Request method failure captured: May 10 21:02:21.477670 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 21:02:21.477670 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: Accept: application/json May 10 21:02:21.477670 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: Accept-Encoding: gzip, deflate May 10 21:02:21.477670 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: Connection: keep-alive May 10 21:02:21.477670 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: Content-Length: 0 May 10 21:02:21.477670 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: Host: 10.222.0.49 May 10 21:02:21.477670 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: Openstack-Api-Version: compute 2.90 May 10 21:02:21.477670 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: Openstack-System-Scope: None May 10 21:02:21.477670 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: User-Agent: python-novaclient May 10 21:02:21.477670 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Auth-Token: gAAAAABietLdOoQFgheSiCVj_wTBBB8olgK854hzJGcjSTjhbOZLAPGR-cHR_2e9S6DHvj4Fho_4ObHFzVGqLcK7RuPDerdh4BCr7MKeiYOYYgxRL_kJKVvH_Ij-FeikJYa73QyGOaTzuiHE4C9mYVkaNDlddznnvmM3nN-dDbq8pIhZ--bsSeg May 10 21:02:21.477670 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Domain-Id: None May 10 21:02:21.477670 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Domain-Name: None May 10 21:02:21.477670 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Identity-Status: Confirmed May 10 21:02:21.477670 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Is-Admin-Project: True May 10 21:02:21.477670 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Openstack-Nova-Api-Version: 2.90 May 10 21:02:21.477670 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Project-Domain-Id: default May 10 21:02:21.477670 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Project-Domain-Name: Default May 10 21:02:21.477670 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Project-Id: 0505b6fc7edf412485d1ca7159b626ae May 10 21:02:21.477670 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Project-Name: admin May 10 21:02:21.477670 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Role: member,reader,admin May 10 21:02:21.477670 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Roles: member,reader,admin May 10 21:02:21.479254 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0505b6fc7edf412485d1ca7159b626ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0505b6fc7edf412485d1ca7159b626ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0505b6fc7edf412485d1ca7159b626ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0505b6fc7edf412485d1ca7159b626ae", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:02:21.479254 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Tenant: admin May 10 21:02:21.479254 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Tenant-Id: 0505b6fc7edf412485d1ca7159b626ae May 10 21:02:21.479254 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-Tenant-Name: admin May 10 21:02:21.479254 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-User: admin May 10 21:02:21.479254 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-User-Domain-Id: default May 10 21:02:21.479254 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-User-Domain-Name: Default May 10 21:02:21.479254 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-User-Id: b4075d4b32a74f3abd78c38a5335cfb6 May 10 21:02:21.479254 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: X-User-Name: admin May 10 21:02:21.479254 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: method: > May 10 21:02:21.479254 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: exception: Flavor 451 could not be found. May 10 21:02:21.479254 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: action_args: {'id': '451'} May 10 21:02:21.479254 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:02:21.479254 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:02:21.480228 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 21:02:21.480228 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 21:02:21.480228 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 21:02:21.480228 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 21:02:21.480228 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 21:02:21.480228 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 21:02:21.480228 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 21:02:21.480228 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 21:02:21.480228 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 21:02:21.480228 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:02:21.480228 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 21:02:21.480228 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 21:02:21.480228 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 21:02:21.480228 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi May 10 21:02:21.480228 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:02:21.480228 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi May 10 21:02:21.480228 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:02:21.480228 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:02:21.480228 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:02:21.481526 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:02:21.481526 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:02:21.481526 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:02:21.481526 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:02:21.481526 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 21:02:21.481526 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 21:02:21.481526 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 21:02:21.481526 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi May 10 21:02:21.481526 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:02:21.481526 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi May 10 21:02:21.481526 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:02:21.481526 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:02:21.481526 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:02:21.481526 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:02:21.481526 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:02:21.481526 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 21:02:21.481526 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: ERROR nova.api.openstack.wsgi May 10 21:02:21.481526 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-0bae6cc2-6dcc-4a89-b367-3d1616bd7330 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:02:21.482751 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-0bae6cc2-6dcc-4a89-b367-3d1616bd7330 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012490 May 10 21:02:21.482751 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 26/52] 10.222.0.49 () {60 vars in 1193 bytes} [Tue May 10 21:02:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 21:02:22.381911 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-a39cbca4-3ead-4b72-ab5d-c2f9f627ad4a admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:02:22.382905 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-a39cbca4-3ead-4b72-ab5d-c2f9f627ad4a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 May 10 21:02:22.383343 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 27/53] 10.222.0.49 () {56 vars in 1074 bytes} [Tue May 10 21:02:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:02:22.577103 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-9b957751-4316-4748-9dd7-d626a5ba056a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:02:22.652698 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-9b957751-4316-4748-9dd7-d626a5ba056a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.128737 May 10 21:02:22.653233 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 27/54] 10.222.0.49 () {64 vars in 1235 bytes} [Tue May 10 21:02:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:02:23.541019 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-a39cbca4-3ead-4b72-ab5d-c2f9f627ad4a admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:02:23.542014 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-a39cbca4-3ead-4b72-ab5d-c2f9f627ad4a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 May 10 21:02:23.542411 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 28/55] 10.222.0.49 () {56 vars in 1074 bytes} [Tue May 10 21:02:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:02:23.731701 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-01c344dd-e776-41ce-817b-45f7689e5e62 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:02:23.801013 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-01c344dd-e776-41ce-817b-45f7689e5e62 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.119654 May 10 21:02:23.801479 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 28/56] 10.222.0.49 () {64 vars in 1235 bytes} [Tue May 10 21:02:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:02:24.691995 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-a39cbca4-3ead-4b72-ab5d-c2f9f627ad4a admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:02:24.692994 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-a39cbca4-3ead-4b72-ab5d-c2f9f627ad4a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 May 10 21:02:24.693397 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 29/57] 10.222.0.49 () {56 vars in 1074 bytes} [Tue May 10 21:02:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:02:24.883632 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-4c0cee4a-7add-4405-b28c-09a2b916aa13 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:02:24.968372 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-4c0cee4a-7add-4405-b28c-09a2b916aa13 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.135787 May 10 21:02:24.968978 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 29/58] 10.222.0.49 () {64 vars in 1235 bytes} [Tue May 10 21:02:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:02:25.862183 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-a39cbca4-3ead-4b72-ab5d-c2f9f627ad4a admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:02:25.863195 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-a39cbca4-3ead-4b72-ab5d-c2f9f627ad4a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 May 10 21:02:25.863594 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 30/59] 10.222.0.49 () {56 vars in 1074 bytes} [Tue May 10 21:02:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:02:26.053373 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-a80af91a-1b89-445e-9f2f-04880ab22ff3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:02:26.129039 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-a80af91a-1b89-445e-9f2f-04880ab22ff3 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.126719 May 10 21:02:26.129593 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 30/60] 10.222.0.49 () {64 vars in 1235 bytes} [Tue May 10 21:02:26 2022] POST /compute/v2.1/flavors => generated 409 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:02:27.023520 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-a39cbca4-3ead-4b72-ab5d-c2f9f627ad4a admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:02:27.024510 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-a39cbca4-3ead-4b72-ab5d-c2f9f627ad4a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 May 10 21:02:27.024910 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 31/61] 10.222.0.49 () {56 vars in 1074 bytes} [Tue May 10 21:02:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:02:27.210529 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-2787621c-f70c-47c1-8433-c2991bf96122 admin admin] Calling method '>' {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:02:27.229600 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-2787621c-f70c-47c1-8433-c2991bf96122 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070479 May 10 21:02:27.230132 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 31/62] 10.222.0.49 () {60 vars in 1202 bytes} [Tue May 10 21:02:27 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:03:29.663438 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-a39cbca4-3ead-4b72-ab5d-c2f9f627ad4a admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:03:29.664442 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-a39cbca4-3ead-4b72-ab5d-c2f9f627ad4a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 May 10 21:03:29.664823 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 32/63] 10.222.0.49 () {54 vars in 930 bytes} [Tue May 10 21:03:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:03:29.722509 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-9b8ae33b-117d-4e67-98a8-0e8f0e3d2b13 admin admin] Calling method '>' {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:03:29.742099 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-9b8ae33b-117d-4e67-98a8-0e8f0e3d2b13 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070416 May 10 21:03:29.742640 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 32/64] 10.222.0.49 () {60 vars in 1291 bytes} [Tue May 10 21:03:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:03:29.766948 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-7cf4427e-34d1-4b47-84ee-853b01e2f753 admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:03:29.774462 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-7cf4427e-34d1-4b47-84ee-853b01e2f753 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011681 May 10 21:03:29.774982 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 33/65] 10.222.0.49 () {60 vars in 1282 bytes} [Tue May 10 21:03:29 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:03:29.786484 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-f32884f4-6663-444f-b266-7b01699d6ff0 admin admin] Calling method '>' {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:03:29.793854 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-f32884f4-6663-444f-b266-7b01699d6ff0 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010856 May 10 21:03:29.794357 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 33/66] 10.222.0.49 () {60 vars in 1285 bytes} [Tue May 10 21:03:29 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:03:29.806206 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-13233400-936b-4533-b1da-5030cbc408dc admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:03:29.813789 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-13233400-936b-4533-b1da-5030cbc408dc admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011338 May 10 21:03:29.814311 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 34/67] 10.222.0.49 () {60 vars in 1285 bytes} [Tue May 10 21:03:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:03:29.825295 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-df12a7dd-3f6d-4956-9da5-e529c053baec admin admin] Calling method '>' {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:03:29.832632 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-df12a7dd-3f6d-4956-9da5-e529c053baec admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010866 May 10 21:03:29.833138 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 34/68] 10.222.0.49 () {60 vars in 1282 bytes} [Tue May 10 21:03:29 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:06:55.015894 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-13233400-936b-4533-b1da-5030cbc408dc admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:06:55.016920 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-13233400-936b-4533-b1da-5030cbc408dc admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 May 10 21:06:55.017308 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 35/69] 10.222.0.49 () {56 vars in 1074 bytes} [Tue May 10 21:06:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:06:55.282604 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-f7c9139c-fa9b-4cc9-929c-f02e87fcbb39 admin admin] Calling method '>' {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:06:55.283610 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 21:06:55.283610 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: warnings.warn(msg) May 10 21:06:55.284907 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG oslo_concurrency.lockutils [None req-f7c9139c-fa9b-4cc9-929c-f02e87fcbb39 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:06:55.285353 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG oslo_concurrency.lockutils [None req-f7c9139c-fa9b-4cc9-929c-f02e87fcbb39 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:06:55.286170 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG oslo_concurrency.lockutils [None req-f7c9139c-fa9b-4cc9-929c-f02e87fcbb39 admin admin] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:06:55.286663 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG oslo_concurrency.lockutils [None req-f7c9139c-fa9b-4cc9-929c-f02e87fcbb39 admin admin] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:06:55.321856 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-f7c9139c-fa9b-4cc9-929c-f02e87fcbb39 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152987 May 10 21:06:55.322417 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 35/70] 10.222.0.49 () {60 vars in 1193 bytes} [Tue May 10 21:06:55 2022] GET /compute/v2.1/os-services => generated 791 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:06:56.233359 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-13233400-936b-4533-b1da-5030cbc408dc admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:06:56.234310 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-13233400-936b-4533-b1da-5030cbc408dc admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 May 10 21:06:56.234736 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 36/71] 10.222.0.49 () {56 vars in 1074 bytes} [Tue May 10 21:06:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:06:56.422542 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-31e0e7ff-d9c2-4d01-9f8e-2e44a48507ed admin admin] Calling method '>' {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:06:56.423747 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 21:06:56.423747 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: warnings.warn(msg) May 10 21:06:56.424925 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG oslo_concurrency.lockutils [None req-31e0e7ff-d9c2-4d01-9f8e-2e44a48507ed admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:06:56.425364 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG oslo_concurrency.lockutils [None req-31e0e7ff-d9c2-4d01-9f8e-2e44a48507ed admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:06:56.426145 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG oslo_concurrency.lockutils [None req-31e0e7ff-d9c2-4d01-9f8e-2e44a48507ed admin admin] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:06:56.426573 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG oslo_concurrency.lockutils [None req-31e0e7ff-d9c2-4d01-9f8e-2e44a48507ed admin admin] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:06:56.446089 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-31e0e7ff-d9c2-4d01-9f8e-2e44a48507ed admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074831 May 10 21:06:56.446624 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 36/72] 10.222.0.49 () {60 vars in 1193 bytes} [Tue May 10 21:06:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:07:07.770063 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-13233400-936b-4533-b1da-5030cbc408dc admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:07:07.771054 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-13233400-936b-4533-b1da-5030cbc408dc admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 May 10 21:07:07.771479 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 37/73] 10.222.0.49 () {56 vars in 1074 bytes} [Tue May 10 21:07:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:07:07.967601 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-ed1cb541-c05e-4c00-9807-ebb6b8de5c7c admin admin] Calling method '>' {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:07:07.968760 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 21:07:07.968760 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: warnings.warn(msg) May 10 21:07:07.969928 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG oslo_concurrency.lockutils [None req-ed1cb541-c05e-4c00-9807-ebb6b8de5c7c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:07:07.970401 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG oslo_concurrency.lockutils [None req-ed1cb541-c05e-4c00-9807-ebb6b8de5c7c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:07:07.971227 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG oslo_concurrency.lockutils [None req-ed1cb541-c05e-4c00-9807-ebb6b8de5c7c admin admin] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:07:07.971654 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG oslo_concurrency.lockutils [None req-ed1cb541-c05e-4c00-9807-ebb6b8de5c7c admin admin] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:07:07.996820 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-ed1cb541-c05e-4c00-9807-ebb6b8de5c7c admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081542 May 10 21:07:07.997361 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 37/74] 10.222.0.49 () {60 vars in 1193 bytes} [Tue May 10 21:07:07 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:07:08.890070 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: DEBUG nova.api.openstack.wsgi [None req-13233400-936b-4533-b1da-5030cbc408dc admin admin] Calling method '>' {{(pid=103359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:07:08.891069 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: INFO nova.api.openstack.requestlog [None req-13233400-936b-4533-b1da-5030cbc408dc admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 May 10 21:07:08.891507 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: [pid: 103359|app: 0|req: 38/75] 10.222.0.49 () {56 vars in 1074 bytes} [Tue May 10 21:07:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:07:09.082082 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG nova.api.openstack.wsgi [None req-ac38ae29-e352-4d1f-a669-cd41c899ec5a admin admin] Calling method '>' {{(pid=103358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:07:09.083282 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 21:07:09.083282 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: warnings.warn(msg) May 10 21:07:09.084460 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG oslo_concurrency.lockutils [None req-ac38ae29-e352-4d1f-a669-cd41c899ec5a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:07:09.084905 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG oslo_concurrency.lockutils [None req-ac38ae29-e352-4d1f-a669-cd41c899ec5a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:07:09.085688 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG oslo_concurrency.lockutils [None req-ac38ae29-e352-4d1f-a669-cd41c899ec5a admin admin] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:07:09.086116 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: DEBUG oslo_concurrency.lockutils [None req-ac38ae29-e352-4d1f-a669-cd41c899ec5a admin admin] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:07:09.108671 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: INFO nova.api.openstack.requestlog [None req-ac38ae29-e352-4d1f-a669-cd41c899ec5a admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.075745 May 10 21:07:09.109171 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: [pid: 103358|app: 0|req: 38/76] 10.222.0.49 () {60 vars in 1193 bytes} [Tue May 10 21:07:09 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:08:06.247093 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: Tue May 10 21:08:06 2022 - graceful shutdown triggered... May 10 21:08:06.246833 dv-cinder-828807-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 10 21:08:06.248310 dv-cinder-828807-2-iscsi devstack@n-api.service[103358]: Gracefully killing worker 1 (pid: 103358)... May 10 21:08:06.248816 dv-cinder-828807-2-iscsi devstack@n-api.service[103359]: Gracefully killing worker 2 (pid: 103359)... May 10 21:08:07.247523 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: worker 1 buried after 1 seconds May 10 21:08:07.247523 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: worker 2 buried after 1 seconds May 10 21:08:07.248161 dv-cinder-828807-2-iscsi devstack@n-api.service[103357]: goodbye to uWSGI. May 10 21:08:07.249092 dv-cinder-828807-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 10 21:08:07.249662 dv-cinder-828807-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 10 21:08:07.252365 dv-cinder-828807-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 10 21:08:07.272376 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 21:08:07.298062 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 21:08:07 2022] *** May 10 21:08:07.298062 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 21:08:07.298062 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 21:08:07.298062 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: nodename: dv-cinder-828807-2-iscsi May 10 21:08:07.298062 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: machine: x86_64 May 10 21:08:07.298062 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: clock source: unix May 10 21:08:07.298062 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: pcre jit disabled May 10 21:08:07.298062 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: detected number of CPU cores: 4 May 10 21:08:07.298062 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: current working directory: / May 10 21:08:07.298062 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: detected binary path: /usr/bin/uwsgi-core May 10 21:08:07.298062 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: your processes number limit is 47680 May 10 21:08:07.298923 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: your memory page size is 4096 bytes May 10 21:08:07.298923 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: detected max file descriptor number: 2048 May 10 21:08:07.298923 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: lock engine: pthread robust mutexes May 10 21:08:07.298923 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: thunder lock: enabled May 10 21:08:07.298923 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 21:08:07.298923 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 21:08:07.345984 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: Python main interpreter initialized at 0x555e43bef9c0 May 10 21:08:07.345984 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: python threads support enabled May 10 21:08:07.345984 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: your server socket listen backlog is limited to 100 connections May 10 21:08:07.345984 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: your mercy for graceful operations on workers is 90 seconds May 10 21:08:07.346429 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: mapped 403077 bytes (393 KB) for 2 cores May 10 21:08:07.346429 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: *** Operational MODE: preforking *** May 10 21:08:07.346692 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: *** uWSGI is running in multiple interpreter mode *** May 10 21:08:07.346692 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: spawned uWSGI master process (pid: 117691) May 10 21:08:07.346899 dv-cinder-828807-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 10 21:08:07.357380 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: spawned uWSGI worker 1 (pid: 117713, cores: 1) May 10 21:08:07.357380 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: spawned uWSGI worker 2 (pid: 117714, cores: 1) May 10 21:08:07.357380 dv-cinder-828807-2-iscsi devstack@n-api.service[117691]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 21:08:08.571691 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 21:08:08.579062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 21:08:09.385143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 21:08:09.385143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: from cryptography.utils import int_from_bytes May 10 21:08:09.385473 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 21:08:09.385473 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: from cryptography.utils import int_from_bytes May 10 21:08:09.394704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 21:08:09.394704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: from cryptography.utils import int_from_bytes May 10 21:08:09.395027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 21:08:09.395027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: from cryptography.utils import int_from_bytes May 10 21:08:11.859412 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 21:08:11.859952 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 21:08:11.860214 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 21:08:11.860584 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 21:08:11.860846 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 21:08:11.861244 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.861585 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.861918 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.862249 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.862589 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.862909 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.863269 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.863604 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.863946 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.864214 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.864542 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.864876 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828807-2-iscsi {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.865212 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.865526 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.865853 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.866181 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.866495 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.866830 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.867167 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.867682 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.868144 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.868464 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.868786 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.871081 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.871081 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.871081 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.871081 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.871081 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.871081 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.871081 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.871690 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828807-2-iscsi {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.871782 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.872106 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.872406 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.872835 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.873158 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.873480 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.873839 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.874446 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.874446 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.874860 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.875216 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.875548 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.875881 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.876192 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.876508 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.876828 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.877158 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.877472 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.877786 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.878041 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.878359 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.878690 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.879022 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.879381 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.879640 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.879896 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.880225 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.880555 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.880872 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.881188 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.881512 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.881827 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.882143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.882459 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.882778 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.883092 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.883446 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.883773 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.884106 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.884425 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.884754 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.885160 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.885419 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.885734 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.886084 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.886411 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.886707 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 21:08:11.887231 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.887369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 21:08:11.887508 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.887508 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.887782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 21:08:11.887938 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.888081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 21:08:11.888213 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.888358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 21:08:11.888509 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.888650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.888783 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.888921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.889052 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.889190 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.889334 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.889474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.890034 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.890034 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.890317 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.890317 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.890591 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.890733 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.890877 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.891018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.891167 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.891389 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.891544 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.891661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.891802 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.891944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.892085 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.892232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828807-2-iscsi {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.892365 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.892504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.892644 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.892803 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.893034 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.893189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.893323 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.893461 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.893599 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.893742 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.893882 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.894026 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.894158 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.894289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.894426 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.894426 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.894674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.894841 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.894984 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.895153 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.895288 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.895431 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.895579 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.895718 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.895850 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.895987 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.896128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.896269 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.896408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.896598 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.896742 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.896915 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.897060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.897231 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.897375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.897563 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.897698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.897879 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.898016 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828807-2-iscsi {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.898195 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.898448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.898601 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.898726 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.898846 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.899000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.899154 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.899446 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.909357 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.909357 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.909606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.909701 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.909789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.909873 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.909968 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.910054 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.910140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.910224 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.910318 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.910404 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.910499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.910592 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.910684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.910771 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.910855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.910948 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.911036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.911169 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.911271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.911366 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.911460 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.911558 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.911645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.911736 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.911821 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.911912 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.912029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.912129 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.912223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.912223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.912378 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.912463 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.912547 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.912643 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.912729 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.912822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.912908 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.913002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.913106 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.913379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.913379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.913571 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.913667 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.913761 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.913858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.913945 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.914031 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.914122 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.914208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.914309 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.914396 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.914489 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.914575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.914666 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.914869 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.914977 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.915073 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.915176 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.915276 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.915377 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.915377 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.915556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.915650 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.915740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.915831 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.915924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.916016 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.916110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.916196 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.916280 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.916417 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.916516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.916741 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.916846 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.916940 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.917036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.917122 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.917207 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.917305 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.917399 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.917491 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.917584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.917670 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.917762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.917859 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.917952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.917952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.918116 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.918210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.918304 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.918403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.918496 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.918588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.918680 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.918772 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.918870 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.918963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.919054 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.919158 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.919255 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.919348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.919442 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.919534 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.919626 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.919711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.919794 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.919877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.919973 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.920109 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.920206 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.920292 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.920376 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.920468 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.920567 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.920660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.921698 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.921812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.921907 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.922009 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.922102 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.922188 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.922281 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.922376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.922376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.922547 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.922635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.922719 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.922810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.922903 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.922989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.923170 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.923294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.923448 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.923448 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.923448 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.923448 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.923448 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.923898 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.923992 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.924087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.924231 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.924329 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.924428 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.924570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.924670 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.924765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.924867 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.924967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.925071 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.925173 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.925260 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.925352 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.925448 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.925535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.925728 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.925835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.926051 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.926156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.926370 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.926475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.926696 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.926805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.927018 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.927142 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.927364 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.927461 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.927693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.927798 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.928004 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.928107 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.928316 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.928415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.928636 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.928735 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.928950 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.929058 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.929258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.929350 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.929568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.929662 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.929880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.929984 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.930189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.930283 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.930501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.930609 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.930810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.930916 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.931158 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.931257 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.931449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.931544 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.931773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.931868 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.932103 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.932195 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.932420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.932521 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.932735 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.932830 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.933048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.933142 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.933376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 21:08:11.933505 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.933699 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.933845 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.934013 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.934149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.934332 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.934477 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.934896 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.935033 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.935235 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.935408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.935552 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.935703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.935873 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.936017 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.936184 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.936333 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.936645 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.937140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.937277 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.937419 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.937561 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.937702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.937849 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.937984 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.938124 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.938256 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.938388 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.938517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.938659 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.938792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.938913 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.939055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.939272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.939419 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.939629 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.939772 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.939911 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.940044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.940176 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.940315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.940493 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.940630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.940823 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.940960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.941158 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.941305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.941490 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.941634 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.941820 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.941963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.942142 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.942288 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.942464 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.942601 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.942788 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.942967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.943109 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.943288 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.943451 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.943579 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.943775 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.943919 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.944090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.944238 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.944411 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.944544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.944746 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.944890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.945062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.945207 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.945386 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.945522 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.945696 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.945831 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.946013 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.946156 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.946330 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.946475 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.946648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.946775 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.946966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.947103 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.947329 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.947477 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.947650 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.947784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.947969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.948103 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.948286 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.948419 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.948603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.948744 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.948922 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.949056 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.949242 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.949378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.949570 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.949716 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.949890 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.950038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.950216 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.950351 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.950538 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.950683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.950872 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.951005 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.951209 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.951338 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.951538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.951683 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.951847 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.952008 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.952569 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.952705 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.952837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.952980 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.953113 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.953252 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.953392 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.953524 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.953664 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.953805 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.953927 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.954056 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.954187 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.954319 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.954458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.954590 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.954728 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.954868 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.955008 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.955181 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.955332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.955467 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.955598 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.955728 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.955861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.955991 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.956191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.956328 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.956503 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.956646 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.956813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.956970 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.957133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.957277 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.957450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.957596 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.957767 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.957917 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.958081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.958216 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.958399 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.958534 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.958728 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.958881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.959044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.959208 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.959390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.959533 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.959721 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.959868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.960036 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.960181 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.960346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.960480 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.960676 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.960810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.960996 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.961146 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.961311 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.961446 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.961621 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.961756 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.961930 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.962065 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.962238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.962380 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.962548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.962683 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.962856 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.962992 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.963177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.963324 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.963496 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.963632 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.963805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.963940 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.964114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.964264 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.964405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.964545 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.964714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.964856 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.965040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.965177 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.965356 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.965506 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.965667 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.965810 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.965977 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.966121 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.966267 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.966401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.966596 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.966731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.966915 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.967063 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.967271 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.967411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.968128 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.968663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.968819 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.968954 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.969085 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.969217 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.969348 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.969489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.969705 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.969847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.969988 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.970120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.970120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.970368 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.970515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.970648 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.970780 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.970910 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.971049 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.971213 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.971366 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.971551 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.971687 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.971868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.972004 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.972199 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.972347 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.972516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.972661 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.972841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.972977 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.973150 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.973300 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.973473 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.973616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.973789 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.973927 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.974102 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.974237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.974424 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.974560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.974738 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.974882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.975052 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.975303 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.975437 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.975585 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.975718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.975858 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.975998 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.976129 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.976297 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.976445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.976607 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.976750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.976921 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.977049 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.977235 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.977387 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.977545 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.977679 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.977858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.977992 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.978167 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.978309 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.978485 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.978628 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.978799 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.978942 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.979086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.979239 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.979434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.979579 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.979743 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.979885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.980089 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.980231 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.980399 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.980533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.980715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.980857 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.981040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.981176 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.981355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.981499 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.981671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.981817 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.981987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.982124 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.982298 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.982441 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.982608 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.982758 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.982921 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.983062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.983868 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.984367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.984515 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.984515 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.984792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.984924 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.985046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.985178 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.985317 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.985459 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.985591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.985729 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.985868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.986000 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.986130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.986272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.986416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.986548 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.986680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.986818 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.986987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.987172 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.987320 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.987453 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.987646 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.987782 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.987975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.988111 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.988289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.988440 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.988600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.988735 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.988931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.989077 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.989246 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.989389 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.989551 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.989686 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.989862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.989998 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.990169 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.990313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.990481 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.990627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.990794 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.990931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.991137 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.991280 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.991457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.991594 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.991767 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.991896 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.992086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.992212 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.992404 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.992539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.992717 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.992838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.993027 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.993163 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.993344 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.993518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.993649 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.993763 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.993952 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.994097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.994268 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.994413 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.994586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.994729 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.994902 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.995045 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.995240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.995378 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.995557 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.995694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.995871 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.996014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.996184 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.996328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.996494 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.996637 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.996800 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.996942 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.997108 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.997243 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.997420 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.997554 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.997730 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.997991 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.998136 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.998329 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.998466 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.998651 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.998816 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:11.999656 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.000591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.000751 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.000888 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.001029 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.001171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.001171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.001444 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.001584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.001724 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.001865 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.002084 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.002229 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.002371 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.002504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.002649 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.002790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.002930 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.003065 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.003220 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.003354 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.003506 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.003640 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.003768 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.003908 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.004048 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.004180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.004324 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.004458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.004598 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.004745 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.004877 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.005018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.005160 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.005292 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.005422 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.005543 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.005682 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.005823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.005963 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.006095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.006236 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.006376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.006508 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.006650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.006790 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.006931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.007064 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.007255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.007255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.007598 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.007740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.007880 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.008013 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.008144 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.008294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.008435 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.008575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.008716 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.008716 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.008965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.009107 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.009248 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.009384 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.009516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.009655 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.009796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.009938 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.010087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.010220 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.010353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.010485 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.010616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.010757 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.010891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.010891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.011154 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.011299 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.011449 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.011582 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.011713 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.011846 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.011978 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.012110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.012255 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.012396 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.012530 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.012661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.012792 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.012932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.013077 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.013211 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.013343 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.013547 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.013681 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.013814 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.014016 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.014155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.014338 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.014515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.014804 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.014984 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.015207 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.015353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.015503 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.015749 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.015902 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.016088 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.016229 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.016415 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.016550 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.016743 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.017053 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.017201 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.017447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.017587 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.017774 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.017913 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.018100 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.018315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.018448 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.018714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.018847 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.019034 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.019242 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.019450 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.019598 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.019729 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.020018 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.020157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.020334 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.020468 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.020670 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.020804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.020986 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.021257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.021399 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.021652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.021793 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.022039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.022180 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.022354 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.022495 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.022784 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.022918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.023105 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.023257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.023452 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.023608 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.023788 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.024033 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.024174 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.024447 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.024597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.024758 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.024906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.025130 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.025272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.025402 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.025643 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.025778 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.026030 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.026170 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.026352 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.026562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.026705 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.026961 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.027088 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.027336 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.027471 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.027672 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.027870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.028003 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.028260 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.028403 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.028660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.028803 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.029050 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.029190 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.029372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.029512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.029706 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.029961 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.030626 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.030959 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.031223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.031379 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.031622 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.031769 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.031937 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.032121 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.032255 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.032577 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.032758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.032901 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.033165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.033307 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.033510 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.033648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.033833 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.034032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.034165 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.034433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.034582 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.034770 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.034940 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.035074 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.035430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.035592 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.035751 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.035890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.036085 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.036305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.036438 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.036717 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.036855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.037052 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.037193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.037374 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.037608 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.037751 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.037989 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.038135 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.038307 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.038448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.038660 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.038932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.039067 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.039319 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.039452 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.039662 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.039835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.040002 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.040290 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.040507 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.040639 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.040769 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.040973 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.041115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.041305 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.041518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.041651 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.041912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.042046 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.042249 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.042390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.042562 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.042705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.042883 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.043092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.043299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.043522 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.043661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.043835 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.043977 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.044154 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.044321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.044462 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.044769 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.044915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.045070 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.045273 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.045407 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.045742 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.046645 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.046778 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.046972 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.047211 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.047359 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.047624 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.047765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.047941 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.048084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.048294 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.048492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.048633 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.048884 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.049026 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.049255 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.049394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.049589 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.049741 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.049927 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.050137 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.050281 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.050568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.050709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.050895 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.051037 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.051255 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.051462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.051597 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.051857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.051998 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.052211 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.052444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.052591 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.052848 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.053000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.053170 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.053408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.053550 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.053810 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.053941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.054139 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.054320 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.054687 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.054844 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.055037 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.055223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.055364 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.055677 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.055817 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.056001 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.056269 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.056416 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.056635 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.056835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.056978 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.057265 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.057398 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.057589 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.057786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.057926 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.058213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.058356 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.058552 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.058685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.058888 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.059045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.059264 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.059480 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.059882 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.060176 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.060308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.060500 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.060669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.060811 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.061062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.061195 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.061536 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.061689 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.061965 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.062106 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.062237 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.062367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.062496 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.062732 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.062868 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.063086 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.063300 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.063436 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.063711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.063858 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.064046 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.064178 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.064371 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.064618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.064761 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.065075 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.065218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.065358 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.065511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.065645 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.065932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.066075 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.066284 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.066416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.066609 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.066749 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.066960 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.067265 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.067414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.067796 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.067937 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.068121 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.068275 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.068463 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.068683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.068816 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.069100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.069248 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.069429 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.069560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.069757 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.069897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.070093 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.070324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.070465 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.070706 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.070837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.071027 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.071235 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.071389 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.071641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.071774 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.072001 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.072139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.072320 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.072617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.072767 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.072948 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.073081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.073268 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.073450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.073808 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.073950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.074167 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.074311 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.074491 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.074633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.074825 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.075017 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.075184 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.075500 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.075650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.075817 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.075958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.076150 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.076337 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.076471 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.076743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.076877 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.077197 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.077571 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.077786 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.077964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.078126 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.078126 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.078383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.078515 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.078645 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.078772 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.078915 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.079148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.079297 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.079545 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.079686 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.079882 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.080015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.080197 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.080379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.080514 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.080809 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.080955 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.081129 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.081308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.081450 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.081727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.081868 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.082045 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.082178 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.082357 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.082560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.082695 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.082972 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.083112 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.083318 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.083453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.083631 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.083810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.083943 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.084205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.084347 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.084553 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.084684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.084924 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.085067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.085259 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.085474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.085615 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.085869 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.086009 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.086191 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.086360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.086494 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.086784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.086919 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.087158 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.087313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.087477 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.087832 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.087966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.088158 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.088344 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.088702 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.088847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.089050 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.089184 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.089385 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.089587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.089722 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.089983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.090124 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.090371 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.090503 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.090690 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.090824 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.091010 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.091363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.091499 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.091690 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.091938 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.092082 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.092317 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.092450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.093171 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.093420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.093566 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.093808 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.093940 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.094129 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.094271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.094450 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.094660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.094800 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.095064 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.095257 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.095402 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.095555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.095762 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.096011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.096152 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.096358 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.096499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.096688 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.096829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.097015 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.097155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.097340 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.097553 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.097694 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.097988 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.098136 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.098289 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.098506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.098649 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.098911 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.099052 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.099260 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.099396 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.099600 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.099811 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.099945 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.100221 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.100353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.100616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.100759 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.100956 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.101156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.101290 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.101564 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.101699 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.101912 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.102043 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.102227 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.102368 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.102558 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.102769 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.102912 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.103191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.103328 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.103526 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.103671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.103864 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.104012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.104214 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.104411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.104544 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.104814 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.104962 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.105177 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.105317 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.105491 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.105639 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.105848 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.106121 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.106344 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.106478 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.106750 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.106893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.107064 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.107224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.107401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.107582 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.107715 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.107981 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.108780 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.108950 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.109068 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.109277 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.109573 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.109720 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.109903 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.110044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.110217 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.110382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.110523 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.110781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.110916 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.111171 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.111308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.111461 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.111729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.111862 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.112086 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.112220 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.112397 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.112566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.112707 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.112990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.113134 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.113304 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.113436 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.113616 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.113795 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.113958 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.114201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.114345 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.114597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.114731 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.114932 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.115077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.115277 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.115482 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.115624 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.115890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.116102 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.116237 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.116373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.116556 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.116773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.116901 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.117187 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.117321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.117527 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.117662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.117846 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.118013 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.118159 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.118476 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.118610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.118797 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.118931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.119115 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.119351 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.119491 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.119778 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.119911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.120115 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.120258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.120432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.120598 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.120768 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.121013 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.121140 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.121413 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.121554 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.121747 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.121975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.122109 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.122378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.122520 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.122701 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.122840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.123023 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.123202 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.123380 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.123702 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.123948 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.124109 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.124361 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.124502 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.124717 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.124850 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.125058 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.125191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.125395 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.125600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.125743 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.126125 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.126267 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.126406 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.126534 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.126717 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.126946 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.127087 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.127426 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.127547 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.127753 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.127979 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.128114 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.128378 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.128502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.128614 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 21:08:12.128891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.129438 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.130071 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.130379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.130737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.131113 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.131615 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.132205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.132605 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.132980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.133392 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.133771 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.134139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.134495 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.134867 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.135256 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.135639 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.136008 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.136476 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.136832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.137189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.137551 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.137921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.138275 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.138671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.139052 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.139495 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.139980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.140405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.140764 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.141208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.141683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.142044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.142402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.142764 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.143144 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.143523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.143885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.144240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.144601 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.144958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.145319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.145727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.146104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.146747 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.147294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.147938 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.148313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.148859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.149345 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.149895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.150517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.151084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.152010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.152433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.152814 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.153218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.153354 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_db.sqlalchemy.engines [None req-5ef26991-d087-4713-bbd9-626cedddb2f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117713) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:08:12.153726 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.154115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.154520 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.154885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.156010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.156592 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.157035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.157463 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.157951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.158511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.158984 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.159461 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.159886 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.160311 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.160827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.161315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.161670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.162104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.162560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.162995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.163491 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.163916 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.164351 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.164779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.165206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.165626 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.166055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.166479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.166998 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.167457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.167872 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.168407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.168832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.169265 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.169704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.170130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.170587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.171094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.171553 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.171982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.172419 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.172895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.173356 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.173799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.174238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.174659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.175074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.175514 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.175941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.176371 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.176793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.177276 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.177684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.178107 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.178515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.178952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.179397 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.179819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.180238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.180672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.181090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.181540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.181958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.182400 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.182812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.183480 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.183798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.184213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.184890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.185307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.185720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.186165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.187363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.187851 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.188294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.188714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.189152 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.189574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.190005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.190471 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.190858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.191272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.191683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.192075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.192487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.192967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.193534 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.193954 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.194324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.194713 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.195091 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.195550 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.196077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.196456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.197068 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.197566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.198084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.198657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.199211 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.199770 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.200309 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.200859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.201406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.202143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.202635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.203245 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.203851 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.204496 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.205079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.205628 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.206027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.206556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.206966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.207453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.207929 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.208378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 21:08:12.208761 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 21:08:12.219092 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.context [None req-5ef26991-d087-4713-bbd9-626cedddb2f2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a9a66363-11d1-480a-8132-cac751fafba9(cell1) {{(pid=117713) load_cells /opt/stack/nova/nova/context.py:464}} May 10 21:08:12.223507 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5ef26991-d087-4713-bbd9-626cedddb2f2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:08:12.225099 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5ef26991-d087-4713-bbd9-626cedddb2f2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:08:12.225920 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5ef26991-d087-4713-bbd9-626cedddb2f2 None None] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:08:12.227915 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5ef26991-d087-4713-bbd9-626cedddb2f2 None None] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:08:12.234627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_db.sqlalchemy.engines [None req-4cf1fd50-b433-48fa-aa80-5c7e2697cac8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117714) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:08:12.239914 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_db.sqlalchemy.engines [None req-5ef26991-d087-4713-bbd9-626cedddb2f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117713) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:08:12.242320 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_db.sqlalchemy.engines [None req-5ef26991-d087-4713-bbd9-626cedddb2f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117713) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:08:12.301687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.context [None req-4cf1fd50-b433-48fa-aa80-5c7e2697cac8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a9a66363-11d1-480a-8132-cac751fafba9(cell1) {{(pid=117714) load_cells /opt/stack/nova/nova/context.py:464}} May 10 21:08:12.306038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4cf1fd50-b433-48fa-aa80-5c7e2697cac8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:08:12.307701 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4cf1fd50-b433-48fa-aa80-5c7e2697cac8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:08:12.308531 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4cf1fd50-b433-48fa-aa80-5c7e2697cac8 None None] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:08:12.310761 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4cf1fd50-b433-48fa-aa80-5c7e2697cac8 None None] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:08:12.322504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_db.sqlalchemy.engines [None req-4cf1fd50-b433-48fa-aa80-5c7e2697cac8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117714) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:08:12.324766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_db.sqlalchemy.engines [None req-4cf1fd50-b433-48fa-aa80-5c7e2697cac8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117714) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:08:12.406423 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_db.sqlalchemy.engines [None req-5ef26991-d087-4713-bbd9-626cedddb2f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117713) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:08:12.490097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_db.sqlalchemy.engines [None req-4cf1fd50-b433-48fa-aa80-5c7e2697cac8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117714) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 21:08:12.733050 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: WARNING keystonemiddleware.auth_token [None req-5ef26991-d087-4713-bbd9-626cedddb2f2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 21:08:12.740763 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: WARNING keystonemiddleware.auth_token [None req-5ef26991-d087-4713-bbd9-626cedddb2f2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 21:08:12.819258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: WARNING keystonemiddleware.auth_token [None req-4cf1fd50-b433-48fa-aa80-5c7e2697cac8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 21:08:12.828485 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: WARNING keystonemiddleware.auth_token [None req-4cf1fd50-b433-48fa-aa80-5c7e2697cac8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 21:08:13.092459 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: WARNING keystonemiddleware.auth_token [None req-5ef26991-d087-4713-bbd9-626cedddb2f2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 21:08:13.099338 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: WARNING keystonemiddleware.auth_token [None req-5ef26991-d087-4713-bbd9-626cedddb2f2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 21:08:13.104682 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555e43bef9c0 pid: 117713 (default app) May 10 21:08:13.176644 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: WARNING keystonemiddleware.auth_token [None req-4cf1fd50-b433-48fa-aa80-5c7e2697cac8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 21:08:13.182960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: WARNING keystonemiddleware.auth_token [None req-4cf1fd50-b433-48fa-aa80-5c7e2697cac8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 21:08:13.188589 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555e43bef9c0 pid: 117714 (default app) May 10 21:08:56.823701 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-b8403242-2ea5-4acf-ab00-8a8defe5eabd tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] Action: 'create', calling method: .version_select at 0x7f85d7438280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-176891030"}} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:08:59.279930 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-b8403242-2ea5-4acf-ab00-8a8defe5eabd tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.211420 May 10 21:08:59.280689 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 1/1] 10.222.0.49 () {60 vars in 1154 bytes} [Tue May 10 21:08:55 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4214 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 10 21:08:59.528148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-829adffa-608d-4f21-80b5-6fb5b57d3515 tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] Calling method '.version_select at 0x7f85d74c7f70>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:00.218393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-829adffa-608d-4f21-80b5-6fb5b57d3515 tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/7c8f5443-7a90-4b60-ad7e-404baa3dc1df" status: 200 len: 345 microversion: 2.1 time: 0.928058 May 10 21:09:00.218941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1/2] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 21:08:59 2022] GET /compute/v2.1/os-volumes/7c8f5443-7a90-4b60-ad7e-404baa3dc1df => generated 345 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:09:00.236711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-23d74c45-e13b-47ca-9027-db7d1e8048e7 tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] Action: 'create', calling method: .version_select at 0x7f85d72fc1f0>, body: {"snapshot": {"volume_id": "7c8f5443-7a90-4b60-ad7e-404baa3dc1df", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-729803110"}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:00.328668 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-1f93ff76-a7ab-4698-8d0d-53e635b45968 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1936822143", "imageRef": "cb321ccf-1ce7-4dda-90d0-f05332eb6fe1", "flavorRef": "452", "networks": [{"uuid": "43901883-ca83-42dc-bdea-efd6f0ab12bf"}]}} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:00.603882 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.network.neutron [None req-1f93ff76-a7ab-4698-8d0d-53e635b45968 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] validate_networks() for [('43901883-ca83-42dc-bdea-efd6f0ab12bf', None, None, None, None, None)] {{(pid=117713) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:09:01.252044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-23d74c45-e13b-47ca-9027-db7d1e8048e7 tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.019301 May 10 21:09:01.252044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2/3] 10.222.0.49 () {60 vars in 1161 bytes} [Tue May 10 21:09:00 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:09:01.258515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6cef345b-d6e8-4c41-95bb-7ff4347f839f tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] Calling method '.version_select at 0x7f85d72fc280>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:01.370694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6cef345b-d6e8-4c41-95bb-7ff4347f839f tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/38ab2ef7-598f-41c8-b1f3-8f46ea5dba65" status: 200 len: 286 microversion: 2.1 time: 0.116543 May 10 21:09:01.371719 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 3/4] 10.222.0.49 () {58 vars in 1250 bytes} [Tue May 10 21:09:01 2022] GET /compute/v2.1/os-snapshots/38ab2ef7-598f-41c8-b1f3-8f46ea5dba65 => generated 286 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:09:01.383895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6d3ac51c-1621-4b58-83b2-332397c10f8e tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] Calling method '.version_select at 0x7f85d72fc160>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:01.482236 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6d3ac51c-1621-4b58-83b2-332397c10f8e tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.103015 May 10 21:09:01.488717 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 4/5] 10.222.0.49 () {58 vars in 1139 bytes} [Tue May 10 21:09:01 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:09:01.497675 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-804925a5-f6eb-44e4-b9c2-5a40f1d07289 tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] Calling method '.version_select at 0x7f85d7289670>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:01.540964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-804925a5-f6eb-44e4-b9c2-5a40f1d07289 tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/38ab2ef7-598f-41c8-b1f3-8f46ea5dba65" status: 200 len: 286 microversion: 2.1 time: 0.050742 May 10 21:09:01.541532 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 5/6] 10.222.0.49 () {58 vars in 1250 bytes} [Tue May 10 21:09:01 2022] GET /compute/v2.1/os-snapshots/38ab2ef7-598f-41c8-b1f3-8f46ea5dba65 => generated 286 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:09:02.486590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-30c8f22f-d36c-4d1d-aa97-a4dd9aed0d39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2027652782", "imageRef": "cb321ccf-1ce7-4dda-90d0-f05332eb6fe1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:02.513036 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.virt.hardware [None req-1f93ff76-a7ab-4698-8d0d-53e635b45968 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Flavor limits 0:0:0 {{(pid=117713) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:09:02.520283 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.virt.hardware [None req-1f93ff76-a7ab-4698-8d0d-53e635b45968 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Image limits 0:0:0 {{(pid=117713) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:09:02.520283 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.virt.hardware [None req-1f93ff76-a7ab-4698-8d0d-53e635b45968 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Flavor pref 0:0:0 {{(pid=117713) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:09:02.520283 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.virt.hardware [None req-1f93ff76-a7ab-4698-8d0d-53e635b45968 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Image pref 0:0:0 {{(pid=117713) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:09:02.520283 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.virt.hardware [None req-1f93ff76-a7ab-4698-8d0d-53e635b45968 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117713) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:09:02.545411 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1f93ff76-a7ab-4698-8d0d-53e635b45968 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:02.546123 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1f93ff76-a7ab-4698-8d0d-53e635b45968 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:02.548545 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1f93ff76-a7ab-4698-8d0d-53e635b45968 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:02.549224 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1f93ff76-a7ab-4698-8d0d-53e635b45968 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:02.635352 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.quota [None req-1f93ff76-a7ab-4698-8d0d-53e635b45968 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Getting quotas for project 9ec69436f8724e48af59f1b87f22b9ac. Resources: {'instances', 'cores', 'ram'} {{(pid=117713) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:09:02.638288 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.quota [None req-1f93ff76-a7ab-4698-8d0d-53e635b45968 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Getting quotas for user 00678cc05f4a40aa86503052b0d067f4 and project 9ec69436f8724e48af59f1b87f22b9ac. Resources: {'instances', 'cores', 'ram'} {{(pid=117713) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:09:02.656168 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-1f93ff76-a7ab-4698-8d0d-53e635b45968 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Going to run 1 instances... {{(pid=117713) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:09:02.658983 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-1f93ff76-a7ab-4698-8d0d-53e635b45968 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb321ccf-1ce7-4dda-90d0-f05332eb6fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117713) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:09:02.676555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.network.neutron [None req-30c8f22f-d36c-4d1d-aa97-a4dd9aed0d39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] validate_networks() for [('dced4eda-1dfb-4abc-8242-f161f1463db0', None, None, None, None, None)] {{(pid=117714) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:09:02.824567 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-1f93ff76-a7ab-4698-8d0d-53e635b45968 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.620582 May 10 21:09:02.825637 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 2/7] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 21:09:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 21:09:02.843737 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-4246b8cf-62f8-4d7f-ada2-5682742ed4c1 tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] Calling method '.version_select at 0x7f85d69a5430>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:02.932613 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-4246b8cf-62f8-4d7f-ada2-5682742ed4c1 tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/38ab2ef7-598f-41c8-b1f3-8f46ea5dba65" status: 200 len: 286 microversion: 2.1 time: 0.101909 May 10 21:09:02.934253 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 3/8] 10.222.0.49 () {58 vars in 1250 bytes} [Tue May 10 21:09:02 2022] GET /compute/v2.1/os-snapshots/38ab2ef7-598f-41c8-b1f3-8f46ea5dba65 => generated 286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:09:02.940033 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-76cf18df-1d64-43d7-a82d-2f9d666385ca tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:02.940971 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-76cf18df-1d64-43d7-a82d-2f9d666385ca tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:03.035929 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-76cf18df-1d64-43d7-a82d-2f9d666385ca tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:03.051583 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-76cf18df-1d64-43d7-a82d-2f9d666385ca tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1215 microversion: 2.1 time: 0.116137 May 10 21:09:03.063029 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 4/9] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:02 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1215 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:03.952265 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9a548210-a34c-45ae-be40-2db2d4f3c585 tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] Calling method '.version_select at 0x7f85d69c1a60>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:04.065610 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9a548210-a34c-45ae-be40-2db2d4f3c585 tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/38ab2ef7-598f-41c8-b1f3-8f46ea5dba65" status: 200 len: 286 microversion: 2.1 time: 0.126812 May 10 21:09:04.066331 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 5/10] 10.222.0.49 () {58 vars in 1250 bytes} [Tue May 10 21:09:03 2022] GET /compute/v2.1/os-snapshots/38ab2ef7-598f-41c8-b1f3-8f46ea5dba65 => generated 286 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:09:04.074221 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-125457ff-47f1-42a5-975d-835385a54cd9 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:04.075187 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-125457ff-47f1-42a5-975d-835385a54cd9 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:04.247608 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-125457ff-47f1-42a5-975d-835385a54cd9 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:04.261466 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-125457ff-47f1-42a5-975d-835385a54cd9 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1215 microversion: 2.1 time: 0.190991 May 10 21:09:04.264217 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 6/11] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:04 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1215 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:05.078128 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d2d90939-c70e-4b3a-a8c2-e0cf50ac00a6 tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] Calling method '.version_select at 0x7f85d6150430>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:05.158727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d2d90939-c70e-4b3a-a8c2-e0cf50ac00a6 tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/38ab2ef7-598f-41c8-b1f3-8f46ea5dba65" status: 200 len: 287 microversion: 2.1 time: 0.084719 May 10 21:09:05.159545 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 7/12] 10.222.0.49 () {58 vars in 1250 bytes} [Tue May 10 21:09:05 2022] GET /compute/v2.1/os-snapshots/38ab2ef7-598f-41c8-b1f3-8f46ea5dba65 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:09:05.169638 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9d6d7dd8-c095-4a5e-b606-224d7d9a2512 tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] Calling method '.version_select at 0x7f85d61504c0>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:05.407289 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9d6d7dd8-c095-4a5e-b606-224d7d9a2512 tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/38ab2ef7-598f-41c8-b1f3-8f46ea5dba65" status: 202 len: 0 microversion: 2.1 time: 0.241284 May 10 21:09:05.408227 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 8/13] 10.222.0.49 () {58 vars in 1253 bytes} [Tue May 10 21:09:05 2022] DELETE /compute/v2.1/os-snapshots/38ab2ef7-598f-41c8-b1f3-8f46ea5dba65 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 21:09:05.414498 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-17f8b98c-6f11-4bfa-baf1-4669afd641d6 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:05.415146 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-17f8b98c-6f11-4bfa-baf1-4669afd641d6 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:05.553992 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-17f8b98c-6f11-4bfa-baf1-4669afd641d6 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:05.580747 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-17f8b98c-6f11-4bfa-baf1-4669afd641d6 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1215 microversion: 2.1 time: 0.160970 May 10 21:09:05.580747 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 9/14] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:05 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1215 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:05.594677 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-1ce7feb7-f4bd-4375-a9c8-caf2b753e4e0 tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] Calling method '.version_select at 0x7f85d61503a0>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:05.700399 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-1ce7feb7-f4bd-4375-a9c8-caf2b753e4e0 tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/38ab2ef7-598f-41c8-b1f3-8f46ea5dba65" status: 200 len: 286 microversion: 2.1 time: 0.122791 May 10 21:09:05.702042 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 10/15] 10.222.0.49 () {58 vars in 1250 bytes} [Tue May 10 21:09:05 2022] GET /compute/v2.1/os-snapshots/38ab2ef7-598f-41c8-b1f3-8f46ea5dba65 => generated 286 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:09:06.162160 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-30c8f22f-d36c-4d1d-aa97-a4dd9aed0d39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Flavor limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:09:06.163494 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-30c8f22f-d36c-4d1d-aa97-a4dd9aed0d39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Image limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:09:06.164401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-30c8f22f-d36c-4d1d-aa97-a4dd9aed0d39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Flavor pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:09:06.165029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-30c8f22f-d36c-4d1d-aa97-a4dd9aed0d39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Image pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:09:06.165637 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-30c8f22f-d36c-4d1d-aa97-a4dd9aed0d39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:09:06.215645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-30c8f22f-d36c-4d1d-aa97-a4dd9aed0d39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:06.220666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-30c8f22f-d36c-4d1d-aa97-a4dd9aed0d39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:06.221765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-30c8f22f-d36c-4d1d-aa97-a4dd9aed0d39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:06.223208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-30c8f22f-d36c-4d1d-aa97-a4dd9aed0d39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:06.330670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-30c8f22f-d36c-4d1d-aa97-a4dd9aed0d39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Getting quotas for project bba0283b32bc4c54ae7cfcb1f984db42. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:09:06.346616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-30c8f22f-d36c-4d1d-aa97-a4dd9aed0d39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Getting quotas for user fe93eb8c93fb4cb4bec6f7cc2c03e1eb and project bba0283b32bc4c54ae7cfcb1f984db42. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:09:06.381489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-30c8f22f-d36c-4d1d-aa97-a4dd9aed0d39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Going to run 1 instances... {{(pid=117714) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:09:06.386408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-30c8f22f-d36c-4d1d-aa97-a4dd9aed0d39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb321ccf-1ce7-4dda-90d0-f05332eb6fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117714) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:09:06.606947 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-8c927dcf-da07-4110-b98b-ae6db9c87d92 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:06.608694 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-8c927dcf-da07-4110-b98b-ae6db9c87d92 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:06.614417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-30c8f22f-d36c-4d1d-aa97-a4dd9aed0d39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.319251 May 10 21:09:06.615878 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 6/16] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 21:09:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 4321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 21:09:06.637771 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7a8d642b-678e-41e8-a2ef-bec54f5913f6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:06.641258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7a8d642b-678e-41e8-a2ef-bec54f5913f6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:06.642063 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8c927dcf-da07-4110-b98b-ae6db9c87d92 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:06.643024 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8c927dcf-da07-4110-b98b-ae6db9c87d92 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:06.644047 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8c927dcf-da07-4110-b98b-ae6db9c87d92 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:06.646059 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8c927dcf-da07-4110-b98b-ae6db9c87d92 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:07.325583 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-8c927dcf-da07-4110-b98b-ae6db9c87d92 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:07.329528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7a8d642b-678e-41e8-a2ef-bec54f5913f6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:07.358980 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-8c927dcf-da07-4110-b98b-ae6db9c87d92 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1211 microversion: 2.1 time: 0.767343 May 10 21:09:07.360647 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 11/17] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:06 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1211 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:09:07.377806 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-dd3fd54f-145d-4897-aa2e-d2464e01bf8d tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] Calling method '.version_select at 0x7f85d6141af0>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:07.395555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7a8d642b-678e-41e8-a2ef-bec54f5913f6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1222 microversion: 2.1 time: 0.770380 May 10 21:09:07.402823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 7/18] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:06 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1222 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:07.472411 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.wsgi [None req-dd3fd54f-145d-4897-aa2e-d2464e01bf8d tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] HTTP exception thrown: Snapshot 38ab2ef7-598f-41c8-b1f3-8f46ea5dba65 could not be found. May 10 21:09:07.479738 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-dd3fd54f-145d-4897-aa2e-d2464e01bf8d tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] Request method failure captured: May 10 21:09:07.479738 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: request: GET /compute/v2.1/os-snapshots/38ab2ef7-598f-41c8-b1f3-8f46ea5dba65 HTTP/1.1 May 10 21:09:07.479738 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Accept: application/json May 10 21:09:07.479738 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Accept-Encoding: identity May 10 21:09:07.479738 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Connection: close May 10 21:09:07.479738 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Content-Length: 0 May 10 21:09:07.479738 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Content-Type: application/json May 10 21:09:07.479738 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Host: 10.222.0.49 May 10 21:09:07.479738 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Openstack-System-Scope: None May 10 21:09:07.479738 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: User-Agent: python-urllib3/1.26.9 May 10 21:09:07.479738 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Auth-Token: gAAAAABietRm1bhe6ZNcc3xtK9QIZMdJ36sepWlEmf7Du7IDib2_nS_WgQ3zwOOZZOOe9eSRcn4q8hSy8YcupvrQgZ2a3HYCH57ET0lK7puDf8ixb-4-Zsb2C-0uNTUPt6K3wTDioERs_D_024JDIeN8qlC_5tYNigyZHipFMdzyjZkhdj3CBT4 May 10 21:09:07.479738 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Domain-Id: None May 10 21:09:07.479738 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Domain-Name: None May 10 21:09:07.479738 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Identity-Status: Confirmed May 10 21:09:07.479738 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Is-Admin-Project: True May 10 21:09:07.479738 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Domain-Id: default May 10 21:09:07.479738 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Domain-Name: Default May 10 21:09:07.479738 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Id: a3e55be674154a24a6171561d9f24175 May 10 21:09:07.479738 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1016931546 May 10 21:09:07.479738 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Role: reader,member May 10 21:09:07.479738 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Roles: reader,member May 10 21:09:07.485580 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a3e55be674154a24a6171561d9f24175"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a3e55be674154a24a6171561d9f24175"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a3e55be674154a24a6171561d9f24175"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a3e55be674154a24a6171561d9f24175", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:09:07.485580 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1016931546 May 10 21:09:07.485580 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Tenant-Id: a3e55be674154a24a6171561d9f24175 May 10 21:09:07.485580 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1016931546 May 10 21:09:07.485580 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User: tempest-VolumesSnapshotsTestJSON-1016931546-project May 10 21:09:07.485580 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Domain-Id: default May 10 21:09:07.485580 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Domain-Name: Default May 10 21:09:07.485580 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Id: e49fe4a3de4a40d9853e06f999e1ede8 May 10 21:09:07.485580 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1016931546-project May 10 21:09:07.485580 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: method: May 10 21:09:07.485580 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: exception: Snapshot 38ab2ef7-598f-41c8-b1f3-8f46ea5dba65 could not be found. May 10 21:09:07.485580 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: action_args: {'id': '38ab2ef7-598f-41c8-b1f3-8f46ea5dba65'} May 10 21:09:07.485580 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:09:07.486357 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:07.486357 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 21:09:07.486357 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 21:09:07.486357 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 21:09:07.486357 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 21:09:07.486357 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 21:09:07.486357 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 21:09:07.486357 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 21:09:07.486357 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 21:09:07.486357 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 21:09:07.486357 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 21:09:07.486357 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:09:07.486357 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:09:07.486357 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:09:07.486357 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:09:07.486357 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 38ab2ef7-598f-41c8-b1f3-8f46ea5dba65 could not be found. (HTTP 404) (Request-ID: req-d0cbc244-c95e-4928-9c80-b9db7952563b) May 10 21:09:07.486357 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:09:07.486357 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:09:07.487272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:09:07.487272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:07.487272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 10 21:09:07.487272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 10 21:09:07.487272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 21:09:07.487272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 21:09:07.487272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 10 21:09:07.487272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 10 21:09:07.487272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 21:09:07.487272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 21:09:07.487272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 21:09:07.487272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 21:09:07.487272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 21:09:07.487272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 21:09:07.487272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 21:09:07.487272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 21:09:07.487272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 21:09:07.487272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 21:09:07.487272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 21:09:07.488183 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 21:09:07.488183 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:09:07.488183 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:09:07.488183 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:09:07.488183 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:09:07.488183 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 38ab2ef7-598f-41c8-b1f3-8f46ea5dba65 could not be found. May 10 21:09:07.488183 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:09:07.488183 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:09:07.488183 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:09:07.488183 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:07.488183 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:09:07.488183 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:09:07.488183 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:09:07.488183 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:09:07.488183 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 21:09:07.488183 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 21:09:07.488183 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:09:07.488183 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:09:07.488183 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 10 21:09:07.488183 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:09:07.489143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 38ab2ef7-598f-41c8-b1f3-8f46ea5dba65 could not be found. May 10 21:09:07.489143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:09:07.489143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:09:07.489143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:09:07.489143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:07.489143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:09:07.489143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:09:07.489143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:09:07.489143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:09:07.489143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 38ab2ef7-598f-41c8-b1f3-8f46ea5dba65 could not be found. May 10 21:09:07.489143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:09:07.489143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-dd3fd54f-145d-4897-aa2e-d2464e01bf8d tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] Returning 404 to user: Snapshot 38ab2ef7-598f-41c8-b1f3-8f46ea5dba65 could not be found. {{(pid=117713) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:09:07.489143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-dd3fd54f-145d-4897-aa2e-d2464e01bf8d tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/38ab2ef7-598f-41c8-b1f3-8f46ea5dba65" status: 404 len: 111 microversion: 2.1 time: 0.119274 May 10 21:09:07.489787 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 12/19] 10.222.0.49 () {58 vars in 1250 bytes} [Tue May 10 21:09:07 2022] GET /compute/v2.1/os-snapshots/38ab2ef7-598f-41c8-b1f3-8f46ea5dba65 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:09:07.496893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6c1e8934-56e9-41d1-9f64-2e12427b0ecd tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] Calling method '.version_select at 0x7f85d69a8e50>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:07.830402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6c1e8934-56e9-41d1-9f64-2e12427b0ecd tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/7c8f5443-7a90-4b60-ad7e-404baa3dc1df" status: 202 len: 0 microversion: 2.1 time: 0.340322 May 10 21:09:07.834705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 8/20] 10.222.0.49 () {58 vars in 1247 bytes} [Tue May 10 21:09:07 2022] DELETE /compute/v2.1/os-volumes/7c8f5443-7a90-4b60-ad7e-404baa3dc1df => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:09:07.849277 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-379c0919-4041-44d6-b50c-10498ccc9739 tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] Calling method '.version_select at 0x7f85d60ddc10>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:07.853799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b049601b-f7f4-4c1b-b9a1-d1915a429dfe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-371293306", "imageRef": "cb321ccf-1ce7-4dda-90d0-f05332eb6fe1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:07.980309 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.network.neutron [None req-b049601b-f7f4-4c1b-b9a1-d1915a429dfe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] validate_networks() for [('dced4eda-1dfb-4abc-8242-f161f1463db0', None, None, None, None, None)] {{(pid=117714) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:09:07.995603 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-379c0919-4041-44d6-b50c-10498ccc9739 tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/7c8f5443-7a90-4b60-ad7e-404baa3dc1df" status: 200 len: 344 microversion: 2.1 time: 0.151204 May 10 21:09:07.995603 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 13/21] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 21:09:07 2022] GET /compute/v2.1/os-volumes/7c8f5443-7a90-4b60-ad7e-404baa3dc1df => generated 344 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:09:08.377838 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-778f348c-301f-4fb6-b859-6ad4f5b6b952 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:08.378458 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-778f348c-301f-4fb6-b859-6ad4f5b6b952 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:08.395066 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-778f348c-301f-4fb6-b859-6ad4f5b6b952 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:08.395480 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-778f348c-301f-4fb6-b859-6ad4f5b6b952 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:08.396281 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-778f348c-301f-4fb6-b859-6ad4f5b6b952 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:08.402899 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-778f348c-301f-4fb6-b859-6ad4f5b6b952 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:08.668128 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-778f348c-301f-4fb6-b859-6ad4f5b6b952 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:08.693789 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-778f348c-301f-4fb6-b859-6ad4f5b6b952 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1285 microversion: 2.1 time: 0.315315 May 10 21:09:08.703613 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 14/22] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:08 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1285 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:09.003247 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e6db6bd3-bcee-4ff5-9fef-96d6eaa2493d tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] Calling method '.version_select at 0x7f85d60729d0>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:09.072616 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.wsgi [None req-e6db6bd3-bcee-4ff5-9fef-96d6eaa2493d tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] HTTP exception thrown: Volume 7c8f5443-7a90-4b60-ad7e-404baa3dc1df could not be found. May 10 21:09:09.080391 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e6db6bd3-bcee-4ff5-9fef-96d6eaa2493d tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] Request method failure captured: May 10 21:09:09.080391 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: request: GET /compute/v2.1/os-volumes/7c8f5443-7a90-4b60-ad7e-404baa3dc1df HTTP/1.1 May 10 21:09:09.080391 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Accept: application/json May 10 21:09:09.080391 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Accept-Encoding: identity May 10 21:09:09.080391 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Connection: close May 10 21:09:09.080391 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Content-Length: 0 May 10 21:09:09.080391 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Content-Type: application/json May 10 21:09:09.080391 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Host: 10.222.0.49 May 10 21:09:09.080391 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Openstack-System-Scope: None May 10 21:09:09.080391 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: User-Agent: python-urllib3/1.26.9 May 10 21:09:09.080391 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Auth-Token: gAAAAABietRm1bhe6ZNcc3xtK9QIZMdJ36sepWlEmf7Du7IDib2_nS_WgQ3zwOOZZOOe9eSRcn4q8hSy8YcupvrQgZ2a3HYCH57ET0lK7puDf8ixb-4-Zsb2C-0uNTUPt6K3wTDioERs_D_024JDIeN8qlC_5tYNigyZHipFMdzyjZkhdj3CBT4 May 10 21:09:09.080391 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Domain-Id: None May 10 21:09:09.080391 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Domain-Name: None May 10 21:09:09.080391 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Identity-Status: Confirmed May 10 21:09:09.080391 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Is-Admin-Project: True May 10 21:09:09.080391 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Domain-Id: default May 10 21:09:09.080391 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Domain-Name: Default May 10 21:09:09.080391 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Id: a3e55be674154a24a6171561d9f24175 May 10 21:09:09.080391 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1016931546 May 10 21:09:09.080391 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Role: reader,member May 10 21:09:09.080391 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Roles: reader,member May 10 21:09:09.081516 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a3e55be674154a24a6171561d9f24175"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a3e55be674154a24a6171561d9f24175"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a3e55be674154a24a6171561d9f24175"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a3e55be674154a24a6171561d9f24175", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:09:09.081516 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1016931546 May 10 21:09:09.081516 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Tenant-Id: a3e55be674154a24a6171561d9f24175 May 10 21:09:09.081516 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1016931546 May 10 21:09:09.081516 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User: tempest-VolumesSnapshotsTestJSON-1016931546-project May 10 21:09:09.081516 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Domain-Id: default May 10 21:09:09.081516 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Domain-Name: Default May 10 21:09:09.081516 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Id: e49fe4a3de4a40d9853e06f999e1ede8 May 10 21:09:09.081516 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1016931546-project May 10 21:09:09.081516 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: method: May 10 21:09:09.081516 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: exception: Volume 7c8f5443-7a90-4b60-ad7e-404baa3dc1df could not be found. May 10 21:09:09.081516 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: action_args: {'id': '7c8f5443-7a90-4b60-ad7e-404baa3dc1df'} May 10 21:09:09.081516 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:09:09.082341 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:09.082341 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:09:09.082341 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:09:09.082341 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 21:09:09.082341 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 21:09:09.082341 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 21:09:09.082341 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 21:09:09.082341 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 21:09:09.082341 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 21:09:09.082341 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 21:09:09.082341 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 21:09:09.082341 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:09:09.082341 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:09:09.082341 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:09:09.082341 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:09:09.082341 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7c8f5443-7a90-4b60-ad7e-404baa3dc1df could not be found. (HTTP 404) (Request-ID: req-7cafd026-3c80-4621-a3da-a4ff68332bb7) May 10 21:09:09.082341 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:09:09.082341 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:09:09.082341 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:09:09.083395 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:09.083395 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 21:09:09.083395 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 21:09:09.083395 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 21:09:09.083395 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 21:09:09.083395 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 21:09:09.083395 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 21:09:09.083395 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 21:09:09.083395 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 21:09:09.083395 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:09:09.083395 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:09:09.083395 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 21:09:09.083395 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 21:09:09.083395 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 21:09:09.083395 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 21:09:09.083395 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 21:09:09.083395 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 21:09:09.083395 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 21:09:09.083395 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 21:09:09.084299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:09:09.084299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:09:09.084299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:09:09.084299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:09:09.084299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7c8f5443-7a90-4b60-ad7e-404baa3dc1df could not be found. May 10 21:09:09.084299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:09:09.084299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:09:09.084299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:09:09.084299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:09.084299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:09:09.084299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:09:09.084299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:09:09.084299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:09:09.084299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 21:09:09.084299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 21:09:09.084299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:09:09.084299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:09:09.084299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 21:09:09.084299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:09:09.085195 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7c8f5443-7a90-4b60-ad7e-404baa3dc1df could not be found. May 10 21:09:09.085195 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:09:09.085195 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:09:09.085195 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:09:09.085195 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:09.085195 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:09:09.085195 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:09:09.085195 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:09:09.085195 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:09:09.085195 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7c8f5443-7a90-4b60-ad7e-404baa3dc1df could not be found. May 10 21:09:09.085195 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:09:09.098962 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e6db6bd3-bcee-4ff5-9fef-96d6eaa2493d tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] Returning 404 to user: Volume 7c8f5443-7a90-4b60-ad7e-404baa3dc1df could not be found. {{(pid=117713) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:09:09.107257 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e6db6bd3-bcee-4ff5-9fef-96d6eaa2493d tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/7c8f5443-7a90-4b60-ad7e-404baa3dc1df" status: 404 len: 109 microversion: 2.1 time: 0.102885 May 10 21:09:09.108641 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 15/23] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 21:09:08 2022] GET /compute/v2.1/os-volumes/7c8f5443-7a90-4b60-ad7e-404baa3dc1df => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 21:09:09.125339 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9258d91c-6df4-4e01-b616-8e49870bec58 tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] Calling method '.version_select at 0x7f85d6072790>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:09.299011 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.wsgi [None req-9258d91c-6df4-4e01-b616-8e49870bec58 tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] HTTP exception thrown: Volume 7c8f5443-7a90-4b60-ad7e-404baa3dc1df could not be found. May 10 21:09:09.301425 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9258d91c-6df4-4e01-b616-8e49870bec58 tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] Request method failure captured: May 10 21:09:09.301425 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: request: DELETE /compute/v2.1/os-volumes/7c8f5443-7a90-4b60-ad7e-404baa3dc1df HTTP/1.1 May 10 21:09:09.301425 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Accept: application/json May 10 21:09:09.301425 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Accept-Encoding: identity May 10 21:09:09.301425 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Connection: close May 10 21:09:09.301425 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Content-Length: 0 May 10 21:09:09.301425 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Content-Type: application/json May 10 21:09:09.301425 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Host: 10.222.0.49 May 10 21:09:09.301425 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Openstack-System-Scope: None May 10 21:09:09.301425 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: User-Agent: python-urllib3/1.26.9 May 10 21:09:09.301425 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Auth-Token: gAAAAABietRm1bhe6ZNcc3xtK9QIZMdJ36sepWlEmf7Du7IDib2_nS_WgQ3zwOOZZOOe9eSRcn4q8hSy8YcupvrQgZ2a3HYCH57ET0lK7puDf8ixb-4-Zsb2C-0uNTUPt6K3wTDioERs_D_024JDIeN8qlC_5tYNigyZHipFMdzyjZkhdj3CBT4 May 10 21:09:09.301425 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Domain-Id: None May 10 21:09:09.301425 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Domain-Name: None May 10 21:09:09.301425 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Identity-Status: Confirmed May 10 21:09:09.301425 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Is-Admin-Project: True May 10 21:09:09.301425 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Domain-Id: default May 10 21:09:09.301425 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Domain-Name: Default May 10 21:09:09.301425 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Id: a3e55be674154a24a6171561d9f24175 May 10 21:09:09.301425 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1016931546 May 10 21:09:09.301425 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Role: reader,member May 10 21:09:09.301425 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Roles: reader,member May 10 21:09:09.302484 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a3e55be674154a24a6171561d9f24175"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a3e55be674154a24a6171561d9f24175"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a3e55be674154a24a6171561d9f24175"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a3e55be674154a24a6171561d9f24175", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:09:09.302484 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1016931546 May 10 21:09:09.302484 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Tenant-Id: a3e55be674154a24a6171561d9f24175 May 10 21:09:09.302484 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1016931546 May 10 21:09:09.302484 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User: tempest-VolumesSnapshotsTestJSON-1016931546-project May 10 21:09:09.302484 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Domain-Id: default May 10 21:09:09.302484 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Domain-Name: Default May 10 21:09:09.302484 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Id: e49fe4a3de4a40d9853e06f999e1ede8 May 10 21:09:09.302484 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1016931546-project May 10 21:09:09.302484 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: method: May 10 21:09:09.302484 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: exception: Volume 7c8f5443-7a90-4b60-ad7e-404baa3dc1df could not be found. May 10 21:09:09.302484 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: action_args: {'id': '7c8f5443-7a90-4b60-ad7e-404baa3dc1df'} May 10 21:09:09.302484 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:09:09.303372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:09.303372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:09:09.303372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:09:09.303372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 21:09:09.303372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 21:09:09.303372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 21:09:09.303372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 21:09:09.303372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 21:09:09.303372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 21:09:09.303372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 21:09:09.303372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 21:09:09.303372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:09:09.303372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:09:09.303372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:09:09.303372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:09:09.303372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7c8f5443-7a90-4b60-ad7e-404baa3dc1df could not be found. (HTTP 404) (Request-ID: req-0282ac7c-a38d-4917-b5b4-29e76716e7d6) May 10 21:09:09.303372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:09:09.303372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:09:09.303372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:09:09.304499 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:09.304499 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 21:09:09.304499 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 21:09:09.304499 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 21:09:09.304499 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 21:09:09.304499 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 21:09:09.304499 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 21:09:09.304499 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 21:09:09.304499 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 21:09:09.304499 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:09:09.304499 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:09:09.304499 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 21:09:09.304499 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 21:09:09.304499 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 21:09:09.304499 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 21:09:09.304499 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 21:09:09.304499 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 21:09:09.304499 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 21:09:09.304499 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 21:09:09.305419 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:09:09.305419 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:09:09.305419 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:09:09.305419 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:09:09.305419 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7c8f5443-7a90-4b60-ad7e-404baa3dc1df could not be found. May 10 21:09:09.305419 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:09:09.305419 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:09:09.305419 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:09:09.305419 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:09.305419 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:09:09.305419 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:09:09.305419 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:09:09.305419 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:09:09.305419 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 21:09:09.305419 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 21:09:09.305419 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:09:09.305419 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:09:09.305419 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 21:09:09.305419 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:09:09.306313 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7c8f5443-7a90-4b60-ad7e-404baa3dc1df could not be found. May 10 21:09:09.306313 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:09:09.306313 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:09:09.306313 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:09:09.306313 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:09.306313 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:09:09.306313 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:09:09.306313 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:09:09.306313 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:09:09.306313 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7c8f5443-7a90-4b60-ad7e-404baa3dc1df could not be found. May 10 21:09:09.306313 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:09:09.308690 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9258d91c-6df4-4e01-b616-8e49870bec58 tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] Returning 404 to user: Volume 7c8f5443-7a90-4b60-ad7e-404baa3dc1df could not be found. {{(pid=117713) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:09:09.309728 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9258d91c-6df4-4e01-b616-8e49870bec58 tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/7c8f5443-7a90-4b60-ad7e-404baa3dc1df" status: 404 len: 109 microversion: 2.1 time: 0.196100 May 10 21:09:09.311066 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 16/24] 10.222.0.49 () {58 vars in 1247 bytes} [Tue May 10 21:09:09 2022] DELETE /compute/v2.1/os-volumes/7c8f5443-7a90-4b60-ad7e-404baa3dc1df => generated 109 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:09:09.319030 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-cc01b471-ebc9-4045-8953-64aafc729427 tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] Calling method '.version_select at 0x7f85d6072430>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:09.443049 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.wsgi [None req-cc01b471-ebc9-4045-8953-64aafc729427 tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] HTTP exception thrown: Volume 7c8f5443-7a90-4b60-ad7e-404baa3dc1df could not be found. May 10 21:09:09.445432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-cc01b471-ebc9-4045-8953-64aafc729427 tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] Request method failure captured: May 10 21:09:09.445432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: request: GET /compute/v2.1/os-volumes/7c8f5443-7a90-4b60-ad7e-404baa3dc1df HTTP/1.1 May 10 21:09:09.445432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Accept: application/json May 10 21:09:09.445432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Accept-Encoding: identity May 10 21:09:09.445432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Connection: close May 10 21:09:09.445432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Content-Length: 0 May 10 21:09:09.445432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Content-Type: application/json May 10 21:09:09.445432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Host: 10.222.0.49 May 10 21:09:09.445432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Openstack-System-Scope: None May 10 21:09:09.445432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: User-Agent: python-urllib3/1.26.9 May 10 21:09:09.445432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Auth-Token: gAAAAABietRm1bhe6ZNcc3xtK9QIZMdJ36sepWlEmf7Du7IDib2_nS_WgQ3zwOOZZOOe9eSRcn4q8hSy8YcupvrQgZ2a3HYCH57ET0lK7puDf8ixb-4-Zsb2C-0uNTUPt6K3wTDioERs_D_024JDIeN8qlC_5tYNigyZHipFMdzyjZkhdj3CBT4 May 10 21:09:09.445432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Domain-Id: None May 10 21:09:09.445432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Domain-Name: None May 10 21:09:09.445432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Identity-Status: Confirmed May 10 21:09:09.445432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Is-Admin-Project: True May 10 21:09:09.445432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Domain-Id: default May 10 21:09:09.445432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Domain-Name: Default May 10 21:09:09.445432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Id: a3e55be674154a24a6171561d9f24175 May 10 21:09:09.445432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1016931546 May 10 21:09:09.445432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Role: reader,member May 10 21:09:09.445432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Roles: reader,member May 10 21:09:09.446582 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a3e55be674154a24a6171561d9f24175"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a3e55be674154a24a6171561d9f24175"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a3e55be674154a24a6171561d9f24175"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a3e55be674154a24a6171561d9f24175", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:09:09.446582 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1016931546 May 10 21:09:09.446582 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Tenant-Id: a3e55be674154a24a6171561d9f24175 May 10 21:09:09.446582 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1016931546 May 10 21:09:09.446582 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User: tempest-VolumesSnapshotsTestJSON-1016931546-project May 10 21:09:09.446582 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Domain-Id: default May 10 21:09:09.446582 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Domain-Name: Default May 10 21:09:09.446582 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Id: e49fe4a3de4a40d9853e06f999e1ede8 May 10 21:09:09.446582 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1016931546-project May 10 21:09:09.446582 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: method: May 10 21:09:09.446582 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: exception: Volume 7c8f5443-7a90-4b60-ad7e-404baa3dc1df could not be found. May 10 21:09:09.446582 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: action_args: {'id': '7c8f5443-7a90-4b60-ad7e-404baa3dc1df'} May 10 21:09:09.446582 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:09:09.447447 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:09.447447 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:09:09.447447 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:09:09.447447 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 21:09:09.447447 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 21:09:09.447447 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 21:09:09.447447 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 21:09:09.447447 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 21:09:09.447447 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 21:09:09.447447 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 21:09:09.447447 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 21:09:09.447447 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:09:09.447447 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:09:09.447447 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:09:09.447447 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:09:09.447447 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7c8f5443-7a90-4b60-ad7e-404baa3dc1df could not be found. (HTTP 404) (Request-ID: req-f630f84c-704e-4969-bc5f-5455f565711c) May 10 21:09:09.447447 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:09:09.447447 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:09:09.447447 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:09:09.448361 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:09.448361 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 21:09:09.448361 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 21:09:09.448361 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 21:09:09.448361 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 21:09:09.448361 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 21:09:09.448361 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 21:09:09.448361 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 21:09:09.448361 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 21:09:09.448361 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:09:09.448361 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:09:09.448361 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 21:09:09.448361 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 21:09:09.448361 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 21:09:09.448361 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 21:09:09.448361 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 21:09:09.448361 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 21:09:09.448361 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 21:09:09.448361 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 21:09:09.449482 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:09:09.449482 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:09:09.449482 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:09:09.449482 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:09:09.449482 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7c8f5443-7a90-4b60-ad7e-404baa3dc1df could not be found. May 10 21:09:09.449482 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:09:09.449482 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:09:09.449482 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:09:09.449482 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:09.449482 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:09:09.449482 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:09:09.449482 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:09:09.449482 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:09:09.449482 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 21:09:09.449482 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 21:09:09.449482 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:09:09.449482 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:09:09.449482 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 21:09:09.449482 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:09:09.450507 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7c8f5443-7a90-4b60-ad7e-404baa3dc1df could not be found. May 10 21:09:09.450507 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:09:09.450507 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:09:09.450507 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:09:09.450507 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:09.450507 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:09:09.450507 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:09:09.450507 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:09:09.450507 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:09:09.450507 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7c8f5443-7a90-4b60-ad7e-404baa3dc1df could not be found. May 10 21:09:09.450507 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:09:09.453616 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-cc01b471-ebc9-4045-8953-64aafc729427 tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] Returning 404 to user: Volume 7c8f5443-7a90-4b60-ad7e-404baa3dc1df could not be found. {{(pid=117713) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:09:09.454444 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-cc01b471-ebc9-4045-8953-64aafc729427 tempest-VolumesSnapshotsTestJSON-1016931546 tempest-VolumesSnapshotsTestJSON-1016931546-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/7c8f5443-7a90-4b60-ad7e-404baa3dc1df" status: 404 len: 109 microversion: 2.1 time: 0.139245 May 10 21:09:09.455004 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 17/25] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 21:09:09 2022] GET /compute/v2.1/os-volumes/7c8f5443-7a90-4b60-ad7e-404baa3dc1df => generated 109 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:09:09.712275 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-90d66a73-5716-4c93-8018-56b8836bef2f tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:09.712964 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-90d66a73-5716-4c93-8018-56b8836bef2f tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:09.723928 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-90d66a73-5716-4c93-8018-56b8836bef2f tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:09.728047 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-90d66a73-5716-4c93-8018-56b8836bef2f tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:09.733241 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-90d66a73-5716-4c93-8018-56b8836bef2f tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:09.733984 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-90d66a73-5716-4c93-8018-56b8836bef2f tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:09.859700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-b049601b-f7f4-4c1b-b9a1-d1915a429dfe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Flavor limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:09:09.860266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-b049601b-f7f4-4c1b-b9a1-d1915a429dfe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Image limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:09:09.860692 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-b049601b-f7f4-4c1b-b9a1-d1915a429dfe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Flavor pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:09:09.861120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-b049601b-f7f4-4c1b-b9a1-d1915a429dfe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Image pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:09:09.861540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-b049601b-f7f4-4c1b-b9a1-d1915a429dfe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:09:09.875406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b049601b-f7f4-4c1b-b9a1-d1915a429dfe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:09.878117 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b049601b-f7f4-4c1b-b9a1-d1915a429dfe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:09.880278 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b049601b-f7f4-4c1b-b9a1-d1915a429dfe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:09.880739 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b049601b-f7f4-4c1b-b9a1-d1915a429dfe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:09.918671 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-90d66a73-5716-4c93-8018-56b8836bef2f tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:09.929328 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-90d66a73-5716-4c93-8018-56b8836bef2f tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1273 microversion: 2.1 time: 0.221018 May 10 21:09:09.932633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-b049601b-f7f4-4c1b-b9a1-d1915a429dfe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Getting quotas for project bba0283b32bc4c54ae7cfcb1f984db42. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:09:09.943701 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 18/26] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:09 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1273 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:09.944583 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-b049601b-f7f4-4c1b-b9a1-d1915a429dfe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Getting quotas for user fe93eb8c93fb4cb4bec6f7cc2c03e1eb and project bba0283b32bc4c54ae7cfcb1f984db42. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:09:09.979530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b049601b-f7f4-4c1b-b9a1-d1915a429dfe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Going to run 1 instances... {{(pid=117714) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:09:09.986918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b049601b-f7f4-4c1b-b9a1-d1915a429dfe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb321ccf-1ce7-4dda-90d0-f05332eb6fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117714) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:09:10.234855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b049601b-f7f4-4c1b-b9a1-d1915a429dfe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.390125 May 10 21:09:10.243381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 9/27] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 21:09:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 2400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 21:09:10.247063 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d77e0ece-9b64-4277-a242-4259ac002a82 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:10.247828 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d77e0ece-9b64-4277-a242-4259ac002a82 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:10.508970 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-d77e0ece-9b64-4277-a242-4259ac002a82 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:10.517188 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d77e0ece-9b64-4277-a242-4259ac002a82 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1221 microversion: 2.1 time: 0.274576 May 10 21:09:10.528292 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 19/28] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:10 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1221 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:09:10.955649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ab7a7362-5014-495a-b26a-410bd5ccacdf tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:10.978411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ab7a7362-5014-495a-b26a-410bd5ccacdf tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:11.037557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab7a7362-5014-495a-b26a-410bd5ccacdf tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:11.041471 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab7a7362-5014-495a-b26a-410bd5ccacdf tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:11.048200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab7a7362-5014-495a-b26a-410bd5ccacdf tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:11.050256 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab7a7362-5014-495a-b26a-410bd5ccacdf tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:11.535579 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d9970285-55ce-4cdb-a8f0-2b3b6e15edba tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:11.537189 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d9970285-55ce-4cdb-a8f0-2b3b6e15edba tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:11.759786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ab7a7362-5014-495a-b26a-410bd5ccacdf tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:11.784455 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ab7a7362-5014-495a-b26a-410bd5ccacdf tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1273 microversion: 2.1 time: 0.835336 May 10 21:09:11.801271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 10/29] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:10 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1273 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:12.085369 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-d9970285-55ce-4cdb-a8f0-2b3b6e15edba tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:12.094410 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d9970285-55ce-4cdb-a8f0-2b3b6e15edba tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1221 microversion: 2.1 time: 0.562526 May 10 21:09:12.095293 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 20/30] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:11 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1221 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:12.801411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-555d7313-add1-485f-b0d8-f8858a293c3a tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:12.803321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-555d7313-add1-485f-b0d8-f8858a293c3a tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:12.823970 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-555d7313-add1-485f-b0d8-f8858a293c3a tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:12.839287 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-555d7313-add1-485f-b0d8-f8858a293c3a tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:12.841608 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-555d7313-add1-485f-b0d8-f8858a293c3a tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:12.844442 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-555d7313-add1-485f-b0d8-f8858a293c3a tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:13.113666 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-7f94a7a5-415d-496a-9159-37d8553cc7d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:13.114153 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-7f94a7a5-415d-496a-9159-37d8553cc7d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:13.121000 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7f94a7a5-415d-496a-9159-37d8553cc7d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:13.124313 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7f94a7a5-415d-496a-9159-37d8553cc7d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:13.126385 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7f94a7a5-415d-496a-9159-37d8553cc7d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:13.127700 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7f94a7a5-415d-496a-9159-37d8553cc7d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:13.244731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-555d7313-add1-485f-b0d8-f8858a293c3a tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:13.265561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-555d7313-add1-485f-b0d8-f8858a293c3a tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1273 microversion: 2.1 time: 0.464654 May 10 21:09:13.269022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 11/31] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:12 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1273 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:13.407348 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-7f94a7a5-415d-496a-9159-37d8553cc7d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:13.420197 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-7f94a7a5-415d-496a-9159-37d8553cc7d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1273 microversion: 2.1 time: 0.310211 May 10 21:09:13.430703 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 21/32] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:13 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1273 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:09:14.295727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-29a0cb2d-bccc-444b-a0eb-1f30ba588447 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:14.295727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-29a0cb2d-bccc-444b-a0eb-1f30ba588447 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:14.301939 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-29a0cb2d-bccc-444b-a0eb-1f30ba588447 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:14.302476 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-29a0cb2d-bccc-444b-a0eb-1f30ba588447 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:14.311297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-29a0cb2d-bccc-444b-a0eb-1f30ba588447 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:14.311751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-29a0cb2d-bccc-444b-a0eb-1f30ba588447 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:14.437886 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e731bd6c-be42-448b-bcc3-587657dbca11 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:14.438512 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e731bd6c-be42-448b-bcc3-587657dbca11 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:14.446693 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e731bd6c-be42-448b-bcc3-587657dbca11 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:14.472819 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e731bd6c-be42-448b-bcc3-587657dbca11 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:14.478035 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e731bd6c-be42-448b-bcc3-587657dbca11 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:14.484158 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e731bd6c-be42-448b-bcc3-587657dbca11 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:14.838421 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-e731bd6c-be42-448b-bcc3-587657dbca11 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:14.850280 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-29a0cb2d-bccc-444b-a0eb-1f30ba588447 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:14.850553 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e731bd6c-be42-448b-bcc3-587657dbca11 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1279 microversion: 2.1 time: 0.416641 May 10 21:09:14.871843 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 22/33] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:14 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1279 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:09:14.876046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-29a0cb2d-bccc-444b-a0eb-1f30ba588447 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1273 microversion: 2.1 time: 0.588656 May 10 21:09:14.887243 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 12/34] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:14 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1273 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:15.614713 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-143d10f1-cbe2-4b8f-9807-c02f8e595769 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Action: 'create', calling method: .version_select at 0x7f85d60cfa60>, body: {"keypair": {"name": "tempest-keypair-139296194", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjjFFYGnymvyNmFkQd/xWZVRfOmpKJiqfsHyX2JeDr3gUvWWG8vhKyjLJMoQUtSJKMvqFPHCrvDWvfnFqDV7dnsuqH2MS8oLh/HfD6KP8FM6uUeY+hJz130mSJ/FRMdFw=="}} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:15.693279 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.quota [None req-143d10f1-cbe2-4b8f-9807-c02f8e595769 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Getting quotas for project 8df9bf1cf45743dc8206cab528d583a1. Resources: {'key_pairs'} {{(pid=117713) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:09:15.697748 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.quota [None req-143d10f1-cbe2-4b8f-9807-c02f8e595769 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Getting quotas for user da06520884ff4677af84f9e7356818ef and project 8df9bf1cf45743dc8206cab528d583a1. Resources: {'key_pairs'} {{(pid=117713) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:09:15.844207 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-143d10f1-cbe2-4b8f-9807-c02f8e595769 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.971153 May 10 21:09:15.858509 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 23/35] 10.222.0.49 () {62 vars in 1199 bytes} [Tue May 10 21:09:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 973 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 21:09:15.873492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8e5a5000-5a49-47e3-a3ab-53b4c1c74eca tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:15.875272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8e5a5000-5a49-47e3-a3ab-53b4c1c74eca tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:15.894478 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e5a5000-5a49-47e3-a3ab-53b4c1c74eca tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:15.894957 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e5a5000-5a49-47e3-a3ab-53b4c1c74eca tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:15.898307 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6d6d3b24-e117-4752-8dcf-0c6880ab511b tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:15.899368 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6d6d3b24-e117-4752-8dcf-0c6880ab511b tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:15.908862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e5a5000-5a49-47e3-a3ab-53b4c1c74eca tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:15.910128 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6d6d3b24-e117-4752-8dcf-0c6880ab511b tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:15.910539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e5a5000-5a49-47e3-a3ab-53b4c1c74eca tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:15.910687 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6d6d3b24-e117-4752-8dcf-0c6880ab511b tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:15.918053 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6d6d3b24-e117-4752-8dcf-0c6880ab511b tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:15.925358 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6d6d3b24-e117-4752-8dcf-0c6880ab511b tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:16.070556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8e5a5000-5a49-47e3-a3ab-53b4c1c74eca tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:16.100142 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8e5a5000-5a49-47e3-a3ab-53b4c1c74eca tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1279 microversion: 2.1 time: 0.234933 May 10 21:09:16.101043 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 13/36] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:15 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1279 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:17.117850 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b253d9d4-41f5-431f-9f9f-9f3a58e75d16 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:17.118537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b253d9d4-41f5-431f-9f9f-9f3a58e75d16 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:17.126502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b253d9d4-41f5-431f-9f9f-9f3a58e75d16 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:17.126954 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b253d9d4-41f5-431f-9f9f-9f3a58e75d16 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:17.127776 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b253d9d4-41f5-431f-9f9f-9f3a58e75d16 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:17.128218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b253d9d4-41f5-431f-9f9f-9f3a58e75d16 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:17.525467 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b253d9d4-41f5-431f-9f9f-9f3a58e75d16 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:17.534616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b253d9d4-41f5-431f-9f9f-9f3a58e75d16 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1279 microversion: 2.1 time: 0.420585 May 10 21:09:17.539854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 14/37] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:17 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1279 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:09:18.071478 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-6d6d3b24-e117-4752-8dcf-0c6880ab511b tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:18.082857 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6d6d3b24-e117-4752-8dcf-0c6880ab511b tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1315 microversion: 2.1 time: 2.188579 May 10 21:09:18.089300 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 24/38] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:15 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1315 bytes in 2196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:09:18.559022 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6377a45e-4326-4be0-8521-c6ffabb4731f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:18.559902 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6377a45e-4326-4be0-8521-c6ffabb4731f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:18.561360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4b529a3a-a4e8-4ce9-81a0-9fe10b797cd2 tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] Action: 'create', calling method: .version_select at 0x7f85d60fed30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-133643299", "metadata": {"Type": "work"}}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:18.584141 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6377a45e-4326-4be0-8521-c6ffabb4731f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:18.586106 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6377a45e-4326-4be0-8521-c6ffabb4731f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:18.590011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4b529a3a-a4e8-4ce9-81a0-9fe10b797cd2 tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] Request method failure captured: May 10 21:09:18.590011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 21:09:18.590011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:09:18.590011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:09:18.590011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:09:18.590011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 121 May 10 21:09:18.590011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:09:18.590011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:09:18.590011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:09:18.590011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:09:18.590011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietR-qKhUThug9i2b5sSk58rwV6LvSTVzAihvL2q6vWl_xmPWd7vEvm9hgzWK2_3AoPq59Hq6CPyy7jETMfDEBlya2dzH3T0DGrmjH69JLYs9WQSwkkQed0xRaGCznoO3lULC-QL7gG-3ddG-yEBFASnUoYExDMUlswcBWZ31zatehb4 May 10 21:09:18.590011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:09:18.590011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:09:18.590011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:09:18.590011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:09:18.590011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:09:18.590011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:09:18.590011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 1c9c9245f72c409788167bef5210d3c1 May 10 21:09:18.590011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-VolumesNegativeTest-1886807686 May 10 21:09:18.590011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:09:18.590011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:09:18.591221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c9c9245f72c409788167bef5210d3c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1c9c9245f72c409788167bef5210d3c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c9c9245f72c409788167bef5210d3c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1c9c9245f72c409788167bef5210d3c1", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:09:18.591221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-VolumesNegativeTest-1886807686 May 10 21:09:18.591221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 1c9c9245f72c409788167bef5210d3c1 May 10 21:09:18.591221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-VolumesNegativeTest-1886807686 May 10 21:09:18.591221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-VolumesNegativeTest-1886807686-project May 10 21:09:18.591221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:09:18.591221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:09:18.591221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 8a6755d64cbb413c9ca08b8927b3f608 May 10 21:09:18.591221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-VolumesNegativeTest-1886807686-project May 10 21:09:18.591221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: May 10 21:09:18.591221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-133643299", "metadata": {"Type": "work"}}} May 10 21:09:18.591221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: May 10 21:09:18.591221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 21:09:18.592641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-133643299', 'metadata': {'Type': 'work'}}}} May 10 21:09:18.592641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:09:18.592641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:18.592641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 21:09:18.592641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 21:09:18.592641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 21:09:18.592641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise error May 10 21:09:18.592641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 10 21:09:18.592641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.592641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 21:09:18.592641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 21:09:18.592641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.592641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 21:09:18.592641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi '#$%' May 10 21:09:18.592641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.592641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:09:18.592641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.592641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:18.592641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:09:18.592641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:09:18.592641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:09:18.592641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:09:18.593839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 21:09:18.593839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 21:09:18.593839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:09:18.593839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:09:18.593839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 21:09:18.593839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 21:09:18.593839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 21:09:18.593839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 21:09:18.593839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 21:09:18.593839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 21:09:18.593839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 21:09:18.593839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.593839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:09:18.593839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.593839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:18.593839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:09:18.593839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:09:18.593839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 21:09:18.593839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 21:09:18.594816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 21:09:18.594816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.594816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4b529a3a-a4e8-4ce9-81a0-9fe10b797cd2 tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:09:18.594816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4b529a3a-a4e8-4ce9-81a0-9fe10b797cd2 tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.303031 May 10 21:09:18.595052 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6377a45e-4326-4be0-8521-c6ffabb4731f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:18.595163 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 15/39] 10.222.0.49 () {60 vars in 1155 bytes} [Tue May 10 21:09:18 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 308 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 21:09:18.595970 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6377a45e-4326-4be0-8521-c6ffabb4731f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:18.607960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-88bcbb1d-4c3b-4775-bec3-d73c80cd1085 tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] Action: 'create', calling method: .version_select at 0x7f85d609a310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2112649084", "metadata": {"Type": "work"}}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:18.613430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-88bcbb1d-4c3b-4775-bec3-d73c80cd1085 tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] Request method failure captured: May 10 21:09:18.613430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 21:09:18.613430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:09:18.613430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:09:18.613430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:09:18.613430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 120 May 10 21:09:18.613430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:09:18.613430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:09:18.613430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:09:18.613430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:09:18.613430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietR-qKhUThug9i2b5sSk58rwV6LvSTVzAihvL2q6vWl_xmPWd7vEvm9hgzWK2_3AoPq59Hq6CPyy7jETMfDEBlya2dzH3T0DGrmjH69JLYs9WQSwkkQed0xRaGCznoO3lULC-QL7gG-3ddG-yEBFASnUoYExDMUlswcBWZ31zatehb4 May 10 21:09:18.613430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:09:18.613430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:09:18.613430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:09:18.613430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:09:18.613430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:09:18.613430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:09:18.613430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 1c9c9245f72c409788167bef5210d3c1 May 10 21:09:18.613430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-VolumesNegativeTest-1886807686 May 10 21:09:18.613430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:09:18.613430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:09:18.614562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c9c9245f72c409788167bef5210d3c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1c9c9245f72c409788167bef5210d3c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c9c9245f72c409788167bef5210d3c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1c9c9245f72c409788167bef5210d3c1", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:09:18.614562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-VolumesNegativeTest-1886807686 May 10 21:09:18.614562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 1c9c9245f72c409788167bef5210d3c1 May 10 21:09:18.614562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-VolumesNegativeTest-1886807686 May 10 21:09:18.614562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-VolumesNegativeTest-1886807686-project May 10 21:09:18.614562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:09:18.614562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:09:18.614562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 8a6755d64cbb413c9ca08b8927b3f608 May 10 21:09:18.614562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-VolumesNegativeTest-1886807686-project May 10 21:09:18.614562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: May 10 21:09:18.614562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2112649084", "metadata": {"Type": "work"}}} May 10 21:09:18.614562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: May 10 21:09:18.614562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 21:09:18.616606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2112649084', 'metadata': {'Type': 'work'}}}} May 10 21:09:18.616606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:09:18.616606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:18.616606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 21:09:18.616606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 21:09:18.616606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 21:09:18.616606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise error May 10 21:09:18.616606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 10 21:09:18.616606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.616606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 10 21:09:18.616606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 21:09:18.616606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.616606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 21:09:18.616606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi '0' May 10 21:09:18.616606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.616606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:09:18.616606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.616606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:18.616606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:09:18.616606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:09:18.616606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:09:18.616606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:09:18.617755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 21:09:18.617755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 21:09:18.617755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:09:18.617755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:09:18.617755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 21:09:18.617755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 21:09:18.617755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 21:09:18.617755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 21:09:18.617755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 21:09:18.617755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 21:09:18.617755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 21:09:18.617755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.617755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:09:18.617755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.617755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:18.617755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:09:18.617755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:09:18.617755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 21:09:18.617755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 21:09:18.618681 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 21:09:18.618681 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.622259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-88bcbb1d-4c3b-4775-bec3-d73c80cd1085 tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:09:18.625175 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-88bcbb1d-4c3b-4775-bec3-d73c80cd1085 tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.023830 May 10 21:09:18.630573 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 16/40] 10.222.0.49 () {60 vars in 1155 bytes} [Tue May 10 21:09:18 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 21:09:18.654621 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-df82816c-7cfc-4d26-a0e5-ea4678aedcb2 tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] Action: 'create', calling method: .version_select at 0x7f85d60fe940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1330316787", "metadata": {"Type": "work"}}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:18.656254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-df82816c-7cfc-4d26-a0e5-ea4678aedcb2 tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] Request method failure captured: May 10 21:09:18.656254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 21:09:18.656254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:09:18.656254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:09:18.656254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:09:18.656254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 119 May 10 21:09:18.656254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:09:18.656254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:09:18.656254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:09:18.656254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:09:18.656254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietR-qKhUThug9i2b5sSk58rwV6LvSTVzAihvL2q6vWl_xmPWd7vEvm9hgzWK2_3AoPq59Hq6CPyy7jETMfDEBlya2dzH3T0DGrmjH69JLYs9WQSwkkQed0xRaGCznoO3lULC-QL7gG-3ddG-yEBFASnUoYExDMUlswcBWZ31zatehb4 May 10 21:09:18.656254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:09:18.656254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:09:18.656254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:09:18.656254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:09:18.656254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:09:18.656254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:09:18.656254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 1c9c9245f72c409788167bef5210d3c1 May 10 21:09:18.656254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-VolumesNegativeTest-1886807686 May 10 21:09:18.656254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:09:18.656254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:09:18.657388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c9c9245f72c409788167bef5210d3c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1c9c9245f72c409788167bef5210d3c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c9c9245f72c409788167bef5210d3c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1c9c9245f72c409788167bef5210d3c1", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:09:18.657388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-VolumesNegativeTest-1886807686 May 10 21:09:18.657388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 1c9c9245f72c409788167bef5210d3c1 May 10 21:09:18.657388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-VolumesNegativeTest-1886807686 May 10 21:09:18.657388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-VolumesNegativeTest-1886807686-project May 10 21:09:18.657388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:09:18.657388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:09:18.657388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 8a6755d64cbb413c9ca08b8927b3f608 May 10 21:09:18.657388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-VolumesNegativeTest-1886807686-project May 10 21:09:18.657388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: May 10 21:09:18.657388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1330316787", "metadata": {"Type": "work"}}} May 10 21:09:18.657388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: May 10 21:09:18.657388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 21:09:18.658069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1330316787', 'metadata': {'Type': 'work'}}}} May 10 21:09:18.658069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:09:18.658069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:18.658069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 21:09:18.658069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 21:09:18.658069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 21:09:18.658069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise error May 10 21:09:18.658069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 10 21:09:18.658069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.658069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 21:09:18.658069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 21:09:18.658069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.658069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 21:09:18.658069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi '' May 10 21:09:18.658069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.658069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:09:18.658069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.658069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:18.658069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:09:18.658069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:09:18.658069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:09:18.658069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:09:18.659228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 21:09:18.659228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 21:09:18.659228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:09:18.659228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:09:18.659228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 21:09:18.659228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 21:09:18.659228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 21:09:18.659228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 21:09:18.659228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 21:09:18.659228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 21:09:18.659228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 21:09:18.659228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.659228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:09:18.659228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.659228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:18.659228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:09:18.659228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:09:18.659228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 21:09:18.659228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 21:09:18.660212 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 21:09:18.660212 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.663891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-df82816c-7cfc-4d26-a0e5-ea4678aedcb2 tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:09:18.665355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-df82816c-7cfc-4d26-a0e5-ea4678aedcb2 tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.031829 May 10 21:09:18.666543 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 17/41] 10.222.0.49 () {60 vars in 1155 bytes} [Tue May 10 21:09:18 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 21:09:18.685221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ce7c589b-1383-4284-a5c3-ed1653d1b0d9 tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] Calling method '.version_select at 0x7f85d609a4c0>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:18.742032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-ce7c589b-1383-4284-a5c3-ed1653d1b0d9 tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] HTTP exception thrown: Volume tempest-invalid-1523859693 could not be found. May 10 21:09:18.746305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ce7c589b-1383-4284-a5c3-ed1653d1b0d9 tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] Request method failure captured: May 10 21:09:18.746305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1523859693 HTTP/1.1 May 10 21:09:18.746305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:09:18.746305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:09:18.746305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:09:18.746305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:09:18.746305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:09:18.746305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:09:18.746305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:09:18.746305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:09:18.746305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietR-qKhUThug9i2b5sSk58rwV6LvSTVzAihvL2q6vWl_xmPWd7vEvm9hgzWK2_3AoPq59Hq6CPyy7jETMfDEBlya2dzH3T0DGrmjH69JLYs9WQSwkkQed0xRaGCznoO3lULC-QL7gG-3ddG-yEBFASnUoYExDMUlswcBWZ31zatehb4 May 10 21:09:18.746305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:09:18.746305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:09:18.746305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:09:18.746305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:09:18.746305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:09:18.746305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:09:18.746305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 1c9c9245f72c409788167bef5210d3c1 May 10 21:09:18.746305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-VolumesNegativeTest-1886807686 May 10 21:09:18.746305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:09:18.746305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:09:18.747486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c9c9245f72c409788167bef5210d3c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1c9c9245f72c409788167bef5210d3c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c9c9245f72c409788167bef5210d3c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1c9c9245f72c409788167bef5210d3c1", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:09:18.747486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-VolumesNegativeTest-1886807686 May 10 21:09:18.747486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 1c9c9245f72c409788167bef5210d3c1 May 10 21:09:18.747486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-VolumesNegativeTest-1886807686 May 10 21:09:18.747486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-VolumesNegativeTest-1886807686-project May 10 21:09:18.747486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:09:18.747486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:09:18.747486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 8a6755d64cbb413c9ca08b8927b3f608 May 10 21:09:18.747486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-VolumesNegativeTest-1886807686-project May 10 21:09:18.747486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: May 10 21:09:18.747486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Volume tempest-invalid-1523859693 could not be found. May 10 21:09:18.747486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': 'tempest-invalid-1523859693'} May 10 21:09:18.747486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:09:18.748712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:18.748712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:09:18.748712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:09:18.748712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 21:09:18.748712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 21:09:18.748712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 21:09:18.748712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 21:09:18.748712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 21:09:18.748712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 21:09:18.748712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 21:09:18.748712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 21:09:18.748712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:09:18.748712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:09:18.748712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:09:18.748712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:09:18.748712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1523859693 could not be found. (HTTP 404) (Request-ID: req-ae533fd8-5bf3-4f18-bbad-8c1afd2e1be7) May 10 21:09:18.748712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.748712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:09:18.748712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.749691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:18.749691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 21:09:18.749691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 21:09:18.749691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 21:09:18.749691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 21:09:18.749691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 21:09:18.749691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 21:09:18.749691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 21:09:18.749691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 21:09:18.749691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:09:18.749691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:09:18.749691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 21:09:18.749691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 21:09:18.749691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 21:09:18.749691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 21:09:18.749691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 21:09:18.749691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 21:09:18.749691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 21:09:18.749691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 21:09:18.750649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:09:18.750649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:09:18.750649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:09:18.750649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:09:18.750649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1523859693 could not be found. May 10 21:09:18.750649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.750649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:09:18.750649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.750649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:18.750649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:09:18.750649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:09:18.750649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:09:18.750649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:09:18.750649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 21:09:18.750649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 21:09:18.750649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:09:18.750649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:09:18.750649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 21:09:18.750649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:09:18.750649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1523859693 could not be found. May 10 21:09:18.752054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.752054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:09:18.752054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.752054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:18.752054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:09:18.752054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:09:18.752054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:09:18.752054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:09:18.752054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1523859693 could not be found. May 10 21:09:18.752054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.755478 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ce7c589b-1383-4284-a5c3-ed1653d1b0d9 tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] Returning 404 to user: Volume tempest-invalid-1523859693 could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:09:18.756839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ce7c589b-1383-4284-a5c3-ed1653d1b0d9 tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1523859693" status: 404 len: 99 microversion: 2.1 time: 0.076025 May 10 21:09:18.757931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 18/42] 10.222.0.49 () {58 vars in 1217 bytes} [Tue May 10 21:09:18 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1523859693 => generated 99 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 10 21:09:18.771743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b7cf3db9-c282-4dc9-8a3a-5433720cb17e tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007222 May 10 21:09:18.776282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 19/43] 10.222.0.49 () {58 vars in 1139 bytes} [Tue May 10 21:09:18 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 10 21:09:18.798675 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c0e2d7a2-c1a3-4785-b9fe-e2b7f152ef9b tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015613 May 10 21:09:18.799741 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 20/44] 10.222.0.49 () {58 vars in 1136 bytes} [Tue May 10 21:09:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 10 21:09:18.821570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2a05dbf7-8884-4822-aec2-a0cc246985fe tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] Calling method '.version_select at 0x7f85d60df940>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:18.893272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-2a05dbf7-8884-4822-aec2-a0cc246985fe tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] HTTP exception thrown: Volume bf352a1e-020c-407e-ad83-27093ca39b1b could not be found. May 10 21:09:18.895849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2a05dbf7-8884-4822-aec2-a0cc246985fe tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] Request method failure captured: May 10 21:09:18.895849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: DELETE /compute/v2.1/os-volumes/bf352a1e-020c-407e-ad83-27093ca39b1b HTTP/1.1 May 10 21:09:18.895849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:09:18.895849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:09:18.895849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:09:18.895849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:09:18.895849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:09:18.895849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:09:18.895849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:09:18.895849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:09:18.895849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietR-qKhUThug9i2b5sSk58rwV6LvSTVzAihvL2q6vWl_xmPWd7vEvm9hgzWK2_3AoPq59Hq6CPyy7jETMfDEBlya2dzH3T0DGrmjH69JLYs9WQSwkkQed0xRaGCznoO3lULC-QL7gG-3ddG-yEBFASnUoYExDMUlswcBWZ31zatehb4 May 10 21:09:18.895849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:09:18.895849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:09:18.895849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:09:18.895849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:09:18.895849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:09:18.895849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:09:18.895849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 1c9c9245f72c409788167bef5210d3c1 May 10 21:09:18.895849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-VolumesNegativeTest-1886807686 May 10 21:09:18.895849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:09:18.895849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:09:18.897285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c9c9245f72c409788167bef5210d3c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1c9c9245f72c409788167bef5210d3c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c9c9245f72c409788167bef5210d3c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1c9c9245f72c409788167bef5210d3c1", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:09:18.897285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-VolumesNegativeTest-1886807686 May 10 21:09:18.897285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 1c9c9245f72c409788167bef5210d3c1 May 10 21:09:18.897285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-VolumesNegativeTest-1886807686 May 10 21:09:18.897285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-VolumesNegativeTest-1886807686-project May 10 21:09:18.897285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:09:18.897285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:09:18.897285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 8a6755d64cbb413c9ca08b8927b3f608 May 10 21:09:18.897285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-VolumesNegativeTest-1886807686-project May 10 21:09:18.897285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: May 10 21:09:18.897285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Volume bf352a1e-020c-407e-ad83-27093ca39b1b could not be found. May 10 21:09:18.897285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': 'bf352a1e-020c-407e-ad83-27093ca39b1b'} May 10 21:09:18.897285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:09:18.898092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:18.898092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:09:18.898092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:09:18.898092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 21:09:18.898092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 21:09:18.898092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 21:09:18.898092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 21:09:18.898092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 21:09:18.898092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 21:09:18.898092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 21:09:18.898092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 21:09:18.898092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:09:18.898092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:09:18.898092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:09:18.898092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:09:18.898092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bf352a1e-020c-407e-ad83-27093ca39b1b could not be found. (HTTP 404) (Request-ID: req-76fb7c2b-290a-46b5-bda2-64195db574a0) May 10 21:09:18.898092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.898092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:09:18.898092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.905232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:18.905232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 21:09:18.905232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 21:09:18.905232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 21:09:18.905232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 21:09:18.905232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 21:09:18.905232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 21:09:18.905232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 21:09:18.905232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 21:09:18.905232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:09:18.905232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:09:18.905232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 21:09:18.905232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 21:09:18.905232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 21:09:18.905232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 21:09:18.905232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 21:09:18.905232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 21:09:18.905232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 21:09:18.905232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 21:09:18.906522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:09:18.906522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:09:18.906522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:09:18.906522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:09:18.906522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bf352a1e-020c-407e-ad83-27093ca39b1b could not be found. May 10 21:09:18.906522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.906522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:09:18.906522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.906522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:18.906522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:09:18.906522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:09:18.906522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:09:18.906522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:09:18.906522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 21:09:18.906522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 21:09:18.906522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:09:18.906522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:09:18.906522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 21:09:18.906522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:09:18.907806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bf352a1e-020c-407e-ad83-27093ca39b1b could not be found. May 10 21:09:18.907806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.907806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:09:18.907806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.907806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:18.907806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:09:18.907806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:09:18.907806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:09:18.907806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:09:18.907806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bf352a1e-020c-407e-ad83-27093ca39b1b could not be found. May 10 21:09:18.907806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.907806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2a05dbf7-8884-4822-aec2-a0cc246985fe tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] Returning 404 to user: Volume bf352a1e-020c-407e-ad83-27093ca39b1b could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:09:18.907806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2a05dbf7-8884-4822-aec2-a0cc246985fe tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/bf352a1e-020c-407e-ad83-27093ca39b1b" status: 404 len: 109 microversion: 2.1 time: 0.090842 May 10 21:09:18.907806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 21/45] 10.222.0.49 () {58 vars in 1247 bytes} [Tue May 10 21:09:18 2022] DELETE /compute/v2.1/os-volumes/bf352a1e-020c-407e-ad83-27093ca39b1b => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 21:09:18.910718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e8bdfbcb-a9ec-4826-a045-a3983525fb40 tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] Calling method '.version_select at 0x7f85d60df940>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:18.950387 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-e8bdfbcb-a9ec-4826-a045-a3983525fb40 tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] HTTP exception thrown: Volume 3ee1e176-b4c4-4ec0-8802-76358ea31658 could not be found. May 10 21:09:18.953025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e8bdfbcb-a9ec-4826-a045-a3983525fb40 tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] Request method failure captured: May 10 21:09:18.953025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: GET /compute/v2.1/os-volumes/3ee1e176-b4c4-4ec0-8802-76358ea31658 HTTP/1.1 May 10 21:09:18.953025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:09:18.953025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:09:18.953025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:09:18.953025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:09:18.953025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:09:18.953025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:09:18.953025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:09:18.953025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:09:18.953025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietR-qKhUThug9i2b5sSk58rwV6LvSTVzAihvL2q6vWl_xmPWd7vEvm9hgzWK2_3AoPq59Hq6CPyy7jETMfDEBlya2dzH3T0DGrmjH69JLYs9WQSwkkQed0xRaGCznoO3lULC-QL7gG-3ddG-yEBFASnUoYExDMUlswcBWZ31zatehb4 May 10 21:09:18.953025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:09:18.953025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:09:18.953025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:09:18.953025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:09:18.953025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:09:18.953025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:09:18.953025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 1c9c9245f72c409788167bef5210d3c1 May 10 21:09:18.953025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-VolumesNegativeTest-1886807686 May 10 21:09:18.953025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:09:18.953025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:09:18.954444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c9c9245f72c409788167bef5210d3c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1c9c9245f72c409788167bef5210d3c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c9c9245f72c409788167bef5210d3c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1c9c9245f72c409788167bef5210d3c1", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:09:18.954444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-VolumesNegativeTest-1886807686 May 10 21:09:18.954444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 1c9c9245f72c409788167bef5210d3c1 May 10 21:09:18.954444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-VolumesNegativeTest-1886807686 May 10 21:09:18.954444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-VolumesNegativeTest-1886807686-project May 10 21:09:18.954444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:09:18.954444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:09:18.954444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 8a6755d64cbb413c9ca08b8927b3f608 May 10 21:09:18.954444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-VolumesNegativeTest-1886807686-project May 10 21:09:18.954444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: May 10 21:09:18.954444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Volume 3ee1e176-b4c4-4ec0-8802-76358ea31658 could not be found. May 10 21:09:18.954444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': '3ee1e176-b4c4-4ec0-8802-76358ea31658'} May 10 21:09:18.954444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:09:18.955456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:18.955456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:09:18.955456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:09:18.955456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 21:09:18.955456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 21:09:18.955456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 21:09:18.955456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 21:09:18.955456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 21:09:18.955456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 21:09:18.955456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 21:09:18.955456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 21:09:18.955456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:09:18.955456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:09:18.955456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:09:18.955456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:09:18.955456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3ee1e176-b4c4-4ec0-8802-76358ea31658 could not be found. (HTTP 404) (Request-ID: req-f08277f3-47b0-4d80-8ca7-eefec76703f8) May 10 21:09:18.955456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.955456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:09:18.955456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.956972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:18.956972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 21:09:18.956972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 21:09:18.956972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 21:09:18.956972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 21:09:18.956972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 21:09:18.956972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 21:09:18.956972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 21:09:18.956972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 21:09:18.956972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:09:18.956972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:09:18.956972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 21:09:18.956972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 21:09:18.956972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 21:09:18.956972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 21:09:18.956972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 21:09:18.956972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 21:09:18.956972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 21:09:18.956972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 21:09:18.958259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:09:18.958259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:09:18.958259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:09:18.958259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:09:18.958259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3ee1e176-b4c4-4ec0-8802-76358ea31658 could not be found. May 10 21:09:18.958259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.958259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:09:18.958259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.958259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:18.958259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:09:18.958259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:09:18.958259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:09:18.958259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:09:18.958259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 21:09:18.958259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 21:09:18.958259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:09:18.958259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:09:18.958259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 21:09:18.958259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:09:18.959959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3ee1e176-b4c4-4ec0-8802-76358ea31658 could not be found. May 10 21:09:18.959959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.959959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:09:18.959959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.959959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:09:18.959959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:09:18.959959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:09:18.959959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:09:18.959959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:09:18.959959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3ee1e176-b4c4-4ec0-8802-76358ea31658 could not be found. May 10 21:09:18.959959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:09:18.959959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e8bdfbcb-a9ec-4826-a045-a3983525fb40 tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] Returning 404 to user: Volume 3ee1e176-b4c4-4ec0-8802-76358ea31658 could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:09:18.959959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e8bdfbcb-a9ec-4826-a045-a3983525fb40 tempest-VolumesNegativeTest-1886807686 tempest-VolumesNegativeTest-1886807686-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/3ee1e176-b4c4-4ec0-8802-76358ea31658" status: 404 len: 109 microversion: 2.1 time: 0.050666 May 10 21:09:18.965840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 22/46] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 21:09:18 2022] GET /compute/v2.1/os-volumes/3ee1e176-b4c4-4ec0-8802-76358ea31658 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:09:19.107558 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-51f25785-eaa6-461b-b63d-a779c7caa7ba tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:19.108234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-51f25785-eaa6-461b-b63d-a779c7caa7ba tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:19.121539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51f25785-eaa6-461b-b63d-a779c7caa7ba tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:19.124915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51f25785-eaa6-461b-b63d-a779c7caa7ba tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:19.129779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51f25785-eaa6-461b-b63d-a779c7caa7ba tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:19.129779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51f25785-eaa6-461b-b63d-a779c7caa7ba tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:19.887020 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-6377a45e-4326-4be0-8521-c6ffabb4731f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:19.900021 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6377a45e-4326-4be0-8521-c6ffabb4731f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1321 microversion: 2.1 time: 1.346608 May 10 21:09:19.901759 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 25/47] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:18 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1321 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:09:20.367412 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-51f25785-eaa6-461b-b63d-a779c7caa7ba tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:20.374754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-51f25785-eaa6-461b-b63d-a779c7caa7ba tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1315 microversion: 2.1 time: 1.272682 May 10 21:09:20.384641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 23/48] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:19 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1315 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:09:20.919681 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9539da80-9fe7-4d2f-a07a-d3367a323658 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:20.920468 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9539da80-9fe7-4d2f-a07a-d3367a323658 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:20.936172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9539da80-9fe7-4d2f-a07a-d3367a323658 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:20.937921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9539da80-9fe7-4d2f-a07a-d3367a323658 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:20.940663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9539da80-9fe7-4d2f-a07a-d3367a323658 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:20.942639 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9539da80-9fe7-4d2f-a07a-d3367a323658 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:21.331442 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-1916ab79-c14f-4a41-9715-907c9eee1c98 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Action: 'create', calling method: .version_select at 0x7f85d6025b80>, body: {"keypair": {"name": "tempest-keypair-1236642330", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb+jJhfXTTiPRJCjlmiRUKVG5l5Xlm/oZUqvkmaGfje6XqHpiMlmas9syBFM3kWYrOFOhYd7EXk16B/xmPRgLpHaO3e39btTjRQBvy3BpyzftEsmFx4avqVtzzByJTajA=="}} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:21.399042 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.quota [None req-1916ab79-c14f-4a41-9715-907c9eee1c98 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Getting quotas for project bd946455713e4c36a8efadbce486ee8b. Resources: {'key_pairs'} {{(pid=117713) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:09:21.416291 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.quota [None req-1916ab79-c14f-4a41-9715-907c9eee1c98 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Getting quotas for user dc411f6a0a024e7eac561ad1b6d2a944 and project bd946455713e4c36a8efadbce486ee8b. Resources: {'key_pairs'} {{(pid=117713) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:09:21.557612 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-1916ab79-c14f-4a41-9715-907c9eee1c98 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.904892 May 10 21:09:21.558952 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 26/49] 10.222.0.49 () {60 vars in 1158 bytes} [Tue May 10 21:09:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:09:21.579856 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-b915ed33-4939-4332-ad3a-0ac7672fc87f tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:21.580750 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-b915ed33-4939-4332-ad3a-0ac7672fc87f tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:21.596666 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b915ed33-4939-4332-ad3a-0ac7672fc87f tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:21.624881 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b915ed33-4939-4332-ad3a-0ac7672fc87f tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:21.625978 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b915ed33-4939-4332-ad3a-0ac7672fc87f tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:21.628258 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b915ed33-4939-4332-ad3a-0ac7672fc87f tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:22.074766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9539da80-9fe7-4d2f-a07a-d3367a323658 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:22.094654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9539da80-9fe7-4d2f-a07a-d3367a323658 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1321 microversion: 2.1 time: 1.179886 May 10 21:09:22.097438 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 24/50] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:20 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1321 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:22.823229 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-b915ed33-4939-4332-ad3a-0ac7672fc87f tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:22.832941 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-b915ed33-4939-4332-ad3a-0ac7672fc87f tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1315 microversion: 2.1 time: 1.272770 May 10 21:09:22.833529 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 27/51] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:21 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1315 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:23.118412 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-03fc0f73-8fde-435a-978a-2fa689344b79 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:23.124439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-03fc0f73-8fde-435a-978a-2fa689344b79 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:23.154911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03fc0f73-8fde-435a-978a-2fa689344b79 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:23.157787 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03fc0f73-8fde-435a-978a-2fa689344b79 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:23.168119 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03fc0f73-8fde-435a-978a-2fa689344b79 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:23.170815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03fc0f73-8fde-435a-978a-2fa689344b79 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:23.849801 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-424d6b1a-c9db-4d62-b604-9be1a86a001e tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:23.850540 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-424d6b1a-c9db-4d62-b604-9be1a86a001e tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:23.861894 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-424d6b1a-c9db-4d62-b604-9be1a86a001e tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:23.871874 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-424d6b1a-c9db-4d62-b604-9be1a86a001e tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:23.873591 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-424d6b1a-c9db-4d62-b604-9be1a86a001e tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:23.874229 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-424d6b1a-c9db-4d62-b604-9be1a86a001e tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:24.838111 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-03fc0f73-8fde-435a-978a-2fa689344b79 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:24.854415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-03fc0f73-8fde-435a-978a-2fa689344b79 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1321 microversion: 2.1 time: 1.740600 May 10 21:09:24.856408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 25/52] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:23 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1321 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:25.350171 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-424d6b1a-c9db-4d62-b604-9be1a86a001e tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:25.363607 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-424d6b1a-c9db-4d62-b604-9be1a86a001e tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1315 microversion: 2.1 time: 1.517519 May 10 21:09:25.364179 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 28/53] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:23 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1315 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:09:25.420684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-4514f8af-944b-4a9e-9072-f8669646626d req-e0f86092-b006-4e7a-8c00-af7881dd0738 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ee5480a-213a-489e-a366-5ffa59cf5487", "tag": "e1708824-bd48-4216-a98b-629b26d874f1"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:25.453773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-4514f8af-944b-4a9e-9072-f8669646626d req-e0f86092-b006-4e7a-8c00-af7881dd0738 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:25.454442 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-4514f8af-944b-4a9e-9072-f8669646626d req-e0f86092-b006-4e7a-8c00-af7881dd0738 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:25.551454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-4514f8af-944b-4a9e-9072-f8669646626d req-e0f86092-b006-4e7a-8c00-af7881dd0738 service nova] Creating event network-changed:e1708824-bd48-4216-a98b-629b26d874f1 for instance 2ee5480a-213a-489e-a366-5ffa59cf5487 on hv-cinder-82880 May 10 21:09:25.551454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-4514f8af-944b-4a9e-9072-f8669646626d req-e0f86092-b006-4e7a-8c00-af7881dd0738 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117714) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 21:09:25.551454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0f289cc-9fcc-4e21-b0ed-fcb922ae7aa2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:25.551454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0f289cc-9fcc-4e21-b0ed-fcb922ae7aa2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:25.551454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0f289cc-9fcc-4e21-b0ed-fcb922ae7aa2 None None] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:25.552274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0f289cc-9fcc-4e21-b0ed-fcb922ae7aa2 None None] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:25.571276 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.compute.rpcapi [None req-a0f289cc-9fcc-4e21-b0ed-fcb922ae7aa2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 21:09:25.576737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0f289cc-9fcc-4e21-b0ed-fcb922ae7aa2 None None] Releasing lock "compute-rpcapi-router" {{(pid=117714) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 21:09:25.627448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a0f289cc-9fcc-4e21-b0ed-fcb922ae7aa2 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.522439 May 10 21:09:25.629094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 26/54] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:09:25.660750 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-2263de52-ebef-4d4f-98fe-64d11d8a9e5b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Action: 'create', calling method: .version_select at 0x7f85d607df70>, body: {"keypair": {"name": "tempest-keypair-1097456563", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqa1rt9qmx8+QExgIHDX9u+Z9/GVNU1cQovidpuwiJLosOIuqeRQHMbIytcaKtUpn+B82LGwo2HuFSDynDT6KVQDGHjOVFe/CEHNFdjiAqNfntG1keXDkr6uA9D8XO5RA=="}} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:25.692934 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.quota [None req-2263de52-ebef-4d4f-98fe-64d11d8a9e5b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Getting quotas for project 9582743483fa4fb88f4e91d3f787c945. Resources: {'key_pairs'} {{(pid=117713) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:09:25.702936 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.quota [None req-2263de52-ebef-4d4f-98fe-64d11d8a9e5b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Getting quotas for user 62bc5605a22d408f9b4bac69a0f5f486 and project 9582743483fa4fb88f4e91d3f787c945. Resources: {'key_pairs'} {{(pid=117713) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:09:25.895213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bd8f3739-f684-407a-bb50-d0bf66241405 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:25.899105 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bd8f3739-f684-407a-bb50-d0bf66241405 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:25.928706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bd8f3739-f684-407a-bb50-d0bf66241405 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:25.930611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bd8f3739-f684-407a-bb50-d0bf66241405 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:25.931963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bd8f3739-f684-407a-bb50-d0bf66241405 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:25.933033 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bd8f3739-f684-407a-bb50-d0bf66241405 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:26.289686 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-2263de52-ebef-4d4f-98fe-64d11d8a9e5b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.908636 May 10 21:09:26.289686 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 29/55] 10.222.0.49 () {60 vars in 1158 bytes} [Tue May 10 21:09:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:09:26.421007 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e1027d95-2dfd-4b77-bd71-9e703074aef6 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:26.421007 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e1027d95-2dfd-4b77-bd71-9e703074aef6 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:26.421007 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e1027d95-2dfd-4b77-bd71-9e703074aef6 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:26.421007 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e1027d95-2dfd-4b77-bd71-9e703074aef6 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:26.422007 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e1027d95-2dfd-4b77-bd71-9e703074aef6 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:26.422007 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e1027d95-2dfd-4b77-bd71-9e703074aef6 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:26.978763 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-e1027d95-2dfd-4b77-bd71-9e703074aef6 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:26.993267 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bd8f3739-f684-407a-bb50-d0bf66241405 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:27.001469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bd8f3739-f684-407a-bb50-d0bf66241405 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1321 microversion: 2.1 time: 1.120170 May 10 21:09:27.012313 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e1027d95-2dfd-4b77-bd71-9e703074aef6 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1315 microversion: 2.1 time: 0.616483 May 10 21:09:27.012313 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 30/56] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:26 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1315 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:27.012658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 27/57] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:25 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1321 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:27.697287 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [req-dd3ccc01-feb3-4cdb-a4cf-40b21c066305 req-27629559-9725-4604-8898-3edf2456bd5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ef51171-183b-4712-b00c-f9612618e4d8", "tag": "a4b5b4f5-1566-4995-b222-14d74d8b3930"}]} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:27.749101 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-dd3ccc01-feb3-4cdb-a4cf-40b21c066305 req-27629559-9725-4604-8898-3edf2456bd5c service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:27.749101 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-dd3ccc01-feb3-4cdb-a4cf-40b21c066305 req-27629559-9725-4604-8898-3edf2456bd5c service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:27.815148 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.compute.server_external_events [req-dd3ccc01-feb3-4cdb-a4cf-40b21c066305 req-27629559-9725-4604-8898-3edf2456bd5c service nova] Creating event network-changed:a4b5b4f5-1566-4995-b222-14d74d8b3930 for instance 5ef51171-183b-4712-b00c-f9612618e4d8 on hv-cinder-82880 May 10 21:09:27.815699 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-dd3ccc01-feb3-4cdb-a4cf-40b21c066305 req-27629559-9725-4604-8898-3edf2456bd5c service nova] Acquired lock "compute-rpcapi-router" {{(pid=117713) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 21:09:27.817707 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-40808472-94fb-4674-b1dd-6a35197d925c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:27.818244 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-40808472-94fb-4674-b1dd-6a35197d925c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:27.825117 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-40808472-94fb-4674-b1dd-6a35197d925c None None] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:27.825117 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-40808472-94fb-4674-b1dd-6a35197d925c None None] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:27.841046 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.compute.rpcapi [None req-40808472-94fb-4674-b1dd-6a35197d925c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 21:09:27.848494 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-40808472-94fb-4674-b1dd-6a35197d925c None None] Releasing lock "compute-rpcapi-router" {{(pid=117713) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 21:09:27.899814 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-40808472-94fb-4674-b1dd-6a35197d925c None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.205885 May 10 21:09:27.900855 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 31/58] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:09:28.020850 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-37def6ff-3bc4-45fe-931b-e28fb3cfd024 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:28.021888 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-37def6ff-3bc4-45fe-931b-e28fb3cfd024 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:28.033248 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-37def6ff-3bc4-45fe-931b-e28fb3cfd024 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:28.033248 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-37def6ff-3bc4-45fe-931b-e28fb3cfd024 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:28.043869 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-37def6ff-3bc4-45fe-931b-e28fb3cfd024 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:28.045458 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-37def6ff-3bc4-45fe-931b-e28fb3cfd024 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:28.413311 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-47cd4429-329d-48e3-914c-6630d7eab931 req-b9ae10ef-feb8-445d-8d67-64ac1682bdbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87", "tag": "40e484fd-855a-4680-a2ef-45c93b616ec9"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:28.428008 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-47cd4429-329d-48e3-914c-6630d7eab931 req-b9ae10ef-feb8-445d-8d67-64ac1682bdbd service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:28.430549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-47cd4429-329d-48e3-914c-6630d7eab931 req-b9ae10ef-feb8-445d-8d67-64ac1682bdbd service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:28.470655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-47cd4429-329d-48e3-914c-6630d7eab931 req-b9ae10ef-feb8-445d-8d67-64ac1682bdbd service nova] Creating event network-changed:40e484fd-855a-4680-a2ef-45c93b616ec9 for instance cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 on hv-cinder-82880 May 10 21:09:28.482584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-47cd4429-329d-48e3-914c-6630d7eab931 req-b9ae10ef-feb8-445d-8d67-64ac1682bdbd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.584063 May 10 21:09:28.485963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 28/59] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:09:28.501227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-50649a08-98a2-49d1-9c54-e1ae5801dc5b tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:28.502161 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-50649a08-98a2-49d1-9c54-e1ae5801dc5b tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:28.519316 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50649a08-98a2-49d1-9c54-e1ae5801dc5b tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:28.523098 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50649a08-98a2-49d1-9c54-e1ae5801dc5b tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:28.524956 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50649a08-98a2-49d1-9c54-e1ae5801dc5b tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:28.526237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50649a08-98a2-49d1-9c54-e1ae5801dc5b tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:28.740136 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-50649a08-98a2-49d1-9c54-e1ae5801dc5b tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:28.750638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-50649a08-98a2-49d1-9c54-e1ae5801dc5b tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1315 microversion: 2.1 time: 0.263192 May 10 21:09:28.753493 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 29/60] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:28 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:28.883795 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-37def6ff-3bc4-45fe-931b-e28fb3cfd024 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:28.891896 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-37def6ff-3bc4-45fe-931b-e28fb3cfd024 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1321 microversion: 2.1 time: 0.875744 May 10 21:09:28.900529 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 32/61] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:28 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1321 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:09:29.598077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-03e9fedf-803e-42da-905f-94114bbb955e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1981813066", "imageRef": "cb321ccf-1ce7-4dda-90d0-f05332eb6fe1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "411e8f68-b02f-49ed-9c70-3713b4941372"}], "security_groups": [{"name": "tempest-securitygroup--2027197343"}], "key_name": "tempest-keypair-139296194", "user_data": "}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:29.751908 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.network.neutron [None req-03e9fedf-803e-42da-905f-94114bbb955e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] validate_networks() for [('411e8f68-b02f-49ed-9c70-3713b4941372', None, None, None, None, None)] {{(pid=117714) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:09:29.772541 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-3d738bf7-89f1-4d7a-ac58-2d9c1fa7c0eb tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:29.773240 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-3d738bf7-89f1-4d7a-ac58-2d9c1fa7c0eb tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:29.784044 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3d738bf7-89f1-4d7a-ac58-2d9c1fa7c0eb tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:29.784833 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3d738bf7-89f1-4d7a-ac58-2d9c1fa7c0eb tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:29.785864 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3d738bf7-89f1-4d7a-ac58-2d9c1fa7c0eb tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:29.787445 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3d738bf7-89f1-4d7a-ac58-2d9c1fa7c0eb tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:30.381796 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-3d738bf7-89f1-4d7a-ac58-2d9c1fa7c0eb tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:30.393648 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-3d738bf7-89f1-4d7a-ac58-2d9c1fa7c0eb tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1315 microversion: 2.1 time: 0.626355 May 10 21:09:30.397022 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 33/62] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:29 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:30.403863 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-1630f5a5-2463-41aa-833b-f8b02f902710 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:30.407971 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-1630f5a5-2463-41aa-833b-f8b02f902710 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:30.421238 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1630f5a5-2463-41aa-833b-f8b02f902710 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:30.424194 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1630f5a5-2463-41aa-833b-f8b02f902710 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:30.425848 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1630f5a5-2463-41aa-833b-f8b02f902710 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:30.427820 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1630f5a5-2463-41aa-833b-f8b02f902710 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:30.929922 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-1630f5a5-2463-41aa-833b-f8b02f902710 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:30.955297 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-1630f5a5-2463-41aa-833b-f8b02f902710 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1321 microversion: 2.1 time: 0.556852 May 10 21:09:30.958655 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 34/63] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:30 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1321 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:31.302594 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-03e9fedf-803e-42da-905f-94114bbb955e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Flavor limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:09:31.303665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-03e9fedf-803e-42da-905f-94114bbb955e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Image limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:09:31.304652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-03e9fedf-803e-42da-905f-94114bbb955e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Flavor pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:09:31.306058 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-03e9fedf-803e-42da-905f-94114bbb955e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Image pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:09:31.306939 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-03e9fedf-803e-42da-905f-94114bbb955e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:09:31.321177 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-380803d5-1579-420d-b865-46e2f534474f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1929190424", "imageRef": "cb321ccf-1ce7-4dda-90d0-f05332eb6fe1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "478733af-435d-4c58-bab5-39ad34689a2c"}], "security_groups": [{"name": "tempest-securitygroup--134965850"}], "key_name": "tempest-keypair-1236642330", "user_data": "}} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:31.332705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03e9fedf-803e-42da-905f-94114bbb955e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:31.333406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03e9fedf-803e-42da-905f-94114bbb955e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:31.334681 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03e9fedf-803e-42da-905f-94114bbb955e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:31.336605 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03e9fedf-803e-42da-905f-94114bbb955e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:31.397888 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-03e9fedf-803e-42da-905f-94114bbb955e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Getting quotas for project 8df9bf1cf45743dc8206cab528d583a1. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:09:31.402880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-03e9fedf-803e-42da-905f-94114bbb955e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Getting quotas for user da06520884ff4677af84f9e7356818ef and project 8df9bf1cf45743dc8206cab528d583a1. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:09:31.449641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-03e9fedf-803e-42da-905f-94114bbb955e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Going to run 1 instances... {{(pid=117714) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:09:31.453987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-03e9fedf-803e-42da-905f-94114bbb955e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb321ccf-1ce7-4dda-90d0-f05332eb6fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117714) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:09:31.577467 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.network.neutron [None req-380803d5-1579-420d-b865-46e2f534474f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] validate_networks() for [('478733af-435d-4c58-bab5-39ad34689a2c', None, None, None, None, None)] {{(pid=117713) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:09:31.624671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-03e9fedf-803e-42da-905f-94114bbb955e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.032478 May 10 21:09:31.630929 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 30/64] 10.222.0.49 () {62 vars in 1187 bytes} [Tue May 10 21:09:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 2040 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 21:09:31.636196 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-abee1acd-3af4-44c8-ba7b-03f91f2da41c tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:31.638846 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-abee1acd-3af4-44c8-ba7b-03f91f2da41c tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:31.657231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-abee1acd-3af4-44c8-ba7b-03f91f2da41c tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:31.659858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-abee1acd-3af4-44c8-ba7b-03f91f2da41c tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:31.661019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-abee1acd-3af4-44c8-ba7b-03f91f2da41c tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:31.663516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-abee1acd-3af4-44c8-ba7b-03f91f2da41c tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:32.195925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-abee1acd-3af4-44c8-ba7b-03f91f2da41c tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:32.204690 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-abee1acd-3af4-44c8-ba7b-03f91f2da41c tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1315 microversion: 2.1 time: 0.575539 May 10 21:09:32.209447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 31/65] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:31 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1315 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:32.221838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f87fe72a-cd27-460e-979c-39c001dfc520 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:32.227218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f87fe72a-cd27-460e-979c-39c001dfc520 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:32.299278 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f87fe72a-cd27-460e-979c-39c001dfc520 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:32.309682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f87fe72a-cd27-460e-979c-39c001dfc520 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:32.313205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f87fe72a-cd27-460e-979c-39c001dfc520 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:32.315456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f87fe72a-cd27-460e-979c-39c001dfc520 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1281 microversion: 2.20 time: 0.104200 May 10 21:09:32.316218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 32/66] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:09:32 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1281 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:09:32.323460 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a4974dd2-6921-4bf8-816d-8b5e6d896c1f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:32.324250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a4974dd2-6921-4bf8-816d-8b5e6d896c1f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:32.332193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a4974dd2-6921-4bf8-816d-8b5e6d896c1f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:32.332913 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a4974dd2-6921-4bf8-816d-8b5e6d896c1f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:32.334018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a4974dd2-6921-4bf8-816d-8b5e6d896c1f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:32.336681 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a4974dd2-6921-4bf8-816d-8b5e6d896c1f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:32.682884 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.virt.hardware [None req-380803d5-1579-420d-b865-46e2f534474f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Flavor limits 0:0:0 {{(pid=117713) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:09:32.684302 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.virt.hardware [None req-380803d5-1579-420d-b865-46e2f534474f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Image limits 0:0:0 {{(pid=117713) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:09:32.689577 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.virt.hardware [None req-380803d5-1579-420d-b865-46e2f534474f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Flavor pref 0:0:0 {{(pid=117713) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:09:32.695663 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.virt.hardware [None req-380803d5-1579-420d-b865-46e2f534474f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Image pref 0:0:0 {{(pid=117713) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:09:32.695663 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.virt.hardware [None req-380803d5-1579-420d-b865-46e2f534474f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117713) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:09:32.702721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a4974dd2-6921-4bf8-816d-8b5e6d896c1f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:32.718465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a4974dd2-6921-4bf8-816d-8b5e6d896c1f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1321 microversion: 2.1 time: 0.400868 May 10 21:09:32.727651 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 33/67] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:32 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1321 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:32.740934 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-380803d5-1579-420d-b865-46e2f534474f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:32.741450 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-380803d5-1579-420d-b865-46e2f534474f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:32.742429 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-380803d5-1579-420d-b865-46e2f534474f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:32.744343 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-380803d5-1579-420d-b865-46e2f534474f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:32.809349 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.quota [None req-380803d5-1579-420d-b865-46e2f534474f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Getting quotas for project bd946455713e4c36a8efadbce486ee8b. Resources: {'instances', 'cores', 'ram'} {{(pid=117713) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:09:32.822338 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.quota [None req-380803d5-1579-420d-b865-46e2f534474f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Getting quotas for user dc411f6a0a024e7eac561ad1b6d2a944 and project bd946455713e4c36a8efadbce486ee8b. Resources: {'instances', 'cores', 'ram'} {{(pid=117713) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:09:32.863697 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-380803d5-1579-420d-b865-46e2f534474f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Going to run 1 instances... {{(pid=117713) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:09:32.875904 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-380803d5-1579-420d-b865-46e2f534474f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb321ccf-1ce7-4dda-90d0-f05332eb6fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117713) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:09:33.168932 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-380803d5-1579-420d-b865-46e2f534474f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.851704 May 10 21:09:33.170934 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 35/68] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 21:09:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 1855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 21:09:33.181323 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1ba6ae38-7392-40fc-83a6-797d3c3ea401 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:33.181975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1ba6ae38-7392-40fc-83a6-797d3c3ea401 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:33.227758 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-eb8ad4c0-0447-4c03-9997-fe39345da5fc tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:33.233156 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-eb8ad4c0-0447-4c03-9997-fe39345da5fc tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:33.243560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1ba6ae38-7392-40fc-83a6-797d3c3ea401 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:33.245689 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-eb8ad4c0-0447-4c03-9997-fe39345da5fc tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:33.246163 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-eb8ad4c0-0447-4c03-9997-fe39345da5fc tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:33.246914 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-eb8ad4c0-0447-4c03-9997-fe39345da5fc tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:33.247496 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-eb8ad4c0-0447-4c03-9997-fe39345da5fc tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:33.252613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1ba6ae38-7392-40fc-83a6-797d3c3ea401 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1238 microversion: 2.1 time: 0.075083 May 10 21:09:33.263853 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 34/69] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:33 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1238 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:33.337826 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-39d466d9-f22f-44f9-9889-72e1867b8c1c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:33.340372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-39d466d9-f22f-44f9-9889-72e1867b8c1c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:33.359847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39d466d9-f22f-44f9-9889-72e1867b8c1c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:33.360907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39d466d9-f22f-44f9-9889-72e1867b8c1c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:33.364103 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39d466d9-f22f-44f9-9889-72e1867b8c1c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:33.364739 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39d466d9-f22f-44f9-9889-72e1867b8c1c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:33.517995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-39d466d9-f22f-44f9-9889-72e1867b8c1c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:33.532575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-39d466d9-f22f-44f9-9889-72e1867b8c1c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:33.541058 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-39d466d9-f22f-44f9-9889-72e1867b8c1c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:33.546331 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-39d466d9-f22f-44f9-9889-72e1867b8c1c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1285 microversion: 2.20 time: 0.214209 May 10 21:09:33.556638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 35/70] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:09:33 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1285 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:09:33.597196 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-eb8ad4c0-0447-4c03-9997-fe39345da5fc tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:33.604962 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-eb8ad4c0-0447-4c03-9997-fe39345da5fc tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1315 microversion: 2.1 time: 0.382548 May 10 21:09:33.610196 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 36/71] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:33 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:33.614979 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-898d3540-d343-4c2a-8e35-2034ffaa775a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-190301620", "imageRef": "cb321ccf-1ce7-4dda-90d0-f05332eb6fe1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a67b65bc-d215-4b97-b229-e2132409a79d"}], "security_groups": [{"name": "tempest-securitygroup--2064554272"}], "key_name": "tempest-keypair-1097456563", "user_data": "}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:33.843519 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [req-fe328ca0-2ffa-4c40-9004-52f7b279f6ba req-56248939-3ccb-4efa-ac55-48867b6e49fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ef51171-183b-4712-b00c-f9612618e4d8", "name": "network-vif-plugged", "status": "completed", "tag": "a4b5b4f5-1566-4995-b222-14d74d8b3930"}]} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:33.852702 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-fe328ca0-2ffa-4c40-9004-52f7b279f6ba req-56248939-3ccb-4efa-ac55-48867b6e49fe service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:33.853632 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-fe328ca0-2ffa-4c40-9004-52f7b279f6ba req-56248939-3ccb-4efa-ac55-48867b6e49fe service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:33.871657 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.compute.server_external_events [req-fe328ca0-2ffa-4c40-9004-52f7b279f6ba req-56248939-3ccb-4efa-ac55-48867b6e49fe service nova] Creating event network-vif-plugged:a4b5b4f5-1566-4995-b222-14d74d8b3930 for instance 5ef51171-183b-4712-b00c-f9612618e4d8 on hv-cinder-82880 May 10 21:09:33.878088 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [req-fe328ca0-2ffa-4c40-9004-52f7b279f6ba req-56248939-3ccb-4efa-ac55-48867b6e49fe service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219595 May 10 21:09:33.878916 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 37/72] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:09:33.883868 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-2d123121-8262-4b0b-88fd-fc7734a9838a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:33.884572 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-2d123121-8262-4b0b-88fd-fc7734a9838a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:33.904485 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2d123121-8262-4b0b-88fd-fc7734a9838a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:33.905375 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2d123121-8262-4b0b-88fd-fc7734a9838a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:33.906312 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2d123121-8262-4b0b-88fd-fc7734a9838a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:33.906926 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2d123121-8262-4b0b-88fd-fc7734a9838a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:33.909645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.network.neutron [None req-898d3540-d343-4c2a-8e35-2034ffaa775a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] validate_networks() for [('a67b65bc-d215-4b97-b229-e2132409a79d', None, None, None, None, None)] {{(pid=117714) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:09:34.158357 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-2d123121-8262-4b0b-88fd-fc7734a9838a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:34.172123 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-2d123121-8262-4b0b-88fd-fc7734a9838a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1321 microversion: 2.1 time: 0.291763 May 10 21:09:34.173190 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 38/73] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:33 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:34.271215 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-47ad3693-d52d-41df-b087-5b6eafebf140 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:34.272050 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-47ad3693-d52d-41df-b087-5b6eafebf140 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:34.367405 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-47ad3693-d52d-41df-b087-5b6eafebf140 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:34.376374 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-47ad3693-d52d-41df-b087-5b6eafebf140 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1238 microversion: 2.1 time: 0.110163 May 10 21:09:34.390735 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 39/74] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:34 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1238 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:09:34.567156 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-34a49f96-9c59-4f86-a639-720a2e0ea093 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:34.568010 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-34a49f96-9c59-4f86-a639-720a2e0ea093 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:34.575200 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-34a49f96-9c59-4f86-a639-720a2e0ea093 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:34.576215 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-34a49f96-9c59-4f86-a639-720a2e0ea093 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:34.577056 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-34a49f96-9c59-4f86-a639-720a2e0ea093 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:34.577494 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-34a49f96-9c59-4f86-a639-720a2e0ea093 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:34.668344 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-34a49f96-9c59-4f86-a639-720a2e0ea093 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:34.680462 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-34a49f96-9c59-4f86-a639-720a2e0ea093 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:34.682498 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-34a49f96-9c59-4f86-a639-720a2e0ea093 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:34.684347 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-34a49f96-9c59-4f86-a639-720a2e0ea093 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1341 microversion: 2.20 time: 0.122920 May 10 21:09:34.686640 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 40/75] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:09:34 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1341 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:09:34.697809 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f6a9284c-272b-4268-b8cf-4c026dae738b tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:34.698583 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f6a9284c-272b-4268-b8cf-4c026dae738b tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:34.705411 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f6a9284c-272b-4268-b8cf-4c026dae738b tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:34.706068 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f6a9284c-272b-4268-b8cf-4c026dae738b tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:34.707613 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f6a9284c-272b-4268-b8cf-4c026dae738b tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:34.708419 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f6a9284c-272b-4268-b8cf-4c026dae738b tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:34.812537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-898d3540-d343-4c2a-8e35-2034ffaa775a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Flavor limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:09:34.813097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-898d3540-d343-4c2a-8e35-2034ffaa775a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Image limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:09:34.813418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-898d3540-d343-4c2a-8e35-2034ffaa775a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Flavor pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:09:34.813990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-898d3540-d343-4c2a-8e35-2034ffaa775a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Image pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:09:34.814548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-898d3540-d343-4c2a-8e35-2034ffaa775a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:09:34.829781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-898d3540-d343-4c2a-8e35-2034ffaa775a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:34.830240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-898d3540-d343-4c2a-8e35-2034ffaa775a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:34.831061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-898d3540-d343-4c2a-8e35-2034ffaa775a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:34.831530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-898d3540-d343-4c2a-8e35-2034ffaa775a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:34.871795 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-898d3540-d343-4c2a-8e35-2034ffaa775a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Getting quotas for project 9582743483fa4fb88f4e91d3f787c945. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:09:34.881965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-898d3540-d343-4c2a-8e35-2034ffaa775a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Getting quotas for user 62bc5605a22d408f9b4bac69a0f5f486 and project 9582743483fa4fb88f4e91d3f787c945. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:09:34.905818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-898d3540-d343-4c2a-8e35-2034ffaa775a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Going to run 1 instances... {{(pid=117714) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:09:34.908063 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-898d3540-d343-4c2a-8e35-2034ffaa775a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb321ccf-1ce7-4dda-90d0-f05332eb6fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117714) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:09:34.908653 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-f6a9284c-272b-4268-b8cf-4c026dae738b tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:34.919809 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f6a9284c-272b-4268-b8cf-4c026dae738b tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1315 microversion: 2.1 time: 0.231137 May 10 21:09:34.921849 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 41/76] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:34 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:35.137712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-898d3540-d343-4c2a-8e35-2034ffaa775a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.548231 May 10 21:09:35.154430 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-70fc6d11-5b9d-45a7-9b27-44c3e475ce1c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:35.155889 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-70fc6d11-5b9d-45a7-9b27-44c3e475ce1c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:35.164069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 36/77] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 21:09:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 1571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 21:09:35.198678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d7a56546-b8ff-4cef-b460-98cf81467c4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:35.198678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d7a56546-b8ff-4cef-b460-98cf81467c4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:35.209743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d7a56546-b8ff-4cef-b460-98cf81467c4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:35.210946 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d7a56546-b8ff-4cef-b460-98cf81467c4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:35.212017 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d7a56546-b8ff-4cef-b460-98cf81467c4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:35.212649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d7a56546-b8ff-4cef-b460-98cf81467c4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:35.269869 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-70fc6d11-5b9d-45a7-9b27-44c3e475ce1c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:35.277737 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-70fc6d11-5b9d-45a7-9b27-44c3e475ce1c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1241 microversion: 2.1 time: 0.128487 May 10 21:09:35.280822 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 42/78] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:35 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1241 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:09:35.393514 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-37ebc4d3-dc56-4e33-b10e-284a14992ed5 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:35.394502 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-37ebc4d3-dc56-4e33-b10e-284a14992ed5 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:35.404501 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-37ebc4d3-dc56-4e33-b10e-284a14992ed5 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:35.405035 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-37ebc4d3-dc56-4e33-b10e-284a14992ed5 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:35.405819 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-37ebc4d3-dc56-4e33-b10e-284a14992ed5 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:35.406313 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-37ebc4d3-dc56-4e33-b10e-284a14992ed5 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:35.471889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d7a56546-b8ff-4cef-b460-98cf81467c4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:35.479746 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d7a56546-b8ff-4cef-b460-98cf81467c4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1321 microversion: 2.1 time: 0.293733 May 10 21:09:35.483888 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 37/79] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:35 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1321 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:09:35.546781 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-37ebc4d3-dc56-4e33-b10e-284a14992ed5 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:35.547876 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-37ebc4d3-dc56-4e33-b10e-284a14992ed5 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1234 microversion: 2.1 time: 0.158258 May 10 21:09:35.548635 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 43/80] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:35 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1234 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:09:35.704765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4514897e-9663-4442-8427-7f91b766b521 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:35.705495 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4514897e-9663-4442-8427-7f91b766b521 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:35.716943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4514897e-9663-4442-8427-7f91b766b521 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:35.717737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4514897e-9663-4442-8427-7f91b766b521 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:35.718530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4514897e-9663-4442-8427-7f91b766b521 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:35.719088 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4514897e-9663-4442-8427-7f91b766b521 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:35.819282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4514897e-9663-4442-8427-7f91b766b521 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:35.831807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4514897e-9663-4442-8427-7f91b766b521 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:35.833516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4514897e-9663-4442-8427-7f91b766b521 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:35.838424 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4514897e-9663-4442-8427-7f91b766b521 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1339 microversion: 2.20 time: 0.138508 May 10 21:09:35.839535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 38/81] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:09:35 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1339 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:09:35.892788 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [req-6ea31c72-65c6-4f16-badb-54a605b65326 req-367fd15e-8ebd-4bd1-afe0-006c84f726d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee5480a-213a-489e-a366-5ffa59cf5487", "name": "network-vif-plugged", "status": "completed", "tag": "e1708824-bd48-4216-a98b-629b26d874f1"}]} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:35.900869 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-6ea31c72-65c6-4f16-badb-54a605b65326 req-367fd15e-8ebd-4bd1-afe0-006c84f726d1 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:35.901319 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-6ea31c72-65c6-4f16-badb-54a605b65326 req-367fd15e-8ebd-4bd1-afe0-006c84f726d1 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:35.922084 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.compute.server_external_events [req-6ea31c72-65c6-4f16-badb-54a605b65326 req-367fd15e-8ebd-4bd1-afe0-006c84f726d1 service nova] Creating event network-vif-plugged:e1708824-bd48-4216-a98b-629b26d874f1 for instance 2ee5480a-213a-489e-a366-5ffa59cf5487 on hv-cinder-82880 May 10 21:09:35.930643 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [req-6ea31c72-65c6-4f16-badb-54a605b65326 req-367fd15e-8ebd-4bd1-afe0-006c84f726d1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040768 May 10 21:09:35.932703 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 44/82] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:09:35.940475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6bda1f95-a49b-452f-82fd-a6aad6be074c tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:35.940475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6bda1f95-a49b-452f-82fd-a6aad6be074c tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:35.947061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6bda1f95-a49b-452f-82fd-a6aad6be074c tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:35.947989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6bda1f95-a49b-452f-82fd-a6aad6be074c tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:35.949187 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6bda1f95-a49b-452f-82fd-a6aad6be074c tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:35.949706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6bda1f95-a49b-452f-82fd-a6aad6be074c tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:36.198127 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6bda1f95-a49b-452f-82fd-a6aad6be074c tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:36.225622 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6bda1f95-a49b-452f-82fd-a6aad6be074c tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1315 microversion: 2.1 time: 0.291547 May 10 21:09:36.235509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 39/83] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:35 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:36.302475 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-816dfc7c-f52e-470c-ab40-b07090153ac9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:36.309892 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-816dfc7c-f52e-470c-ab40-b07090153ac9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:36.398602 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-816dfc7c-f52e-470c-ab40-b07090153ac9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:36.406533 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-816dfc7c-f52e-470c-ab40-b07090153ac9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1241 microversion: 2.1 time: 0.113272 May 10 21:09:36.407392 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 45/84] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:36 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1241 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:36.498893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-653bc553-d047-412d-bd95-dbf1971a7e41 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:36.499837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-653bc553-d047-412d-bd95-dbf1971a7e41 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:36.512648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-653bc553-d047-412d-bd95-dbf1971a7e41 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:36.512648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-653bc553-d047-412d-bd95-dbf1971a7e41 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:36.515864 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-653bc553-d047-412d-bd95-dbf1971a7e41 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:36.516428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-653bc553-d047-412d-bd95-dbf1971a7e41 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:36.565989 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-8e45ec96-d27f-4839-883a-0dd17e264145 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:36.566987 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-8e45ec96-d27f-4839-883a-0dd17e264145 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:36.573912 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8e45ec96-d27f-4839-883a-0dd17e264145 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:36.574373 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8e45ec96-d27f-4839-883a-0dd17e264145 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:36.575903 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8e45ec96-d27f-4839-883a-0dd17e264145 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:36.576552 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8e45ec96-d27f-4839-883a-0dd17e264145 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:36.726136 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-8e45ec96-d27f-4839-883a-0dd17e264145 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:36.737373 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-8e45ec96-d27f-4839-883a-0dd17e264145 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1298 microversion: 2.1 time: 0.175316 May 10 21:09:36.746565 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 46/85] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:36 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1298 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:09:36.857754 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-2f1cd831-24ad-4906-882e-032fcd7e0075 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:36.858738 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-2f1cd831-24ad-4906-882e-032fcd7e0075 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:36.868378 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2f1cd831-24ad-4906-882e-032fcd7e0075 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:36.870432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2f1cd831-24ad-4906-882e-032fcd7e0075 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:36.873125 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2f1cd831-24ad-4906-882e-032fcd7e0075 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:36.875180 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2f1cd831-24ad-4906-882e-032fcd7e0075 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:37.014055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-653bc553-d047-412d-bd95-dbf1971a7e41 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:37.023426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-653bc553-d047-412d-bd95-dbf1971a7e41 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1321 microversion: 2.1 time: 0.528735 May 10 21:09:37.032648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 40/86] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:36 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1321 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:37.118756 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-2f1cd831-24ad-4906-882e-032fcd7e0075 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:37.173253 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-2f1cd831-24ad-4906-882e-032fcd7e0075 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:37.173253 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-2f1cd831-24ad-4906-882e-032fcd7e0075 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:37.187106 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-2f1cd831-24ad-4906-882e-032fcd7e0075 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1407 microversion: 2.20 time: 0.334228 May 10 21:09:37.199221 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 47/87] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:09:36 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1407 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:09:37.244027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9a7d0aa0-0634-4b93-952d-53a58f89bb5d tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:37.244927 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9a7d0aa0-0634-4b93-952d-53a58f89bb5d tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:37.255152 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9a7d0aa0-0634-4b93-952d-53a58f89bb5d tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:37.255598 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9a7d0aa0-0634-4b93-952d-53a58f89bb5d tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:37.260839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9a7d0aa0-0634-4b93-952d-53a58f89bb5d tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:37.265892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9a7d0aa0-0634-4b93-952d-53a58f89bb5d tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:37.426042 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e7ca5c42-ee44-4d7b-9293-b7d3cef83ed6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:37.427839 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e7ca5c42-ee44-4d7b-9293-b7d3cef83ed6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:37.447999 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e7ca5c42-ee44-4d7b-9293-b7d3cef83ed6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:37.448643 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e7ca5c42-ee44-4d7b-9293-b7d3cef83ed6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:37.450033 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e7ca5c42-ee44-4d7b-9293-b7d3cef83ed6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:37.450751 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e7ca5c42-ee44-4d7b-9293-b7d3cef83ed6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:37.583297 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-e7ca5c42-ee44-4d7b-9293-b7d3cef83ed6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:37.617355 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e7ca5c42-ee44-4d7b-9293-b7d3cef83ed6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1237 microversion: 2.1 time: 0.196781 May 10 21:09:37.618014 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 48/88] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:37 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1237 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:37.642898 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9a7d0aa0-0634-4b93-952d-53a58f89bb5d tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:37.650502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9a7d0aa0-0634-4b93-952d-53a58f89bb5d tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1315 microversion: 2.1 time: 0.411127 May 10 21:09:37.651061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 41/89] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:37 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:37.754240 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-0776dd69-ddfb-48a1-a258-55d7525f9a54 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:37.755770 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-0776dd69-ddfb-48a1-a258-55d7525f9a54 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:37.769579 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0776dd69-ddfb-48a1-a258-55d7525f9a54 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:37.773692 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0776dd69-ddfb-48a1-a258-55d7525f9a54 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:37.774530 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0776dd69-ddfb-48a1-a258-55d7525f9a54 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:37.774984 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0776dd69-ddfb-48a1-a258-55d7525f9a54 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:37.846560 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-0776dd69-ddfb-48a1-a258-55d7525f9a54 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:37.854666 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-0776dd69-ddfb-48a1-a258-55d7525f9a54 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1296 microversion: 2.1 time: 0.104320 May 10 21:09:37.855458 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 49/90] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:37 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1296 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:37.967924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-c81322b9-fea7-4d77-83d6-6514122b22e6 req-f9bb3d91-4e54-4192-9b78-142fa61da825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87", "name": "network-vif-plugged", "status": "completed", "tag": "40e484fd-855a-4680-a2ef-45c93b616ec9"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:37.978554 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-c81322b9-fea7-4d77-83d6-6514122b22e6 req-f9bb3d91-4e54-4192-9b78-142fa61da825 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:37.984062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-c81322b9-fea7-4d77-83d6-6514122b22e6 req-f9bb3d91-4e54-4192-9b78-142fa61da825 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:37.996581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-c81322b9-fea7-4d77-83d6-6514122b22e6 req-f9bb3d91-4e54-4192-9b78-142fa61da825 service nova] Creating event network-vif-plugged:40e484fd-855a-4680-a2ef-45c93b616ec9 for instance cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 on hv-cinder-82880 May 10 21:09:38.003988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-c81322b9-fea7-4d77-83d6-6514122b22e6 req-f9bb3d91-4e54-4192-9b78-142fa61da825 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042668 May 10 21:09:38.004902 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 42/91] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:09:38.056813 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-4ff23d63-053d-48e9-b672-6ae16024b35a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:38.056813 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-4ff23d63-053d-48e9-b672-6ae16024b35a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:38.065400 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4ff23d63-053d-48e9-b672-6ae16024b35a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:38.065939 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4ff23d63-053d-48e9-b672-6ae16024b35a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:38.066753 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4ff23d63-053d-48e9-b672-6ae16024b35a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:38.067221 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4ff23d63-053d-48e9-b672-6ae16024b35a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:38.114921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-11ba71dc-33e8-4e5c-b1ff-299f52738572 req-c03db77c-8d25-4c05-bc03-54e7e66630a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "688d836a-358b-4815-80e9-f43bd14f5f93", "tag": "8d78546f-3c5c-4f44-9d56-4eb5e6c1e96f"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:38.135361 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-11ba71dc-33e8-4e5c-b1ff-299f52738572 req-c03db77c-8d25-4c05-bc03-54e7e66630a2 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:38.136036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-11ba71dc-33e8-4e5c-b1ff-299f52738572 req-c03db77c-8d25-4c05-bc03-54e7e66630a2 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:38.154039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-11ba71dc-33e8-4e5c-b1ff-299f52738572 req-c03db77c-8d25-4c05-bc03-54e7e66630a2 service nova] Creating event network-changed:8d78546f-3c5c-4f44-9d56-4eb5e6c1e96f for instance 688d836a-358b-4815-80e9-f43bd14f5f93 on hv-cinder-82880 May 10 21:09:38.159159 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-11ba71dc-33e8-4e5c-b1ff-299f52738572 req-c03db77c-8d25-4c05-bc03-54e7e66630a2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048282 May 10 21:09:38.160294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 43/92] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:09:38.208715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-21065322-2886-4407-8b9e-9bc61e5e7787 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:38.213505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-21065322-2886-4407-8b9e-9bc61e5e7787 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:38.222885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21065322-2886-4407-8b9e-9bc61e5e7787 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:38.223374 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21065322-2886-4407-8b9e-9bc61e5e7787 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:38.224157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21065322-2886-4407-8b9e-9bc61e5e7787 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:38.224596 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21065322-2886-4407-8b9e-9bc61e5e7787 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:38.296555 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-4ff23d63-053d-48e9-b672-6ae16024b35a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:38.321241 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-4ff23d63-053d-48e9-b672-6ae16024b35a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1321 microversion: 2.1 time: 0.280689 May 10 21:09:38.321831 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 50/93] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:38 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:38.446296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-21065322-2886-4407-8b9e-9bc61e5e7787 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:38.460877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-21065322-2886-4407-8b9e-9bc61e5e7787 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:38.462717 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-21065322-2886-4407-8b9e-9bc61e5e7787 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:38.464093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-21065322-2886-4407-8b9e-9bc61e5e7787 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1407 microversion: 2.20 time: 0.261969 May 10 21:09:38.465225 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 44/94] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:09:38 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:09:38.640496 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6867330f-dd80-45d5-af62-2ab9bb2ef72d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:38.641286 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6867330f-dd80-45d5-af62-2ab9bb2ef72d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:38.647764 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6867330f-dd80-45d5-af62-2ab9bb2ef72d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:38.648291 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6867330f-dd80-45d5-af62-2ab9bb2ef72d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:38.649117 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6867330f-dd80-45d5-af62-2ab9bb2ef72d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:38.649553 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6867330f-dd80-45d5-af62-2ab9bb2ef72d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:38.669263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-325c1908-bb41-4048-b265-7f5fccc503eb tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:38.670100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-325c1908-bb41-4048-b265-7f5fccc503eb tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:38.676144 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-325c1908-bb41-4048-b265-7f5fccc503eb tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:38.676764 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-325c1908-bb41-4048-b265-7f5fccc503eb tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:38.677698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-325c1908-bb41-4048-b265-7f5fccc503eb tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:38.678285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-325c1908-bb41-4048-b265-7f5fccc503eb tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:38.753566 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-6867330f-dd80-45d5-af62-2ab9bb2ef72d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:38.767507 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6867330f-dd80-45d5-af62-2ab9bb2ef72d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1301 microversion: 2.1 time: 0.131409 May 10 21:09:38.769827 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 51/95] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:38 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1301 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:38.873228 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f1fa9982-32ec-4672-92a1-c208b01221ef tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:38.874191 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f1fa9982-32ec-4672-92a1-c208b01221ef tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:38.895275 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f1fa9982-32ec-4672-92a1-c208b01221ef tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:38.899752 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f1fa9982-32ec-4672-92a1-c208b01221ef tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:38.902756 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f1fa9982-32ec-4672-92a1-c208b01221ef tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:38.905031 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f1fa9982-32ec-4672-92a1-c208b01221ef tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:39.066822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-325c1908-bb41-4048-b265-7f5fccc503eb tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:39.075619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-325c1908-bb41-4048-b265-7f5fccc503eb tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1503 microversion: 2.1 time: 0.410191 May 10 21:09:39.077659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 45/96] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:38 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1503 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:39.253718 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-f1fa9982-32ec-4672-92a1-c208b01221ef tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:39.268107 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f1fa9982-32ec-4672-92a1-c208b01221ef tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1363 microversion: 2.1 time: 0.398879 May 10 21:09:39.268646 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 52/97] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:38 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1363 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:39.338206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d29abca2-4728-4084-bf07-3fde5628e9b9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:39.338911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d29abca2-4728-4084-bf07-3fde5628e9b9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:39.353466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d29abca2-4728-4084-bf07-3fde5628e9b9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:39.355598 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d29abca2-4728-4084-bf07-3fde5628e9b9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:39.359093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d29abca2-4728-4084-bf07-3fde5628e9b9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:39.359739 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d29abca2-4728-4084-bf07-3fde5628e9b9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:39.483458 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f3e76356-de31-4418-981a-2e11ad8b7a81 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:39.484073 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f3e76356-de31-4418-981a-2e11ad8b7a81 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:39.493316 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f3e76356-de31-4418-981a-2e11ad8b7a81 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:39.493316 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f3e76356-de31-4418-981a-2e11ad8b7a81 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:39.493316 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f3e76356-de31-4418-981a-2e11ad8b7a81 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:39.493667 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f3e76356-de31-4418-981a-2e11ad8b7a81 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:39.654666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d29abca2-4728-4084-bf07-3fde5628e9b9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:39.665127 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d29abca2-4728-4084-bf07-3fde5628e9b9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1321 microversion: 2.1 time: 0.330631 May 10 21:09:39.668190 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 46/98] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:39 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1321 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:39.717383 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-f3e76356-de31-4418-981a-2e11ad8b7a81 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:39.725166 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-f3e76356-de31-4418-981a-2e11ad8b7a81 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:39.726663 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-f3e76356-de31-4418-981a-2e11ad8b7a81 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:39.727801 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f3e76356-de31-4418-981a-2e11ad8b7a81 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1407 microversion: 2.20 time: 0.249079 May 10 21:09:39.728444 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 53/99] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:09:39 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:09:39.787304 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-be2e90e0-7461-466e-a72c-c9a4afbeb21b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:39.788187 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-be2e90e0-7461-466e-a72c-c9a4afbeb21b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:39.800183 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be2e90e0-7461-466e-a72c-c9a4afbeb21b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:39.800648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be2e90e0-7461-466e-a72c-c9a4afbeb21b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:39.802730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be2e90e0-7461-466e-a72c-c9a4afbeb21b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:39.803196 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be2e90e0-7461-466e-a72c-c9a4afbeb21b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:39.911904 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-be2e90e0-7461-466e-a72c-c9a4afbeb21b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:39.925617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-be2e90e0-7461-466e-a72c-c9a4afbeb21b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1299 microversion: 2.1 time: 0.143105 May 10 21:09:39.926962 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 47/100] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:39 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1299 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:40.196584 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [req-2cc6743c-895e-4d18-8b4d-d24149f4a419 req-6e906d06-444d-429d-99c3-703d34281d06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "504464a5-03e5-42af-a2f3-ca210277d932", "tag": "c1351ad9-3f5d-4556-bf2a-38dd3150e8b1"}]} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:40.221972 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-2cc6743c-895e-4d18-8b4d-d24149f4a419 req-6e906d06-444d-429d-99c3-703d34281d06 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:40.222422 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-2cc6743c-895e-4d18-8b4d-d24149f4a419 req-6e906d06-444d-429d-99c3-703d34281d06 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:40.238026 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.compute.server_external_events [req-2cc6743c-895e-4d18-8b4d-d24149f4a419 req-6e906d06-444d-429d-99c3-703d34281d06 service nova] Creating event network-changed:c1351ad9-3f5d-4556-bf2a-38dd3150e8b1 for instance 504464a5-03e5-42af-a2f3-ca210277d932 on hv-cinder-82880 May 10 21:09:40.243184 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [req-2cc6743c-895e-4d18-8b4d-d24149f4a419 req-6e906d06-444d-429d-99c3-703d34281d06 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049870 May 10 21:09:40.244241 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 54/101] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:09:40.295782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c6e5c35d-6f1d-40cb-a5d3-3a8cdc01fabd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:40.295782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c6e5c35d-6f1d-40cb-a5d3-3a8cdc01fabd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:40.312850 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c6e5c35d-6f1d-40cb-a5d3-3a8cdc01fabd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:40.313628 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c6e5c35d-6f1d-40cb-a5d3-3a8cdc01fabd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:40.319198 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c6e5c35d-6f1d-40cb-a5d3-3a8cdc01fabd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:40.319657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c6e5c35d-6f1d-40cb-a5d3-3a8cdc01fabd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:40.484386 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c6e5c35d-6f1d-40cb-a5d3-3a8cdc01fabd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:40.491990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c6e5c35d-6f1d-40cb-a5d3-3a8cdc01fabd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1363 microversion: 2.1 time: 0.210328 May 10 21:09:40.492657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 48/102] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:40 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:40.684544 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-0b4e024a-f498-4fec-8bbd-0a77b06a5e93 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:40.686172 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-0b4e024a-f498-4fec-8bbd-0a77b06a5e93 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:40.692591 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0b4e024a-f498-4fec-8bbd-0a77b06a5e93 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:40.693043 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0b4e024a-f498-4fec-8bbd-0a77b06a5e93 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:40.693811 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0b4e024a-f498-4fec-8bbd-0a77b06a5e93 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:40.694241 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0b4e024a-f498-4fec-8bbd-0a77b06a5e93 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:40.745945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-25b3f8ee-4b9d-43fa-97f1-cdc11f6f4c03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:40.746798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-25b3f8ee-4b9d-43fa-97f1-cdc11f6f4c03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:40.755418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-25b3f8ee-4b9d-43fa-97f1-cdc11f6f4c03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:40.756117 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-25b3f8ee-4b9d-43fa-97f1-cdc11f6f4c03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:40.757061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-25b3f8ee-4b9d-43fa-97f1-cdc11f6f4c03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:40.757652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-25b3f8ee-4b9d-43fa-97f1-cdc11f6f4c03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:40.836272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-0b4e024a-f498-4fec-8bbd-0a77b06a5e93 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:40.845147 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-0b4e024a-f498-4fec-8bbd-0a77b06a5e93 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1321 microversion: 2.1 time: 0.164860 May 10 21:09:40.846186 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 55/103] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:40 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:40.905304 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-25b3f8ee-4b9d-43fa-97f1-cdc11f6f4c03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:40.913088 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-25b3f8ee-4b9d-43fa-97f1-cdc11f6f4c03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:40.914653 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-25b3f8ee-4b9d-43fa-97f1-cdc11f6f4c03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:40.915783 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-25b3f8ee-4b9d-43fa-97f1-cdc11f6f4c03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1407 microversion: 2.20 time: 0.173837 May 10 21:09:40.916359 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 49/104] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:09:40 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:09:40.944628 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-37eb5f10-f45c-4a87-adef-d413d8a4e682 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:40.945289 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-37eb5f10-f45c-4a87-adef-d413d8a4e682 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:40.952048 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-37eb5f10-f45c-4a87-adef-d413d8a4e682 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:40.952539 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-37eb5f10-f45c-4a87-adef-d413d8a4e682 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:40.953313 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-37eb5f10-f45c-4a87-adef-d413d8a4e682 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:40.953755 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-37eb5f10-f45c-4a87-adef-d413d8a4e682 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:41.082255 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-37eb5f10-f45c-4a87-adef-d413d8a4e682 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:41.089869 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-37eb5f10-f45c-4a87-adef-d413d8a4e682 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1367 microversion: 2.1 time: 0.149035 May 10 21:09:41.090440 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 56/105] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:40 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:41.509763 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-02a735ff-efbf-478c-bb73-109bd6ab57b0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:41.510379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-02a735ff-efbf-478c-bb73-109bd6ab57b0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:41.517293 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-02a735ff-efbf-478c-bb73-109bd6ab57b0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:41.517749 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-02a735ff-efbf-478c-bb73-109bd6ab57b0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:41.518526 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-02a735ff-efbf-478c-bb73-109bd6ab57b0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:41.518967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-02a735ff-efbf-478c-bb73-109bd6ab57b0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:41.653215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-02a735ff-efbf-478c-bb73-109bd6ab57b0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:41.661186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-02a735ff-efbf-478c-bb73-109bd6ab57b0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1363 microversion: 2.1 time: 0.155328 May 10 21:09:41.661799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 50/106] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:41 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:41.861786 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-3de90a55-db65-4609-96dc-29acfbd2ece0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:41.862486 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-3de90a55-db65-4609-96dc-29acfbd2ece0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:41.868670 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3de90a55-db65-4609-96dc-29acfbd2ece0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:41.869129 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3de90a55-db65-4609-96dc-29acfbd2ece0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:41.870086 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3de90a55-db65-4609-96dc-29acfbd2ece0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:41.870520 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3de90a55-db65-4609-96dc-29acfbd2ece0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:41.933773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e15d3050-1ed1-4707-9b9a-46d8f2d56218 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:41.935505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e15d3050-1ed1-4707-9b9a-46d8f2d56218 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:41.942079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e15d3050-1ed1-4707-9b9a-46d8f2d56218 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:41.942609 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e15d3050-1ed1-4707-9b9a-46d8f2d56218 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:41.943510 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e15d3050-1ed1-4707-9b9a-46d8f2d56218 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:41.944024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e15d3050-1ed1-4707-9b9a-46d8f2d56218 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:42.021901 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-3de90a55-db65-4609-96dc-29acfbd2ece0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:42.031034 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-3de90a55-db65-4609-96dc-29acfbd2ece0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1321 microversion: 2.1 time: 0.173105 May 10 21:09:42.031637 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 57/107] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:41 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:42.077286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e15d3050-1ed1-4707-9b9a-46d8f2d56218 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:42.085332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e15d3050-1ed1-4707-9b9a-46d8f2d56218 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:42.086830 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e15d3050-1ed1-4707-9b9a-46d8f2d56218 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:42.087956 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e15d3050-1ed1-4707-9b9a-46d8f2d56218 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1407 microversion: 2.20 time: 0.158121 May 10 21:09:42.088512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 51/108] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:09:41 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:09:42.107029 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-527f6fd6-1f83-4ea1-ac3b-4e22c2022865 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:42.107677 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-527f6fd6-1f83-4ea1-ac3b-4e22c2022865 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:42.114009 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-527f6fd6-1f83-4ea1-ac3b-4e22c2022865 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:42.114622 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-527f6fd6-1f83-4ea1-ac3b-4e22c2022865 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:42.115332 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-527f6fd6-1f83-4ea1-ac3b-4e22c2022865 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:42.115768 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-527f6fd6-1f83-4ea1-ac3b-4e22c2022865 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:42.252040 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-527f6fd6-1f83-4ea1-ac3b-4e22c2022865 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:42.261741 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-527f6fd6-1f83-4ea1-ac3b-4e22c2022865 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1367 microversion: 2.1 time: 0.158705 May 10 21:09:42.262320 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 58/109] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:42 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:42.776858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d6bbd333-b71d-4dc4-94d1-e91a67c48a3a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:42.776858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d6bbd333-b71d-4dc4-94d1-e91a67c48a3a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:42.776858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6bbd333-b71d-4dc4-94d1-e91a67c48a3a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:42.776858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6bbd333-b71d-4dc4-94d1-e91a67c48a3a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:42.778144 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6bbd333-b71d-4dc4-94d1-e91a67c48a3a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:42.778144 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6bbd333-b71d-4dc4-94d1-e91a67c48a3a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:42.833229 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d6bbd333-b71d-4dc4-94d1-e91a67c48a3a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:42.840555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d6bbd333-b71d-4dc4-94d1-e91a67c48a3a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1363 microversion: 2.1 time: 0.166570 May 10 21:09:42.841738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 52/110] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:42 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:43.054687 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-654f91fa-d1ad-4e06-b46d-7aae69ec2c2d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:43.055423 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-654f91fa-d1ad-4e06-b46d-7aae69ec2c2d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:43.062395 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-654f91fa-d1ad-4e06-b46d-7aae69ec2c2d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:43.062925 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-654f91fa-d1ad-4e06-b46d-7aae69ec2c2d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:43.063956 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-654f91fa-d1ad-4e06-b46d-7aae69ec2c2d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:43.064637 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-654f91fa-d1ad-4e06-b46d-7aae69ec2c2d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:43.106395 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6530e2cb-313d-4c38-a7fe-5731881922ee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:43.108298 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6530e2cb-313d-4c38-a7fe-5731881922ee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:43.114824 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6530e2cb-313d-4c38-a7fe-5731881922ee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:43.115358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6530e2cb-313d-4c38-a7fe-5731881922ee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:43.116093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6530e2cb-313d-4c38-a7fe-5731881922ee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:43.116528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6530e2cb-313d-4c38-a7fe-5731881922ee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:43.272590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6530e2cb-313d-4c38-a7fe-5731881922ee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:43.283345 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6530e2cb-313d-4c38-a7fe-5731881922ee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:43.284855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6530e2cb-313d-4c38-a7fe-5731881922ee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:43.285994 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6530e2cb-313d-4c38-a7fe-5731881922ee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1407 microversion: 2.20 time: 0.183473 May 10 21:09:43.286620 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 53/111] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:09:43 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:09:43.291182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-888f7ec1-7971-4bbf-a969-dd3370fb9305 req-6c471d5e-222a-4bf0-8465-71e4a1d5797d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b28c992-788d-4e37-b194-aaf2fb61577b", "tag": "f92cd78e-033b-4a35-8495-6a1fd5b8ba63"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:43.300871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-888f7ec1-7971-4bbf-a969-dd3370fb9305 req-6c471d5e-222a-4bf0-8465-71e4a1d5797d service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:43.301583 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-888f7ec1-7971-4bbf-a969-dd3370fb9305 req-6c471d5e-222a-4bf0-8465-71e4a1d5797d service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:43.314685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-888f7ec1-7971-4bbf-a969-dd3370fb9305 req-6c471d5e-222a-4bf0-8465-71e4a1d5797d service nova] Creating event network-changed:f92cd78e-033b-4a35-8495-6a1fd5b8ba63 for instance 4b28c992-788d-4e37-b194-aaf2fb61577b on hv-cinder-82880 May 10 21:09:43.319971 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-888f7ec1-7971-4bbf-a969-dd3370fb9305 req-6c471d5e-222a-4bf0-8465-71e4a1d5797d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032253 May 10 21:09:43.320584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 54/112] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:09:43.324691 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-654f91fa-d1ad-4e06-b46d-7aae69ec2c2d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:43.327155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ae0a4e87-b55b-4cdd-b92b-1990326585df tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56ee5f1a-d7d8-41f6-b707-2bee3b7482bc"}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:43.328828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ae0a4e87-b55b-4cdd-b92b-1990326585df tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:43.334271 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-654f91fa-d1ad-4e06-b46d-7aae69ec2c2d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1321 microversion: 2.1 time: 0.290346 May 10 21:09:43.335154 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 59/113] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:43 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:43.336170 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae0a4e87-b55b-4cdd-b92b-1990326585df tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:43.336619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae0a4e87-b55b-4cdd-b92b-1990326585df tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:43.337567 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae0a4e87-b55b-4cdd-b92b-1990326585df tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:43.338008 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae0a4e87-b55b-4cdd-b92b-1990326585df tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:43.340846 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-7a2351cd-8ec8-4a6d-bc20-3f1da967ac6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:43.343079 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-7a2351cd-8ec8-4a6d-bc20-3f1da967ac6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:43.364483 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7a2351cd-8ec8-4a6d-bc20-3f1da967ac6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:43.364943 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7a2351cd-8ec8-4a6d-bc20-3f1da967ac6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:43.365737 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7a2351cd-8ec8-4a6d-bc20-3f1da967ac6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:43.366180 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7a2351cd-8ec8-4a6d-bc20-3f1da967ac6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:43.705895 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-7a2351cd-8ec8-4a6d-bc20-3f1da967ac6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:43.719657 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-7a2351cd-8ec8-4a6d-bc20-3f1da967ac6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1367 microversion: 2.1 time: 0.382132 May 10 21:09:43.720674 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 60/114] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:43 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1367 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:43.861560 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-41e5f7e0-ab3a-4152-89e9-9516409c4a52 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:43.861560 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-41e5f7e0-ab3a-4152-89e9-9516409c4a52 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:43.873718 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-41e5f7e0-ab3a-4152-89e9-9516409c4a52 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:43.875045 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-41e5f7e0-ab3a-4152-89e9-9516409c4a52 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:43.876066 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-41e5f7e0-ab3a-4152-89e9-9516409c4a52 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:43.876665 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-41e5f7e0-ab3a-4152-89e9-9516409c4a52 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:44.162980 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-41e5f7e0-ab3a-4152-89e9-9516409c4a52 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:44.167363 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-41e5f7e0-ab3a-4152-89e9-9516409c4a52 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1363 microversion: 2.1 time: 0.312921 May 10 21:09:44.168597 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 61/115] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:43 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1363 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:09:44.306057 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f24256d7-7f56-4884-bdd8-edf723b035bf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:44.306965 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f24256d7-7f56-4884-bdd8-edf723b035bf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:44.335636 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f24256d7-7f56-4884-bdd8-edf723b035bf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:44.336940 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f24256d7-7f56-4884-bdd8-edf723b035bf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:44.337674 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f24256d7-7f56-4884-bdd8-edf723b035bf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:44.340830 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f24256d7-7f56-4884-bdd8-edf723b035bf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:44.646744 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-f24256d7-7f56-4884-bdd8-edf723b035bf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:44.656142 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-f24256d7-7f56-4884-bdd8-edf723b035bf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:44.658135 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-f24256d7-7f56-4884-bdd8-edf723b035bf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:44.659995 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f24256d7-7f56-4884-bdd8-edf723b035bf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1407 microversion: 2.20 time: 0.358690 May 10 21:09:44.660818 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 62/116] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:09:44 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1407 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:09:44.675791 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-8fde2012-3d40-416e-b5f2-e69818a476b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:44.676437 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-8fde2012-3d40-416e-b5f2-e69818a476b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:44.682593 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8fde2012-3d40-416e-b5f2-e69818a476b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:44.683583 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8fde2012-3d40-416e-b5f2-e69818a476b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:44.684371 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8fde2012-3d40-416e-b5f2-e69818a476b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:44.685013 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8fde2012-3d40-416e-b5f2-e69818a476b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:44.836373 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-8fde2012-3d40-416e-b5f2-e69818a476b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:44.844707 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-8fde2012-3d40-416e-b5f2-e69818a476b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1516 microversion: 2.1 time: 0.182693 May 10 21:09:44.845282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 63/117] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:44 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:44.850540 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-7b4a1cca-b829-4941-9d75-a51f6a2dc2f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:44.851384 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-7b4a1cca-b829-4941-9d75-a51f6a2dc2f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:44.858595 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7b4a1cca-b829-4941-9d75-a51f6a2dc2f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:44.859628 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7b4a1cca-b829-4941-9d75-a51f6a2dc2f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:44.860472 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7b4a1cca-b829-4941-9d75-a51f6a2dc2f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:44.860860 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7b4a1cca-b829-4941-9d75-a51f6a2dc2f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:44.998228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ae0a4e87-b55b-4cdd-b92b-1990326585df tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "POST /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.675211 May 10 21:09:45.000172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 55/118] 10.222.0.49 () {60 vars in 1322 bytes} [Tue May 10 21:09:43 2022] POST /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8/os-volume_attachments => generated 194 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:09:45.013711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6d85f4a2-9cd3-4b33-8277-04ab2af50645 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:45.014833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6d85f4a2-9cd3-4b33-8277-04ab2af50645 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:45.022062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6d85f4a2-9cd3-4b33-8277-04ab2af50645 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:45.022530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6d85f4a2-9cd3-4b33-8277-04ab2af50645 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:45.023388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6d85f4a2-9cd3-4b33-8277-04ab2af50645 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:45.027476 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6d85f4a2-9cd3-4b33-8277-04ab2af50645 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:45.049659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.objects.instance [None req-6d85f4a2-9cd3-4b33-8277-04ab2af50645 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lazy-loading 'flavor' on Instance uuid cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 {{(pid=117714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:09:45.223078 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-7b4a1cca-b829-4941-9d75-a51f6a2dc2f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:45.232171 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-7b4a1cca-b829-4941-9d75-a51f6a2dc2f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1367 microversion: 2.1 time: 0.384647 May 10 21:09:45.232990 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 64/119] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:44 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1367 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:45.237859 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9d124eee-88d4-49e7-a13f-ccc08da99c33 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:45.238528 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-9d124eee-88d4-49e7-a13f-ccc08da99c33 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:45.245201 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9d124eee-88d4-49e7-a13f-ccc08da99c33 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:45.245653 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9d124eee-88d4-49e7-a13f-ccc08da99c33 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:45.246425 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9d124eee-88d4-49e7-a13f-ccc08da99c33 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:45.246897 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9d124eee-88d4-49e7-a13f-ccc08da99c33 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:45.391708 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6d85f4a2-9cd3-4b33-8277-04ab2af50645 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "POST /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87/action" status: 200 len: 32 microversion: 2.1 time: 0.385758 May 10 21:09:45.392336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 56/120] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 21:09:44 2022] POST /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87/action => generated 32 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 21:09:45.393037 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-9d124eee-88d4-49e7-a13f-ccc08da99c33 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:45.401135 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9d124eee-88d4-49e7-a13f-ccc08da99c33 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1363 microversion: 2.1 time: 0.166992 May 10 21:09:45.401700 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 65/121] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:45 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:45.401827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-79a6d1d1-469b-4c32-89a2-be0bf07264f8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:45.402584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-79a6d1d1-469b-4c32-89a2-be0bf07264f8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:45.410038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-79a6d1d1-469b-4c32-89a2-be0bf07264f8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:45.410498 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-79a6d1d1-469b-4c32-89a2-be0bf07264f8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:45.411358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-79a6d1d1-469b-4c32-89a2-be0bf07264f8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:45.411930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-79a6d1d1-469b-4c32-89a2-be0bf07264f8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:45.571325 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-79a6d1d1-469b-4c32-89a2-be0bf07264f8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:45.578897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-79a6d1d1-469b-4c32-89a2-be0bf07264f8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.181237 May 10 21:09:45.579516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 57/122] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:45 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:09:45.677780 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f33f2616-00fc-4a57-8bb9-463e7fb596d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:45.679604 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f33f2616-00fc-4a57-8bb9-463e7fb596d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:45.684601 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f33f2616-00fc-4a57-8bb9-463e7fb596d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:45.685092 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f33f2616-00fc-4a57-8bb9-463e7fb596d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:45.686209 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f33f2616-00fc-4a57-8bb9-463e7fb596d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:45.686643 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f33f2616-00fc-4a57-8bb9-463e7fb596d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:45.863340 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-f33f2616-00fc-4a57-8bb9-463e7fb596d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:45.871673 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-f33f2616-00fc-4a57-8bb9-463e7fb596d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:45.874166 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-f33f2616-00fc-4a57-8bb9-463e7fb596d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:45.875330 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f33f2616-00fc-4a57-8bb9-463e7fb596d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1407 microversion: 2.20 time: 0.201444 May 10 21:09:45.875895 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 66/123] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:09:45 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:09:46.250640 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-61fba195-830b-404e-baea-6a9556a22377 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:46.252301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-61fba195-830b-404e-baea-6a9556a22377 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:46.260722 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-61fba195-830b-404e-baea-6a9556a22377 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:46.263321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-61fba195-830b-404e-baea-6a9556a22377 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:46.263321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-61fba195-830b-404e-baea-6a9556a22377 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:46.263321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-61fba195-830b-404e-baea-6a9556a22377 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:46.418800 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-4f55e2bf-2277-4a0e-b80e-4ab8614afddd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:46.420600 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-4f55e2bf-2277-4a0e-b80e-4ab8614afddd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:46.429728 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4f55e2bf-2277-4a0e-b80e-4ab8614afddd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:46.430667 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4f55e2bf-2277-4a0e-b80e-4ab8614afddd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:46.433697 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4f55e2bf-2277-4a0e-b80e-4ab8614afddd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:46.433697 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4f55e2bf-2277-4a0e-b80e-4ab8614afddd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:46.433979 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-61fba195-830b-404e-baea-6a9556a22377 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:46.441532 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-61fba195-830b-404e-baea-6a9556a22377 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1367 microversion: 2.1 time: 0.196008 May 10 21:09:46.442111 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 58/124] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:46 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:46.581929 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-4f55e2bf-2277-4a0e-b80e-4ab8614afddd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:46.592481 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-4f55e2bf-2277-4a0e-b80e-4ab8614afddd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1363 microversion: 2.1 time: 0.177909 May 10 21:09:46.593286 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 67/125] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:46 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:46.597454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-05cbe9b3-f59f-404c-94d6-1aff1b1943e1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:46.598628 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-05cbe9b3-f59f-404c-94d6-1aff1b1943e1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:46.615929 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-05cbe9b3-f59f-404c-94d6-1aff1b1943e1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:46.616843 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-05cbe9b3-f59f-404c-94d6-1aff1b1943e1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:46.617621 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-05cbe9b3-f59f-404c-94d6-1aff1b1943e1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:46.618055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-05cbe9b3-f59f-404c-94d6-1aff1b1943e1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:46.749678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-05cbe9b3-f59f-404c-94d6-1aff1b1943e1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:46.757281 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-05cbe9b3-f59f-404c-94d6-1aff1b1943e1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.166177 May 10 21:09:46.757773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 59/126] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:46 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:46.895457 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-fcaae551-6d66-4123-851c-ea14027a3a36 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:46.896266 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-fcaae551-6d66-4123-851c-ea14027a3a36 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:46.906237 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fcaae551-6d66-4123-851c-ea14027a3a36 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:46.907414 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fcaae551-6d66-4123-851c-ea14027a3a36 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:46.908400 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fcaae551-6d66-4123-851c-ea14027a3a36 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:46.910385 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fcaae551-6d66-4123-851c-ea14027a3a36 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:47.050359 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-fcaae551-6d66-4123-851c-ea14027a3a36 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:47.058238 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-fcaae551-6d66-4123-851c-ea14027a3a36 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:47.065072 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-fcaae551-6d66-4123-851c-ea14027a3a36 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:47.065072 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-fcaae551-6d66-4123-851c-ea14027a3a36 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1407 microversion: 2.20 time: 0.172276 May 10 21:09:47.065072 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 68/127] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:09:46 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:09:47.459890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f600947b-e1ec-4a2a-94bf-85bc01f83deb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:47.460632 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f600947b-e1ec-4a2a-94bf-85bc01f83deb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:47.468583 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f600947b-e1ec-4a2a-94bf-85bc01f83deb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:47.469031 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f600947b-e1ec-4a2a-94bf-85bc01f83deb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:47.469969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f600947b-e1ec-4a2a-94bf-85bc01f83deb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:47.470412 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f600947b-e1ec-4a2a-94bf-85bc01f83deb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:47.609615 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f600947b-e1ec-4a2a-94bf-85bc01f83deb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:47.612951 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-13b45e7a-b129-4a58-876d-6fab99f20bcd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:47.614350 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-13b45e7a-b129-4a58-876d-6fab99f20bcd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:47.621335 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-13b45e7a-b129-4a58-876d-6fab99f20bcd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:47.621838 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-13b45e7a-b129-4a58-876d-6fab99f20bcd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:47.622893 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-13b45e7a-b129-4a58-876d-6fab99f20bcd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:47.623495 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-13b45e7a-b129-4a58-876d-6fab99f20bcd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:47.634122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f600947b-e1ec-4a2a-94bf-85bc01f83deb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1367 microversion: 2.1 time: 0.178157 May 10 21:09:47.635073 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 60/128] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:47 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:47.761742 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-13b45e7a-b129-4a58-876d-6fab99f20bcd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:47.770068 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-13b45e7a-b129-4a58-876d-6fab99f20bcd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1363 microversion: 2.1 time: 0.162564 May 10 21:09:47.770628 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 69/129] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:47 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:47.775439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-56dc9ce2-5b3d-4915-8391-c1cd8d8f0676 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:47.776137 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-56dc9ce2-5b3d-4915-8391-c1cd8d8f0676 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:47.782834 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-56dc9ce2-5b3d-4915-8391-c1cd8d8f0676 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:47.783334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-56dc9ce2-5b3d-4915-8391-c1cd8d8f0676 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:47.784111 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-56dc9ce2-5b3d-4915-8391-c1cd8d8f0676 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:47.784559 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-56dc9ce2-5b3d-4915-8391-c1cd8d8f0676 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:47.917803 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-56dc9ce2-5b3d-4915-8391-c1cd8d8f0676 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:47.925513 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-56dc9ce2-5b3d-4915-8391-c1cd8d8f0676 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.154577 May 10 21:09:47.926104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 61/130] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:47 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:09:48.081427 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-4e47bde3-f71c-4b4f-8b8c-150318d392c9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:48.082208 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-4e47bde3-f71c-4b4f-8b8c-150318d392c9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:48.088331 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4e47bde3-f71c-4b4f-8b8c-150318d392c9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:48.088772 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4e47bde3-f71c-4b4f-8b8c-150318d392c9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:48.089533 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4e47bde3-f71c-4b4f-8b8c-150318d392c9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:48.089961 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4e47bde3-f71c-4b4f-8b8c-150318d392c9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:48.237292 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-4e47bde3-f71c-4b4f-8b8c-150318d392c9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:48.246392 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-4e47bde3-f71c-4b4f-8b8c-150318d392c9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:48.249201 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-4e47bde3-f71c-4b4f-8b8c-150318d392c9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:48.250660 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-4e47bde3-f71c-4b4f-8b8c-150318d392c9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1407 microversion: 2.20 time: 0.173591 May 10 21:09:48.252705 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 70/131] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:09:48 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:09:48.560355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-5fe5d26a-b127-4e77-82fd-a8596823e95d req-ecb16fa6-c0ba-41ab-b801-559352f8d22b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688d836a-358b-4815-80e9-f43bd14f5f93", "name": "network-vif-plugged", "status": "completed", "tag": "8d78546f-3c5c-4f44-9d56-4eb5e6c1e96f"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:48.572222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-5fe5d26a-b127-4e77-82fd-a8596823e95d req-ecb16fa6-c0ba-41ab-b801-559352f8d22b service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:48.572222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-5fe5d26a-b127-4e77-82fd-a8596823e95d req-ecb16fa6-c0ba-41ab-b801-559352f8d22b service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:48.585062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-5fe5d26a-b127-4e77-82fd-a8596823e95d req-ecb16fa6-c0ba-41ab-b801-559352f8d22b service nova] Creating event network-vif-plugged:8d78546f-3c5c-4f44-9d56-4eb5e6c1e96f for instance 688d836a-358b-4815-80e9-f43bd14f5f93 on hv-cinder-82880 May 10 21:09:48.590486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-5fe5d26a-b127-4e77-82fd-a8596823e95d req-ecb16fa6-c0ba-41ab-b801-559352f8d22b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034347 May 10 21:09:48.592167 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 62/132] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:09:48.657689 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-cd9bf8c1-f4c8-4127-8475-34aa5ca8e4c3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:48.658479 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-cd9bf8c1-f4c8-4127-8475-34aa5ca8e4c3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:48.668881 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cd9bf8c1-f4c8-4127-8475-34aa5ca8e4c3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:48.669409 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cd9bf8c1-f4c8-4127-8475-34aa5ca8e4c3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:48.675305 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cd9bf8c1-f4c8-4127-8475-34aa5ca8e4c3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:48.675747 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cd9bf8c1-f4c8-4127-8475-34aa5ca8e4c3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:48.789036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6845a997-b1c5-44f4-9aaf-d825b4dd254e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:48.789992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6845a997-b1c5-44f4-9aaf-d825b4dd254e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:48.808609 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6845a997-b1c5-44f4-9aaf-d825b4dd254e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:48.809093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6845a997-b1c5-44f4-9aaf-d825b4dd254e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:48.810770 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6845a997-b1c5-44f4-9aaf-d825b4dd254e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:48.811509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6845a997-b1c5-44f4-9aaf-d825b4dd254e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:48.863637 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-cd9bf8c1-f4c8-4127-8475-34aa5ca8e4c3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:48.873317 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-cd9bf8c1-f4c8-4127-8475-34aa5ca8e4c3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1367 microversion: 2.1 time: 0.225653 May 10 21:09:48.876096 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 71/133] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:48 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:48.942740 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-bc7865b6-aeda-4ba0-bcac-2a9b8c5c141e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:48.943478 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-bc7865b6-aeda-4ba0-bcac-2a9b8c5c141e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:48.949504 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bc7865b6-aeda-4ba0-bcac-2a9b8c5c141e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:48.960789 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bc7865b6-aeda-4ba0-bcac-2a9b8c5c141e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:48.961648 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bc7865b6-aeda-4ba0-bcac-2a9b8c5c141e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:48.962078 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bc7865b6-aeda-4ba0-bcac-2a9b8c5c141e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:48.985987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6845a997-b1c5-44f4-9aaf-d825b4dd254e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:48.993590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6845a997-b1c5-44f4-9aaf-d825b4dd254e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1363 microversion: 2.1 time: 0.209367 May 10 21:09:48.996481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 63/134] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:48 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:49.121814 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-bc7865b6-aeda-4ba0-bcac-2a9b8c5c141e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:49.129911 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-bc7865b6-aeda-4ba0-bcac-2a9b8c5c141e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.190913 May 10 21:09:49.130753 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 72/135] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:48 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:49.270296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f8c8e727-66d8-4cc8-a3cb-a06632b3f146 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:49.270867 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f8c8e727-66d8-4cc8-a3cb-a06632b3f146 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:49.281841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f8c8e727-66d8-4cc8-a3cb-a06632b3f146 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:49.281841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f8c8e727-66d8-4cc8-a3cb-a06632b3f146 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:49.281841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f8c8e727-66d8-4cc8-a3cb-a06632b3f146 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:49.281841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f8c8e727-66d8-4cc8-a3cb-a06632b3f146 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:49.418308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f8c8e727-66d8-4cc8-a3cb-a06632b3f146 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:49.427082 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f8c8e727-66d8-4cc8-a3cb-a06632b3f146 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:49.428482 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f8c8e727-66d8-4cc8-a3cb-a06632b3f146 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:49.429616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f8c8e727-66d8-4cc8-a3cb-a06632b3f146 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1407 microversion: 2.20 time: 0.163231 May 10 21:09:49.430464 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 64/136] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:09:49 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:09:49.889788 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-85398f3f-5558-4468-9a27-db1f97fdec74 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:49.890556 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-85398f3f-5558-4468-9a27-db1f97fdec74 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:49.897059 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-85398f3f-5558-4468-9a27-db1f97fdec74 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:49.897498 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-85398f3f-5558-4468-9a27-db1f97fdec74 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:49.898257 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-85398f3f-5558-4468-9a27-db1f97fdec74 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:49.898687 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-85398f3f-5558-4468-9a27-db1f97fdec74 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:50.017306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c38575dd-9639-435e-806f-009ecca2a73f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:50.018789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c38575dd-9639-435e-806f-009ecca2a73f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:50.025719 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c38575dd-9639-435e-806f-009ecca2a73f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:50.026230 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c38575dd-9639-435e-806f-009ecca2a73f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:50.027237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c38575dd-9639-435e-806f-009ecca2a73f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:50.027743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c38575dd-9639-435e-806f-009ecca2a73f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:50.032834 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-85398f3f-5558-4468-9a27-db1f97fdec74 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:50.041065 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-85398f3f-5558-4468-9a27-db1f97fdec74 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1367 microversion: 2.1 time: 0.155212 May 10 21:09:50.041835 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 73/137] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:49 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:50.163095 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-68693568-837f-458e-b625-8caf7c75e3ce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:50.163727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-68693568-837f-458e-b625-8caf7c75e3ce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:50.169965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c38575dd-9639-435e-806f-009ecca2a73f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:50.170204 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-68693568-837f-458e-b625-8caf7c75e3ce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:50.170648 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-68693568-837f-458e-b625-8caf7c75e3ce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:50.171438 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-68693568-837f-458e-b625-8caf7c75e3ce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:50.171870 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-68693568-837f-458e-b625-8caf7c75e3ce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:50.179214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c38575dd-9639-435e-806f-009ecca2a73f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1363 microversion: 2.1 time: 0.166247 May 10 21:09:50.179827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 65/138] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:50 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:09:50.331035 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-68693568-837f-458e-b625-8caf7c75e3ce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:50.339267 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-68693568-837f-458e-b625-8caf7c75e3ce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.180002 May 10 21:09:50.339854 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 74/139] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:50 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:09:50.448115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f285e318-e4f1-4fb2-bdf7-759668fc1373 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:50.448724 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f285e318-e4f1-4fb2-bdf7-759668fc1373 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:50.454792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f285e318-e4f1-4fb2-bdf7-759668fc1373 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:50.455277 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f285e318-e4f1-4fb2-bdf7-759668fc1373 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:50.456110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f285e318-e4f1-4fb2-bdf7-759668fc1373 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:50.456525 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f285e318-e4f1-4fb2-bdf7-759668fc1373 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:50.614825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f285e318-e4f1-4fb2-bdf7-759668fc1373 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:50.623608 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f285e318-e4f1-4fb2-bdf7-759668fc1373 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:50.625120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f285e318-e4f1-4fb2-bdf7-759668fc1373 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:50.626734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f285e318-e4f1-4fb2-bdf7-759668fc1373 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1407 microversion: 2.20 time: 0.182206 May 10 21:09:50.627463 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 66/140] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:09:50 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:09:50.850524 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [req-e47b765f-d8fb-4794-8c7a-66a062d3a70c req-fde455f8-6fb3-42f7-a0f2-64e4a1aea701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "504464a5-03e5-42af-a2f3-ca210277d932", "name": "network-vif-plugged", "status": "completed", "tag": "c1351ad9-3f5d-4556-bf2a-38dd3150e8b1"}]} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:50.861853 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-e47b765f-d8fb-4794-8c7a-66a062d3a70c req-fde455f8-6fb3-42f7-a0f2-64e4a1aea701 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:50.862649 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-e47b765f-d8fb-4794-8c7a-66a062d3a70c req-fde455f8-6fb3-42f7-a0f2-64e4a1aea701 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:50.875882 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.compute.server_external_events [req-e47b765f-d8fb-4794-8c7a-66a062d3a70c req-fde455f8-6fb3-42f7-a0f2-64e4a1aea701 service nova] Creating event network-vif-plugged:c1351ad9-3f5d-4556-bf2a-38dd3150e8b1 for instance 504464a5-03e5-42af-a2f3-ca210277d932 on hv-cinder-82880 May 10 21:09:50.881014 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [req-e47b765f-d8fb-4794-8c7a-66a062d3a70c req-fde455f8-6fb3-42f7-a0f2-64e4a1aea701 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043165 May 10 21:09:50.881620 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 75/141] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:09:51.061271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-da3fca79-f3ce-4409-b514-ab792e18adc4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:51.061907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-da3fca79-f3ce-4409-b514-ab792e18adc4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:51.069865 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-da3fca79-f3ce-4409-b514-ab792e18adc4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:51.070324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-da3fca79-f3ce-4409-b514-ab792e18adc4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:51.071101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-da3fca79-f3ce-4409-b514-ab792e18adc4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:51.071759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-da3fca79-f3ce-4409-b514-ab792e18adc4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:51.197447 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e9381f13-6e97-41ce-a19d-d1b6446c7706 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:51.198252 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e9381f13-6e97-41ce-a19d-d1b6446c7706 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:51.208171 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e9381f13-6e97-41ce-a19d-d1b6446c7706 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:51.210401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e9381f13-6e97-41ce-a19d-d1b6446c7706 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:51.211485 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e9381f13-6e97-41ce-a19d-d1b6446c7706 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:51.212595 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e9381f13-6e97-41ce-a19d-d1b6446c7706 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:51.251742 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-da3fca79-f3ce-4409-b514-ab792e18adc4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:51.262148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-da3fca79-f3ce-4409-b514-ab792e18adc4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1367 microversion: 2.1 time: 0.206931 May 10 21:09:51.265818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 67/142] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:51 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:51.359215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-434dd55a-a20a-4846-90ce-9ad0d120e29d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:51.359836 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-434dd55a-a20a-4846-90ce-9ad0d120e29d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:51.369974 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-434dd55a-a20a-4846-90ce-9ad0d120e29d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:51.370625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-434dd55a-a20a-4846-90ce-9ad0d120e29d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:51.374672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-434dd55a-a20a-4846-90ce-9ad0d120e29d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:51.374672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-434dd55a-a20a-4846-90ce-9ad0d120e29d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:51.398040 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-e9381f13-6e97-41ce-a19d-d1b6446c7706 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:51.406369 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e9381f13-6e97-41ce-a19d-d1b6446c7706 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1363 microversion: 2.1 time: 0.213577 May 10 21:09:51.406979 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 76/143] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:51 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:51.523700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-434dd55a-a20a-4846-90ce-9ad0d120e29d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:51.531812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-434dd55a-a20a-4846-90ce-9ad0d120e29d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.179039 May 10 21:09:51.532468 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 68/144] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:51 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:51.644798 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-4c00fa88-5a83-44b3-afd2-9c5391a6e1b4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:51.645431 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-4c00fa88-5a83-44b3-afd2-9c5391a6e1b4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:51.651259 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4c00fa88-5a83-44b3-afd2-9c5391a6e1b4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:51.651703 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4c00fa88-5a83-44b3-afd2-9c5391a6e1b4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:51.652457 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4c00fa88-5a83-44b3-afd2-9c5391a6e1b4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:51.652886 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4c00fa88-5a83-44b3-afd2-9c5391a6e1b4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:51.783995 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-4c00fa88-5a83-44b3-afd2-9c5391a6e1b4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:51.791822 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-4c00fa88-5a83-44b3-afd2-9c5391a6e1b4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:51.793394 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-4c00fa88-5a83-44b3-afd2-9c5391a6e1b4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:51.795254 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-4c00fa88-5a83-44b3-afd2-9c5391a6e1b4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1600 microversion: 2.20 time: 0.154258 May 10 21:09:51.795812 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 77/145] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:09:51 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:09:51.814247 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-83407d4c-148f-4cb5-ac3e-7972405833ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:51.814652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-83407d4c-148f-4cb5-ac3e-7972405833ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:51.820547 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-83407d4c-148f-4cb5-ac3e-7972405833ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:51.820991 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-83407d4c-148f-4cb5-ac3e-7972405833ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:51.821797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-83407d4c-148f-4cb5-ac3e-7972405833ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:51.822237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-83407d4c-148f-4cb5-ac3e-7972405833ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:51.902697 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-83407d4c-148f-4cb5-ac3e-7972405833ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092989 May 10 21:09:51.903964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 69/146] 10.222.0.49 () {60 vars in 1315 bytes} [Tue May 10 21:09:51 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:09:52.282305 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6e124ffa-31f2-4ce0-bfa5-34e047be4ffc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:52.283004 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6e124ffa-31f2-4ce0-bfa5-34e047be4ffc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:52.289394 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6e124ffa-31f2-4ce0-bfa5-34e047be4ffc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:52.289843 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6e124ffa-31f2-4ce0-bfa5-34e047be4ffc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:52.290682 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6e124ffa-31f2-4ce0-bfa5-34e047be4ffc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:52.291323 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6e124ffa-31f2-4ce0-bfa5-34e047be4ffc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:52.425751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ab78b5cf-7bb5-489b-8156-79fba80bb509 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:52.436958 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-6e124ffa-31f2-4ce0-bfa5-34e047be4ffc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:52.439648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ab78b5cf-7bb5-489b-8156-79fba80bb509 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:52.448219 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6e124ffa-31f2-4ce0-bfa5-34e047be4ffc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1367 microversion: 2.1 time: 0.170645 May 10 21:09:52.458232 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 78/147] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:52 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:52.458624 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab78b5cf-7bb5-489b-8156-79fba80bb509 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:52.459893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab78b5cf-7bb5-489b-8156-79fba80bb509 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:52.461666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab78b5cf-7bb5-489b-8156-79fba80bb509 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:52.475413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab78b5cf-7bb5-489b-8156-79fba80bb509 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:52.550763 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-7424fcc1-ea0a-41d1-bbf2-ba0cfcf8d1da tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:52.552267 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-7424fcc1-ea0a-41d1-bbf2-ba0cfcf8d1da tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:52.558680 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7424fcc1-ea0a-41d1-bbf2-ba0cfcf8d1da tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:52.559168 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7424fcc1-ea0a-41d1-bbf2-ba0cfcf8d1da tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:52.559949 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7424fcc1-ea0a-41d1-bbf2-ba0cfcf8d1da tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:52.560600 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7424fcc1-ea0a-41d1-bbf2-ba0cfcf8d1da tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:52.730047 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-7424fcc1-ea0a-41d1-bbf2-ba0cfcf8d1da tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:52.745314 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-7424fcc1-ea0a-41d1-bbf2-ba0cfcf8d1da tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.198743 May 10 21:09:52.746602 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 79/148] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:52 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:09:52.833730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ab78b5cf-7bb5-489b-8156-79fba80bb509 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:52.847898 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ab78b5cf-7bb5-489b-8156-79fba80bb509 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1363 microversion: 2.1 time: 0.428321 May 10 21:09:52.849619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 70/149] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:52 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1363 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:52.898552 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [req-bd74e325-afc3-4fcd-bdf4-9aabfa86eb4c req-66ca7421-adc3-4eb5-ab20-530de21a408c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b28c992-788d-4e37-b194-aaf2fb61577b", "name": "network-vif-plugged", "status": "completed", "tag": "f92cd78e-033b-4a35-8495-6a1fd5b8ba63"}]} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:52.912932 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-bd74e325-afc3-4fcd-bdf4-9aabfa86eb4c req-66ca7421-adc3-4eb5-ab20-530de21a408c service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:52.913379 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-bd74e325-afc3-4fcd-bdf4-9aabfa86eb4c req-66ca7421-adc3-4eb5-ab20-530de21a408c service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:52.929144 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.compute.server_external_events [req-bd74e325-afc3-4fcd-bdf4-9aabfa86eb4c req-66ca7421-adc3-4eb5-ab20-530de21a408c service nova] Creating event network-vif-plugged:f92cd78e-033b-4a35-8495-6a1fd5b8ba63 for instance 4b28c992-788d-4e37-b194-aaf2fb61577b on hv-cinder-82880 May 10 21:09:52.934104 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [req-bd74e325-afc3-4fcd-bdf4-9aabfa86eb4c req-66ca7421-adc3-4eb5-ab20-530de21a408c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040958 May 10 21:09:52.936200 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 80/150] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:09:53.479685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e0c85160-c016-4645-a7a4-742204c46c52 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:53.480345 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e0c85160-c016-4645-a7a4-742204c46c52 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:53.494290 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e0c85160-c016-4645-a7a4-742204c46c52 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:53.494740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e0c85160-c016-4645-a7a4-742204c46c52 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:53.495802 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e0c85160-c016-4645-a7a4-742204c46c52 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:53.496276 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e0c85160-c016-4645-a7a4-742204c46c52 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:53.658144 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [req-c95266fc-8421-4faa-8cf6-73f37ec9e749 req-ae64eb0b-9afe-4010-9c52-430e170ff524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "688d836a-358b-4815-80e9-f43bd14f5f93", "tag": "8d78546f-3c5c-4f44-9d56-4eb5e6c1e96f"}]} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:53.677126 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-c95266fc-8421-4faa-8cf6-73f37ec9e749 req-ae64eb0b-9afe-4010-9c52-430e170ff524 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:53.677734 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-c95266fc-8421-4faa-8cf6-73f37ec9e749 req-ae64eb0b-9afe-4010-9c52-430e170ff524 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:53.687899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e0c85160-c016-4645-a7a4-742204c46c52 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:53.690583 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.compute.server_external_events [req-c95266fc-8421-4faa-8cf6-73f37ec9e749 req-ae64eb0b-9afe-4010-9c52-430e170ff524 service nova] Creating event network-changed:8d78546f-3c5c-4f44-9d56-4eb5e6c1e96f for instance 688d836a-358b-4815-80e9-f43bd14f5f93 on hv-cinder-82880 May 10 21:09:53.695649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e0c85160-c016-4645-a7a4-742204c46c52 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1367 microversion: 2.1 time: 0.234596 May 10 21:09:53.696475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 71/151] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:53 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:53.696884 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [req-c95266fc-8421-4faa-8cf6-73f37ec9e749 req-ae64eb0b-9afe-4010-9c52-430e170ff524 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044230 May 10 21:09:53.697929 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 81/152] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:09:53.763435 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-91d7a3dc-e46a-496a-9d79-b1919cb905cc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:53.764094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-91d7a3dc-e46a-496a-9d79-b1919cb905cc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:53.770282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91d7a3dc-e46a-496a-9d79-b1919cb905cc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:53.770739 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91d7a3dc-e46a-496a-9d79-b1919cb905cc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:53.771546 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91d7a3dc-e46a-496a-9d79-b1919cb905cc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:53.771982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91d7a3dc-e46a-496a-9d79-b1919cb905cc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:53.866491 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-25a9676b-323c-49d3-8f09-c2d824059d0b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:53.867453 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-25a9676b-323c-49d3-8f09-c2d824059d0b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:53.874878 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-25a9676b-323c-49d3-8f09-c2d824059d0b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:53.875358 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-25a9676b-323c-49d3-8f09-c2d824059d0b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:53.876459 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-25a9676b-323c-49d3-8f09-c2d824059d0b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:53.877068 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-25a9676b-323c-49d3-8f09-c2d824059d0b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:53.906213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-91d7a3dc-e46a-496a-9d79-b1919cb905cc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:53.915446 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-91d7a3dc-e46a-496a-9d79-b1919cb905cc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.156222 May 10 21:09:53.916431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 72/153] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:53 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:54.014045 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-25a9676b-323c-49d3-8f09-c2d824059d0b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:54.021787 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-25a9676b-323c-49d3-8f09-c2d824059d0b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1548 microversion: 2.1 time: 0.159436 May 10 21:09:54.022362 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 82/154] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:53 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:54.038954 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-eedfa516-d729-4635-9b20-659d05305c63 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:54.039496 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-eedfa516-d729-4635-9b20-659d05305c63 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:54.046145 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eedfa516-d729-4635-9b20-659d05305c63 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:54.046603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eedfa516-d729-4635-9b20-659d05305c63 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:54.047445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eedfa516-d729-4635-9b20-659d05305c63 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:54.047876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eedfa516-d729-4635-9b20-659d05305c63 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:54.132005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-eedfa516-d729-4635-9b20-659d05305c63 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096967 May 10 21:09:54.132585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 73/155] 10.222.0.49 () {58 vars in 1274 bytes} [Tue May 10 21:09:54 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:09:54.715367 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-99371feb-980f-4352-8eed-a0c0d43f0c36 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:54.717949 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-99371feb-980f-4352-8eed-a0c0d43f0c36 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:54.754114 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-99371feb-980f-4352-8eed-a0c0d43f0c36 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:54.754564 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-99371feb-980f-4352-8eed-a0c0d43f0c36 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:54.755387 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-99371feb-980f-4352-8eed-a0c0d43f0c36 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:54.755814 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-99371feb-980f-4352-8eed-a0c0d43f0c36 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:54.932863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5b65f02b-d60d-49e3-a2ea-590fe66414d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:54.933579 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5b65f02b-d60d-49e3-a2ea-590fe66414d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:54.948291 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b65f02b-d60d-49e3-a2ea-590fe66414d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:54.948291 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b65f02b-d60d-49e3-a2ea-590fe66414d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:54.948291 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b65f02b-d60d-49e3-a2ea-590fe66414d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:54.948291 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b65f02b-d60d-49e3-a2ea-590fe66414d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:55.019515 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-99371feb-980f-4352-8eed-a0c0d43f0c36 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:55.026959 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-99371feb-980f-4352-8eed-a0c0d43f0c36 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1367 microversion: 2.1 time: 0.317884 May 10 21:09:55.027562 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 83/156] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:54 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1367 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:55.088855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5b65f02b-d60d-49e3-a2ea-590fe66414d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:55.096456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5b65f02b-d60d-49e3-a2ea-590fe66414d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.168060 May 10 21:09:55.105878 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 74/157] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:54 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:09:55.717192 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [req-a11e82b2-7798-405c-94ca-75f9c949bd44 req-146c2d7d-6621-4e9d-961a-ef8be4330036 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "504464a5-03e5-42af-a2f3-ca210277d932", "tag": "c1351ad9-3f5d-4556-bf2a-38dd3150e8b1"}]} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:09:55.725134 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-a11e82b2-7798-405c-94ca-75f9c949bd44 req-146c2d7d-6621-4e9d-961a-ef8be4330036 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:55.725573 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-a11e82b2-7798-405c-94ca-75f9c949bd44 req-146c2d7d-6621-4e9d-961a-ef8be4330036 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:55.737685 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.compute.server_external_events [req-a11e82b2-7798-405c-94ca-75f9c949bd44 req-146c2d7d-6621-4e9d-961a-ef8be4330036 service nova] Creating event network-changed:c1351ad9-3f5d-4556-bf2a-38dd3150e8b1 for instance 504464a5-03e5-42af-a2f3-ca210277d932 on hv-cinder-82880 May 10 21:09:55.743495 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [req-a11e82b2-7798-405c-94ca-75f9c949bd44 req-146c2d7d-6621-4e9d-961a-ef8be4330036 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030146 May 10 21:09:55.744506 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 84/158] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:09:56.044827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-804270ee-68a9-4d36-a2fc-aa240d36a173 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:56.045444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-804270ee-68a9-4d36-a2fc-aa240d36a173 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:56.052166 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-804270ee-68a9-4d36-a2fc-aa240d36a173 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:56.052836 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-804270ee-68a9-4d36-a2fc-aa240d36a173 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:56.061227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-804270ee-68a9-4d36-a2fc-aa240d36a173 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:56.062955 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-804270ee-68a9-4d36-a2fc-aa240d36a173 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:56.114819 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-cbde2e88-6401-457a-8154-934ef1d0859f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:56.115827 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-cbde2e88-6401-457a-8154-934ef1d0859f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:56.123874 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cbde2e88-6401-457a-8154-934ef1d0859f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:56.124326 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cbde2e88-6401-457a-8154-934ef1d0859f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:56.125097 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cbde2e88-6401-457a-8154-934ef1d0859f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:56.125728 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cbde2e88-6401-457a-8154-934ef1d0859f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:56.391963 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-cbde2e88-6401-457a-8154-934ef1d0859f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:56.402568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-cbde2e88-6401-457a-8154-934ef1d0859f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.292107 May 10 21:09:56.403812 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 85/159] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:56 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:56.590250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-804270ee-68a9-4d36-a2fc-aa240d36a173 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:56.600041 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-804270ee-68a9-4d36-a2fc-aa240d36a173 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1367 microversion: 2.1 time: 0.559799 May 10 21:09:56.601050 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 75/160] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:56 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1367 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:57.250994 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6784caf1-60f3-49d4-93e0-01391b4afaa1 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:57.251567 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6784caf1-60f3-49d4-93e0-01391b4afaa1 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:57.257542 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6784caf1-60f3-49d4-93e0-01391b4afaa1 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:57.257995 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6784caf1-60f3-49d4-93e0-01391b4afaa1 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:57.258825 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6784caf1-60f3-49d4-93e0-01391b4afaa1 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:57.259295 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6784caf1-60f3-49d4-93e0-01391b4afaa1 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:57.285149 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6784caf1-60f3-49d4-93e0-01391b4afaa1 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Going to try to terminate instance {{(pid=117713) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:09:57.424209 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8126b0ba-b019-4bbf-a489-a73d00056452 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:57.425506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8126b0ba-b019-4bbf-a489-a73d00056452 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:57.441327 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8126b0ba-b019-4bbf-a489-a73d00056452 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:57.441794 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8126b0ba-b019-4bbf-a489-a73d00056452 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:57.442581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8126b0ba-b019-4bbf-a489-a73d00056452 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:57.443016 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8126b0ba-b019-4bbf-a489-a73d00056452 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:57.688227 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6784caf1-60f3-49d4-93e0-01391b4afaa1 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 204 len: 0 microversion: 2.1 time: 0.440925 May 10 21:09:57.688796 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 86/161] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 21:09:57 2022] DELETE /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 21:09:57.696090 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-3e9d2920-3c2a-4073-97cc-5c3b10c7553f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:57.696985 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-3e9d2920-3c2a-4073-97cc-5c3b10c7553f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:57.711030 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3e9d2920-3c2a-4073-97cc-5c3b10c7553f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:57.711030 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3e9d2920-3c2a-4073-97cc-5c3b10c7553f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:57.711030 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3e9d2920-3c2a-4073-97cc-5c3b10c7553f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:57.712790 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3e9d2920-3c2a-4073-97cc-5c3b10c7553f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:57.763895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8126b0ba-b019-4bbf-a489-a73d00056452 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:57.772017 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8126b0ba-b019-4bbf-a489-a73d00056452 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.352967 May 10 21:09:57.774270 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 76/162] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:57 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:09:57.780660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ad0bc320-b4b4-459c-8ea1-5c021e7412ff tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:57.781489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ad0bc320-b4b4-459c-8ea1-5c021e7412ff tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:57.788715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ad0bc320-b4b4-459c-8ea1-5c021e7412ff tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:57.789177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ad0bc320-b4b4-459c-8ea1-5c021e7412ff tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:57.789958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ad0bc320-b4b4-459c-8ea1-5c021e7412ff tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:57.790601 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ad0bc320-b4b4-459c-8ea1-5c021e7412ff tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:57.920876 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-3e9d2920-3c2a-4073-97cc-5c3b10c7553f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:57.920876 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-3e9d2920-3c2a-4073-97cc-5c3b10c7553f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1367 microversion: 2.1 time: 0.181710 May 10 21:09:57.920876 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 87/163] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:57 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:57.933450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ad0bc320-b4b4-459c-8ea1-5c021e7412ff tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:57.941838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ad0bc320-b4b4-459c-8ea1-5c021e7412ff tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1555 microversion: 2.1 time: 0.166296 May 10 21:09:57.942407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 77/164] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:57 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:58.808174 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a070b665-b74b-4c61-a3c5-06d991feab73 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:58.808855 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a070b665-b74b-4c61-a3c5-06d991feab73 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:58.815701 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a070b665-b74b-4c61-a3c5-06d991feab73 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:58.821589 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a070b665-b74b-4c61-a3c5-06d991feab73 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:58.821589 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a070b665-b74b-4c61-a3c5-06d991feab73 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:58.821589 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a070b665-b74b-4c61-a3c5-06d991feab73 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:58.917627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f16a88f9-930c-4a76-a528-4c80769ac225 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:58.918324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f16a88f9-930c-4a76-a528-4c80769ac225 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:58.925032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f16a88f9-930c-4a76-a528-4c80769ac225 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:58.925558 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f16a88f9-930c-4a76-a528-4c80769ac225 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:58.926411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f16a88f9-930c-4a76-a528-4c80769ac225 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:58.926921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f16a88f9-930c-4a76-a528-4c80769ac225 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:58.983150 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-a070b665-b74b-4c61-a3c5-06d991feab73 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:58.991971 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a070b665-b74b-4c61-a3c5-06d991feab73 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.187501 May 10 21:09:58.992871 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 88/165] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:58 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:58.997391 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-bb5fa782-71be-4f2d-844f-cb4e5d10739e tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:58.998351 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-bb5fa782-71be-4f2d-844f-cb4e5d10739e tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:59.007030 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bb5fa782-71be-4f2d-844f-cb4e5d10739e tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:59.007030 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bb5fa782-71be-4f2d-844f-cb4e5d10739e tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:59.007030 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bb5fa782-71be-4f2d-844f-cb4e5d10739e tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:59.007030 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bb5fa782-71be-4f2d-844f-cb4e5d10739e tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:59.071811 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f16a88f9-930c-4a76-a528-4c80769ac225 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:59.080688 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f16a88f9-930c-4a76-a528-4c80769ac225 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1557 microversion: 2.1 time: 0.166812 May 10 21:09:59.100191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 78/166] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:58 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1557 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:59.101977 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6d48b550-e98d-4b5e-82c9-97ba3dce186b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:09:59.102479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6d48b550-e98d-4b5e-82c9-97ba3dce186b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:09:59.110547 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6d48b550-e98d-4b5e-82c9-97ba3dce186b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:59.111002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6d48b550-e98d-4b5e-82c9-97ba3dce186b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:59.111902 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6d48b550-e98d-4b5e-82c9-97ba3dce186b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:09:59.112347 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6d48b550-e98d-4b5e-82c9-97ba3dce186b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:09:59.152721 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-bb5fa782-71be-4f2d-844f-cb4e5d10739e tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:09:59.161590 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-bb5fa782-71be-4f2d-844f-cb4e5d10739e tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1555 microversion: 2.1 time: 0.167576 May 10 21:09:59.171209 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 89/167] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:09:58 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:09:59.208514 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6d48b550-e98d-4b5e-82c9-97ba3dce186b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107063 May 10 21:09:59.208514 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 79/168] 10.222.0.49 () {58 vars in 1274 bytes} [Tue May 10 21:09:59 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:10:00.008863 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e5fae1b7-d0da-45d9-9027-16b761b46495 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:00.009476 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e5fae1b7-d0da-45d9-9027-16b761b46495 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:00.016633 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e5fae1b7-d0da-45d9-9027-16b761b46495 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:00.023023 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e5fae1b7-d0da-45d9-9027-16b761b46495 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:00.023023 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e5fae1b7-d0da-45d9-9027-16b761b46495 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:00.023023 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e5fae1b7-d0da-45d9-9027-16b761b46495 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:00.149194 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-e5fae1b7-d0da-45d9-9027-16b761b46495 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:00.159605 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e5fae1b7-d0da-45d9-9027-16b761b46495 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.154445 May 10 21:10:00.160281 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 90/169] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:00 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:10:00.181222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-affb0540-c0a9-417a-a53b-189d74102e28 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:00.181827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-affb0540-c0a9-417a-a53b-189d74102e28 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:00.188854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-affb0540-c0a9-417a-a53b-189d74102e28 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:00.189458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-affb0540-c0a9-417a-a53b-189d74102e28 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:00.190475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-affb0540-c0a9-417a-a53b-189d74102e28 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:00.190903 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-affb0540-c0a9-417a-a53b-189d74102e28 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:00.417768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-affb0540-c0a9-417a-a53b-189d74102e28 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:00.426834 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-affb0540-c0a9-417a-a53b-189d74102e28 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1555 microversion: 2.1 time: 0.250274 May 10 21:10:00.427674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 80/170] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:00 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1555 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:00.461064 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [req-6fd59832-5a4a-4281-b870-873175308aa9 req-23a75520-214f-4465-98b2-df3c4fcedb77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b28c992-788d-4e37-b194-aaf2fb61577b", "tag": "f92cd78e-033b-4a35-8495-6a1fd5b8ba63"}]} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:10:00.477136 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-6fd59832-5a4a-4281-b870-873175308aa9 req-23a75520-214f-4465-98b2-df3c4fcedb77 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:00.477789 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-6fd59832-5a4a-4281-b870-873175308aa9 req-23a75520-214f-4465-98b2-df3c4fcedb77 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:00.496908 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.compute.server_external_events [req-6fd59832-5a4a-4281-b870-873175308aa9 req-23a75520-214f-4465-98b2-df3c4fcedb77 service nova] Creating event network-changed:f92cd78e-033b-4a35-8495-6a1fd5b8ba63 for instance 4b28c992-788d-4e37-b194-aaf2fb61577b on hv-cinder-82880 May 10 21:10:00.498632 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [req-6fd59832-5a4a-4281-b870-873175308aa9 req-23a75520-214f-4465-98b2-df3c4fcedb77 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041090 May 10 21:10:00.499743 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 91/171] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:10:01.181377 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-32224005-9a46-4ae9-af3d-ac78d44e70bd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:01.182002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-32224005-9a46-4ae9-af3d-ac78d44e70bd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:01.189021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-32224005-9a46-4ae9-af3d-ac78d44e70bd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:01.191819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-32224005-9a46-4ae9-af3d-ac78d44e70bd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:01.191819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-32224005-9a46-4ae9-af3d-ac78d44e70bd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:01.191819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-32224005-9a46-4ae9-af3d-ac78d44e70bd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:01.351528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-32224005-9a46-4ae9-af3d-ac78d44e70bd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:01.364531 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-32224005-9a46-4ae9-af3d-ac78d44e70bd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.186960 May 10 21:10:01.365359 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 81/172] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:01 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:01.446352 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-14ee2997-c995-4581-a122-bfc44cc81442 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:01.448039 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-14ee2997-c995-4581-a122-bfc44cc81442 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:01.455912 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-14ee2997-c995-4581-a122-bfc44cc81442 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:01.462306 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-14ee2997-c995-4581-a122-bfc44cc81442 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:01.462306 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-14ee2997-c995-4581-a122-bfc44cc81442 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:01.462306 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-14ee2997-c995-4581-a122-bfc44cc81442 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:01.616215 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-14ee2997-c995-4581-a122-bfc44cc81442 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:01.630362 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-14ee2997-c995-4581-a122-bfc44cc81442 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1555 microversion: 2.1 time: 0.187749 May 10 21:10:01.631393 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 92/173] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:01 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1555 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:02.382033 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f174c0bb-428d-4e26-9dd0-b0c5c4b14248 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:02.382718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f174c0bb-428d-4e26-9dd0-b0c5c4b14248 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:02.389286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f174c0bb-428d-4e26-9dd0-b0c5c4b14248 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:02.390020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f174c0bb-428d-4e26-9dd0-b0c5c4b14248 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:02.390909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f174c0bb-428d-4e26-9dd0-b0c5c4b14248 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:02.391437 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f174c0bb-428d-4e26-9dd0-b0c5c4b14248 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:02.648974 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-5604a88c-f2a3-4756-bc4f-d0ceac9af579 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:02.650131 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5604a88c-f2a3-4756-bc4f-d0ceac9af579 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:02.656517 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5604a88c-f2a3-4756-bc4f-d0ceac9af579 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:02.679630 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5604a88c-f2a3-4756-bc4f-d0ceac9af579 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:02.680479 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5604a88c-f2a3-4756-bc4f-d0ceac9af579 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:02.680930 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5604a88c-f2a3-4756-bc4f-d0ceac9af579 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:02.836024 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-5604a88c-f2a3-4756-bc4f-d0ceac9af579 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:02.846361 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-5604a88c-f2a3-4756-bc4f-d0ceac9af579 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1555 microversion: 2.1 time: 0.201091 May 10 21:10:02.847305 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 93/174] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:02 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1555 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:10:03.000742 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f174c0bb-428d-4e26-9dd0-b0c5c4b14248 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:03.012272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f174c0bb-428d-4e26-9dd0-b0c5c4b14248 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.634130 May 10 21:10:03.016636 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 82/175] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:02 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:03.867492 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-65b4eec5-cb02-4b29-b3f9-1e582ce7508a tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:03.872350 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-65b4eec5-cb02-4b29-b3f9-1e582ce7508a tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:03.885432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-65b4eec5-cb02-4b29-b3f9-1e582ce7508a tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:03.888496 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-65b4eec5-cb02-4b29-b3f9-1e582ce7508a tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:03.891609 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-65b4eec5-cb02-4b29-b3f9-1e582ce7508a tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:03.892121 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-65b4eec5-cb02-4b29-b3f9-1e582ce7508a tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:04.032303 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ffb5b99f-5c71-494f-964f-f515a45c02de tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:04.032303 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ffb5b99f-5c71-494f-964f-f515a45c02de tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:04.038897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ffb5b99f-5c71-494f-964f-f515a45c02de tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:04.040150 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ffb5b99f-5c71-494f-964f-f515a45c02de tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:04.044212 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ffb5b99f-5c71-494f-964f-f515a45c02de tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:04.050531 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ffb5b99f-5c71-494f-964f-f515a45c02de tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:04.227615 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-65b4eec5-cb02-4b29-b3f9-1e582ce7508a tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:04.236708 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-65b4eec5-cb02-4b29-b3f9-1e582ce7508a tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1555 microversion: 2.1 time: 0.374297 May 10 21:10:04.237288 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 94/176] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:03 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1555 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:04.242422 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [req-08226b07-9e6c-485c-aaf7-27679d8e7597 req-c7a25f50-44f4-43dc-a5fd-db32d6245631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ef51171-183b-4712-b00c-f9612618e4d8", "name": "network-vif-deleted", "tag": "a4b5b4f5-1566-4995-b222-14d74d8b3930"}]} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:10:04.253267 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-08226b07-9e6c-485c-aaf7-27679d8e7597 req-c7a25f50-44f4-43dc-a5fd-db32d6245631 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:04.253974 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-08226b07-9e6c-485c-aaf7-27679d8e7597 req-c7a25f50-44f4-43dc-a5fd-db32d6245631 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:04.267759 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.compute.server_external_events [req-08226b07-9e6c-485c-aaf7-27679d8e7597 req-c7a25f50-44f4-43dc-a5fd-db32d6245631 service nova] Creating event network-vif-deleted:a4b5b4f5-1566-4995-b222-14d74d8b3930 for instance 5ef51171-183b-4712-b00c-f9612618e4d8 on hv-cinder-82880 May 10 21:10:04.276882 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [req-08226b07-9e6c-485c-aaf7-27679d8e7597 req-c7a25f50-44f4-43dc-a5fd-db32d6245631 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038153 May 10 21:10:04.277555 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 95/177] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:10:04.286369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ffb5b99f-5c71-494f-964f-f515a45c02de tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:04.295880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ffb5b99f-5c71-494f-964f-f515a45c02de tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.269864 May 10 21:10:04.305683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 83/178] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:04 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:05.254501 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-33ef0dc2-0ccf-424b-8dc9-ba92ca8e214a tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:05.255240 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-33ef0dc2-0ccf-424b-8dc9-ba92ca8e214a tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:05.262345 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-33ef0dc2-0ccf-424b-8dc9-ba92ca8e214a tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:05.262799 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-33ef0dc2-0ccf-424b-8dc9-ba92ca8e214a tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:05.263619 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-33ef0dc2-0ccf-424b-8dc9-ba92ca8e214a tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:05.264085 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-33ef0dc2-0ccf-424b-8dc9-ba92ca8e214a tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:05.301063 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-33ef0dc2-0ccf-424b-8dc9-ba92ca8e214a tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:05.302165 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-33ef0dc2-0ccf-424b-8dc9-ba92ca8e214a tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:05.302733 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.objects.instance [None req-33ef0dc2-0ccf-424b-8dc9-ba92ca8e214a tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lazy-loading 'fault' on Instance uuid 5ef51171-183b-4712-b00c-f9612618e4d8 {{(pid=117713) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:10:05.313643 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0bc1b594-7f22-461f-bd56-5fda49906931 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:05.314255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0bc1b594-7f22-461f-bd56-5fda49906931 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:05.331737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0bc1b594-7f22-461f-bd56-5fda49906931 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:05.331737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0bc1b594-7f22-461f-bd56-5fda49906931 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:05.331737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0bc1b594-7f22-461f-bd56-5fda49906931 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:05.331737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0bc1b594-7f22-461f-bd56-5fda49906931 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:05.361445 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-33ef0dc2-0ccf-424b-8dc9-ba92ca8e214a tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00678cc05f4a40aa86503052b0d067f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec69436f8724e48af59f1b87f22b9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:05.370135 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-33ef0dc2-0ccf-424b-8dc9-ba92ca8e214a tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 200 len: 1351 microversion: 2.1 time: 0.119983 May 10 21:10:05.370712 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 96/179] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:05 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 1351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:05.504780 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0bc1b594-7f22-461f-bd56-5fda49906931 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:05.513469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0bc1b594-7f22-461f-bd56-5fda49906931 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.203882 May 10 21:10:05.519885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 84/180] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:05 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:06.391367 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-42068292-7468-4d4f-b1ec-086b076f308e tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:06.391983 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-42068292-7468-4d4f-b1ec-086b076f308e tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:06.399388 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-42068292-7468-4d4f-b1ec-086b076f308e tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:06.399388 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-42068292-7468-4d4f-b1ec-086b076f308e tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:06.400278 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-42068292-7468-4d4f-b1ec-086b076f308e tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:06.400724 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-42068292-7468-4d4f-b1ec-086b076f308e tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:06.414963 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.wsgi [None req-42068292-7468-4d4f-b1ec-086b076f308e tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] HTTP exception thrown: Instance 5ef51171-183b-4712-b00c-f9612618e4d8 could not be found. May 10 21:10:06.419679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-42068292-7468-4d4f-b1ec-086b076f308e tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Request method failure captured: May 10 21:10:06.419679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: request: GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 HTTP/1.1 May 10 21:10:06.419679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Accept: application/json May 10 21:10:06.419679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Accept-Encoding: identity May 10 21:10:06.419679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Connection: close May 10 21:10:06.419679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Content-Length: 0 May 10 21:10:06.419679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Content-Type: application/json May 10 21:10:06.419679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Host: 10.222.0.49 May 10 21:10:06.419679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Openstack-System-Scope: None May 10 21:10:06.419679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: User-Agent: python-urllib3/1.26.9 May 10 21:10:06.419679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Auth-Token: gAAAAABietRs4BRJxBvWUx0tk0EefMSwcfHsL5aPqZbCOxy3EqNnIKsCjeAJwsFMZmGlJ2vaVWBgUUk1FbkO6NTdxZKj-6yVy0Pc6wFPqf41KO93do3_hj63EAFo53CQveSLoptPGbyGaEB3K8_pbYI8YIL1QOath8qJZ3W0ZZLmkZzoh2OVJYE May 10 21:10:06.419679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Domain-Id: None May 10 21:10:06.419679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Domain-Name: None May 10 21:10:06.419679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Identity-Status: Confirmed May 10 21:10:06.419679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Is-Admin-Project: True May 10 21:10:06.419679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Domain-Id: default May 10 21:10:06.419679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Domain-Name: Default May 10 21:10:06.419679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Id: 9ec69436f8724e48af59f1b87f22b9ac May 10 21:10:06.419679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Name: tempest-DeleteServersTestJSON-1647863150 May 10 21:10:06.419679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Role: reader,member May 10 21:10:06.419679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Roles: reader,member May 10 21:10:06.421280 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9ec69436f8724e48af59f1b87f22b9ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9ec69436f8724e48af59f1b87f22b9ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9ec69436f8724e48af59f1b87f22b9ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9ec69436f8724e48af59f1b87f22b9ac", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:10:06.421280 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Tenant: tempest-DeleteServersTestJSON-1647863150 May 10 21:10:06.421280 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Tenant-Id: 9ec69436f8724e48af59f1b87f22b9ac May 10 21:10:06.421280 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Tenant-Name: tempest-DeleteServersTestJSON-1647863150 May 10 21:10:06.421280 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User: tempest-DeleteServersTestJSON-1647863150-project May 10 21:10:06.421280 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Domain-Id: default May 10 21:10:06.421280 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Domain-Name: Default May 10 21:10:06.421280 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Id: 00678cc05f4a40aa86503052b0d067f4 May 10 21:10:06.421280 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Name: tempest-DeleteServersTestJSON-1647863150-project May 10 21:10:06.421280 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: method: > May 10 21:10:06.421280 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: exception: Instance 5ef51171-183b-4712-b00c-f9612618e4d8 could not be found. May 10 21:10:06.421280 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: action_args: {'id': '5ef51171-183b-4712-b00c-f9612618e4d8'} May 10 21:10:06.422282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:10:06.422282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:10:06.422282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:10:06.422282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:10:06.422282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:10:06.422282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:10:06.422282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:10:06.422282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:10:06.422282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:10:06.422282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:10:06.422282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ef51171-183b-4712-b00c-f9612618e4d8 could not be found. May 10 21:10:06.422282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:10:06.422282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:10:06.422282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:10:06.422282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:10:06.422282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:10:06.422282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:10:06.422282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:10:06.422282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:10:06.422282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:10:06.426189 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:10:06.426189 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:10:06.426189 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:10:06.426189 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:10:06.426189 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:10:06.426189 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:10:06.426189 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:10:06.426189 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ef51171-183b-4712-b00c-f9612618e4d8 could not be found. May 10 21:10:06.426189 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:10:06.426189 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:10:06.426189 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:10:06.426189 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:10:06.426189 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:10:06.426189 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:10:06.426189 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:10:06.426189 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:10:06.426189 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ef51171-183b-4712-b00c-f9612618e4d8 could not be found. May 10 21:10:06.426189 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:10:06.427451 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-42068292-7468-4d4f-b1ec-086b076f308e tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Returning 404 to user: Instance 5ef51171-183b-4712-b00c-f9612618e4d8 could not be found. {{(pid=117713) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:10:06.427451 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-42068292-7468-4d4f-b1ec-086b076f308e tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 404 len: 111 microversion: 2.1 time: 0.037659 May 10 21:10:06.427451 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 97/181] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:06 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:10:06.531525 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-91b375cc-19f8-4c9e-b699-d2bae7585001 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:06.532457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-91b375cc-19f8-4c9e-b699-d2bae7585001 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:06.536143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-25269851-8984-4e7c-9792-78e9d76ca233 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:06.536765 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-25269851-8984-4e7c-9792-78e9d76ca233 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:06.539187 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91b375cc-19f8-4c9e-b699-d2bae7585001 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:06.539636 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91b375cc-19f8-4c9e-b699-d2bae7585001 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:06.540397 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91b375cc-19f8-4c9e-b699-d2bae7585001 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:06.540830 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91b375cc-19f8-4c9e-b699-d2bae7585001 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:06.542735 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-25269851-8984-4e7c-9792-78e9d76ca233 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:06.543233 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-25269851-8984-4e7c-9792-78e9d76ca233 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:06.543978 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-25269851-8984-4e7c-9792-78e9d76ca233 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:06.544400 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-25269851-8984-4e7c-9792-78e9d76ca233 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:06.555034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-91b375cc-19f8-4c9e-b699-d2bae7585001 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] HTTP exception thrown: Instance 5ef51171-183b-4712-b00c-f9612618e4d8 could not be found. May 10 21:10:06.559266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-91b375cc-19f8-4c9e-b699-d2bae7585001 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Request method failure captured: May 10 21:10:06.559266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8/os-volume_attachments HTTP/1.1 May 10 21:10:06.559266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:10:06.559266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:10:06.559266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:10:06.559266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:10:06.559266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:10:06.559266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:10:06.559266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:10:06.559266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:10:06.559266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietRs4BRJxBvWUx0tk0EefMSwcfHsL5aPqZbCOxy3EqNnIKsCjeAJwsFMZmGlJ2vaVWBgUUk1FbkO6NTdxZKj-6yVy0Pc6wFPqf41KO93do3_hj63EAFo53CQveSLoptPGbyGaEB3K8_pbYI8YIL1QOath8qJZ3W0ZZLmkZzoh2OVJYE May 10 21:10:06.559266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:10:06.559266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:10:06.559266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:10:06.559266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:10:06.559266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:10:06.559266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:10:06.559266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 9ec69436f8724e48af59f1b87f22b9ac May 10 21:10:06.559266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-DeleteServersTestJSON-1647863150 May 10 21:10:06.559266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:10:06.559266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:10:06.567085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9ec69436f8724e48af59f1b87f22b9ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9ec69436f8724e48af59f1b87f22b9ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9ec69436f8724e48af59f1b87f22b9ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9ec69436f8724e48af59f1b87f22b9ac", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:10:06.567085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-DeleteServersTestJSON-1647863150 May 10 21:10:06.567085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 9ec69436f8724e48af59f1b87f22b9ac May 10 21:10:06.567085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-DeleteServersTestJSON-1647863150 May 10 21:10:06.567085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-DeleteServersTestJSON-1647863150-project May 10 21:10:06.567085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:10:06.567085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:10:06.567085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 00678cc05f4a40aa86503052b0d067f4 May 10 21:10:06.567085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-DeleteServersTestJSON-1647863150-project May 10 21:10:06.567085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:10:06.567085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance 5ef51171-183b-4712-b00c-f9612618e4d8 could not be found. May 10 21:10:06.567085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'server_id': '5ef51171-183b-4712-b00c-f9612618e4d8'} May 10 21:10:06.567996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:10:06.567996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:10:06.567996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:10:06.567996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:10:06.567996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:10:06.567996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:10:06.567996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:10:06.567996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:10:06.567996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:10:06.567996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:10:06.567996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ef51171-183b-4712-b00c-f9612618e4d8 could not be found. May 10 21:10:06.567996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:10:06.567996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:10:06.567996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:10:06.567996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:10:06.567996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:10:06.567996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:10:06.567996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:10:06.567996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:10:06.567996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:10:06.569120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:10:06.569120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 21:10:06.569120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 21:10:06.569120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 21:10:06.569120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 21:10:06.569120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 10 21:10:06.569120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 10 21:10:06.569120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:10:06.569120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:10:06.569120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ef51171-183b-4712-b00c-f9612618e4d8 could not be found. May 10 21:10:06.569120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:10:06.569120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:10:06.569120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:10:06.569120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:10:06.569120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:10:06.569120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:10:06.569120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:10:06.569120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:10:06.569120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ef51171-183b-4712-b00c-f9612618e4d8 could not be found. May 10 21:10:06.569120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:10:06.570438 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-91b375cc-19f8-4c9e-b699-d2bae7585001 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Returning 404 to user: Instance 5ef51171-183b-4712-b00c-f9612618e4d8 could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:10:06.570438 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-91b375cc-19f8-4c9e-b699-d2bae7585001 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033843 May 10 21:10:06.570438 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 85/182] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:10:06 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:10:06.706211 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-25269851-8984-4e7c-9792-78e9d76ca233 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:06.713806 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-25269851-8984-4e7c-9792-78e9d76ca233 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.181720 May 10 21:10:06.714370 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 98/183] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:06 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:10:07.731603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bc83ac96-3cca-4a9c-8173-a82be45e0ec3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:07.732217 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bc83ac96-3cca-4a9c-8173-a82be45e0ec3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:07.739012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bc83ac96-3cca-4a9c-8173-a82be45e0ec3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:07.739501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bc83ac96-3cca-4a9c-8173-a82be45e0ec3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:07.740279 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bc83ac96-3cca-4a9c-8173-a82be45e0ec3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:07.740870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bc83ac96-3cca-4a9c-8173-a82be45e0ec3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:07.877247 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bc83ac96-3cca-4a9c-8173-a82be45e0ec3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:07.884633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bc83ac96-3cca-4a9c-8173-a82be45e0ec3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.157166 May 10 21:10:07.885187 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 86/184] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:07 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:07.947820 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-bc4b67a5-78e1-4c4f-aefd-2685501352f1 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:07.948356 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-bc4b67a5-78e1-4c4f-aefd-2685501352f1 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:07.954792 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bc4b67a5-78e1-4c4f-aefd-2685501352f1 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:07.955575 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bc4b67a5-78e1-4c4f-aefd-2685501352f1 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:07.956364 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bc4b67a5-78e1-4c4f-aefd-2685501352f1 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:07.956861 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bc4b67a5-78e1-4c4f-aefd-2685501352f1 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:07.971398 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.wsgi [None req-bc4b67a5-78e1-4c4f-aefd-2685501352f1 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] HTTP exception thrown: Instance 5ef51171-183b-4712-b00c-f9612618e4d8 could not be found. May 10 21:10:07.972935 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-bc4b67a5-78e1-4c4f-aefd-2685501352f1 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Request method failure captured: May 10 21:10:07.972935 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: request: DELETE /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 HTTP/1.1 May 10 21:10:07.972935 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Accept: application/json May 10 21:10:07.972935 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Accept-Encoding: identity May 10 21:10:07.972935 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Connection: close May 10 21:10:07.972935 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Content-Length: 0 May 10 21:10:07.972935 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Content-Type: application/json May 10 21:10:07.972935 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Host: 10.222.0.49 May 10 21:10:07.972935 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Openstack-System-Scope: None May 10 21:10:07.972935 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: User-Agent: python-urllib3/1.26.9 May 10 21:10:07.972935 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Auth-Token: gAAAAABietRs4BRJxBvWUx0tk0EefMSwcfHsL5aPqZbCOxy3EqNnIKsCjeAJwsFMZmGlJ2vaVWBgUUk1FbkO6NTdxZKj-6yVy0Pc6wFPqf41KO93do3_hj63EAFo53CQveSLoptPGbyGaEB3K8_pbYI8YIL1QOath8qJZ3W0ZZLmkZzoh2OVJYE May 10 21:10:07.972935 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Domain-Id: None May 10 21:10:07.972935 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Domain-Name: None May 10 21:10:07.972935 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Identity-Status: Confirmed May 10 21:10:07.972935 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Is-Admin-Project: True May 10 21:10:07.972935 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Domain-Id: default May 10 21:10:07.972935 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Domain-Name: Default May 10 21:10:07.972935 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Id: 9ec69436f8724e48af59f1b87f22b9ac May 10 21:10:07.972935 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Name: tempest-DeleteServersTestJSON-1647863150 May 10 21:10:07.972935 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Role: reader,member May 10 21:10:07.972935 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Roles: reader,member May 10 21:10:07.974440 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9ec69436f8724e48af59f1b87f22b9ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9ec69436f8724e48af59f1b87f22b9ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9ec69436f8724e48af59f1b87f22b9ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9ec69436f8724e48af59f1b87f22b9ac", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:10:07.974440 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Tenant: tempest-DeleteServersTestJSON-1647863150 May 10 21:10:07.974440 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Tenant-Id: 9ec69436f8724e48af59f1b87f22b9ac May 10 21:10:07.974440 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Tenant-Name: tempest-DeleteServersTestJSON-1647863150 May 10 21:10:07.974440 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User: tempest-DeleteServersTestJSON-1647863150-project May 10 21:10:07.974440 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Domain-Id: default May 10 21:10:07.974440 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Domain-Name: Default May 10 21:10:07.974440 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Id: 00678cc05f4a40aa86503052b0d067f4 May 10 21:10:07.974440 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Name: tempest-DeleteServersTestJSON-1647863150-project May 10 21:10:07.974440 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: method: > May 10 21:10:07.974440 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: exception: Instance 5ef51171-183b-4712-b00c-f9612618e4d8 could not be found. May 10 21:10:07.974440 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: action_args: {'id': '5ef51171-183b-4712-b00c-f9612618e4d8'} May 10 21:10:07.980763 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:10:07.980763 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:10:07.980763 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:10:07.980763 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:10:07.980763 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:10:07.980763 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:10:07.980763 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:10:07.980763 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:10:07.980763 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:10:07.980763 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:10:07.980763 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ef51171-183b-4712-b00c-f9612618e4d8 could not be found. May 10 21:10:07.980763 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:10:07.980763 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:10:07.980763 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:10:07.980763 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:10:07.980763 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:10:07.980763 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:10:07.980763 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:10:07.980763 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:10:07.980763 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:10:07.982082 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:10:07.982082 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 21:10:07.982082 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 21:10:07.982082 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 21:10:07.982082 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 21:10:07.982082 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:10:07.982082 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:10:07.982082 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:10:07.982082 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:10:07.982082 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ef51171-183b-4712-b00c-f9612618e4d8 could not be found. May 10 21:10:07.982082 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:10:07.982082 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:10:07.982082 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:10:07.982082 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:10:07.982082 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:10:07.982082 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:10:07.982082 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:10:07.982082 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:10:07.982082 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ef51171-183b-4712-b00c-f9612618e4d8 could not be found. May 10 21:10:07.982082 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:10:07.983394 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-bc4b67a5-78e1-4c4f-aefd-2685501352f1 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Returning 404 to user: Instance 5ef51171-183b-4712-b00c-f9612618e4d8 could not be found. {{(pid=117713) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:10:07.983394 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-bc4b67a5-78e1-4c4f-aefd-2685501352f1 tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 404 len: 111 microversion: 2.1 time: 0.030351 May 10 21:10:07.983394 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 99/185] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 21:10:07 2022] DELETE /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:10:07.983627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3046ce28-e59e-4baf-ae09-4900c3849abc tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:07.983714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3046ce28-e59e-4baf-ae09-4900c3849abc tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] [instance: 5ef51171-183b-4712-b00c-f9612618e4d8] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:07.989844 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3046ce28-e59e-4baf-ae09-4900c3849abc tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:07.990286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3046ce28-e59e-4baf-ae09-4900c3849abc tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:07.991046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3046ce28-e59e-4baf-ae09-4900c3849abc tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:07.991503 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3046ce28-e59e-4baf-ae09-4900c3849abc tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:08.005588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-3046ce28-e59e-4baf-ae09-4900c3849abc tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] HTTP exception thrown: Instance 5ef51171-183b-4712-b00c-f9612618e4d8 could not be found. May 10 21:10:08.007837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3046ce28-e59e-4baf-ae09-4900c3849abc tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Request method failure captured: May 10 21:10:08.007837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 HTTP/1.1 May 10 21:10:08.007837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:10:08.007837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:10:08.007837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:10:08.007837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:10:08.007837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:10:08.007837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:10:08.007837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:10:08.007837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:10:08.007837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietRs4BRJxBvWUx0tk0EefMSwcfHsL5aPqZbCOxy3EqNnIKsCjeAJwsFMZmGlJ2vaVWBgUUk1FbkO6NTdxZKj-6yVy0Pc6wFPqf41KO93do3_hj63EAFo53CQveSLoptPGbyGaEB3K8_pbYI8YIL1QOath8qJZ3W0ZZLmkZzoh2OVJYE May 10 21:10:08.007837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:10:08.007837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:10:08.007837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:10:08.007837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:10:08.007837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:10:08.007837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:10:08.007837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 9ec69436f8724e48af59f1b87f22b9ac May 10 21:10:08.007837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-DeleteServersTestJSON-1647863150 May 10 21:10:08.007837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:10:08.007837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:10:08.009527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9ec69436f8724e48af59f1b87f22b9ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9ec69436f8724e48af59f1b87f22b9ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9ec69436f8724e48af59f1b87f22b9ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9ec69436f8724e48af59f1b87f22b9ac", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:10:08.009527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-DeleteServersTestJSON-1647863150 May 10 21:10:08.009527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 9ec69436f8724e48af59f1b87f22b9ac May 10 21:10:08.009527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-DeleteServersTestJSON-1647863150 May 10 21:10:08.009527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-DeleteServersTestJSON-1647863150-project May 10 21:10:08.009527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:10:08.009527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:10:08.009527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 00678cc05f4a40aa86503052b0d067f4 May 10 21:10:08.009527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-DeleteServersTestJSON-1647863150-project May 10 21:10:08.009527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:10:08.009527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance 5ef51171-183b-4712-b00c-f9612618e4d8 could not be found. May 10 21:10:08.009527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': '5ef51171-183b-4712-b00c-f9612618e4d8'} May 10 21:10:08.010484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:10:08.010484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:10:08.010484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:10:08.010484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:10:08.010484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:10:08.010484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:10:08.010484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:10:08.010484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:10:08.010484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:10:08.010484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:10:08.010484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ef51171-183b-4712-b00c-f9612618e4d8 could not be found. May 10 21:10:08.010484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:10:08.010484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:10:08.010484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:10:08.010484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:10:08.010484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:10:08.010484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:10:08.010484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:10:08.010484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:10:08.010484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:10:08.011809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:10:08.011809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:10:08.011809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:10:08.011809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:10:08.011809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:10:08.011809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:10:08.011809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:10:08.011809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ef51171-183b-4712-b00c-f9612618e4d8 could not be found. May 10 21:10:08.011809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:10:08.011809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:10:08.011809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:10:08.011809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:10:08.011809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:10:08.011809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:10:08.011809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:10:08.011809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:10:08.011809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ef51171-183b-4712-b00c-f9612618e4d8 could not be found. May 10 21:10:08.011809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:10:08.013410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3046ce28-e59e-4baf-ae09-4900c3849abc tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] Returning 404 to user: Instance 5ef51171-183b-4712-b00c-f9612618e4d8 could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:10:08.013410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3046ce28-e59e-4baf-ae09-4900c3849abc tempest-DeleteServersTestJSON-1647863150 tempest-DeleteServersTestJSON-1647863150-project] 10.222.0.49 "GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8" status: 404 len: 111 microversion: 2.1 time: 0.030020 May 10 21:10:08.013410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 87/186] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:07 2022] GET /compute/v2.1/servers/5ef51171-183b-4712-b00c-f9612618e4d8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 21:10:08.902230 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c965c1c7-d41e-4b5e-bcbc-1fd00d80f122 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:08.902971 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c965c1c7-d41e-4b5e-bcbc-1fd00d80f122 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:08.909666 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c965c1c7-d41e-4b5e-bcbc-1fd00d80f122 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:08.910176 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c965c1c7-d41e-4b5e-bcbc-1fd00d80f122 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:08.910953 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c965c1c7-d41e-4b5e-bcbc-1fd00d80f122 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:08.911410 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c965c1c7-d41e-4b5e-bcbc-1fd00d80f122 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:09.041142 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-c965c1c7-d41e-4b5e-bcbc-1fd00d80f122 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:09.049610 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c965c1c7-d41e-4b5e-bcbc-1fd00d80f122 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.151481 May 10 21:10:09.050172 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 100/187] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:08 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:10.072527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-452b6d8f-fd44-4576-a362-0ad6c0c57c87 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:10.074328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-452b6d8f-fd44-4576-a362-0ad6c0c57c87 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:10.084162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-452b6d8f-fd44-4576-a362-0ad6c0c57c87 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:10.084607 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-452b6d8f-fd44-4576-a362-0ad6c0c57c87 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:10.085394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-452b6d8f-fd44-4576-a362-0ad6c0c57c87 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:10.085863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-452b6d8f-fd44-4576-a362-0ad6c0c57c87 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:10.225756 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-452b6d8f-fd44-4576-a362-0ad6c0c57c87 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:10.234672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-452b6d8f-fd44-4576-a362-0ad6c0c57c87 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.166700 May 10 21:10:10.236028 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 88/188] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:10 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:11.255654 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-676eb0cc-3a0a-4a83-a05c-6a3b0087b043 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:11.257449 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-676eb0cc-3a0a-4a83-a05c-6a3b0087b043 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:11.275411 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-676eb0cc-3a0a-4a83-a05c-6a3b0087b043 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:11.276590 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-676eb0cc-3a0a-4a83-a05c-6a3b0087b043 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:11.277540 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-676eb0cc-3a0a-4a83-a05c-6a3b0087b043 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:11.278179 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-676eb0cc-3a0a-4a83-a05c-6a3b0087b043 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:11.474326 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-676eb0cc-3a0a-4a83-a05c-6a3b0087b043 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:11.484438 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-676eb0cc-3a0a-4a83-a05c-6a3b0087b043 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.235399 May 10 21:10:11.486143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 101/189] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:11 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:12.503157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b3951122-fa9e-4479-a89c-432364029a5d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:12.503914 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b3951122-fa9e-4479-a89c-432364029a5d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:12.510139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3951122-fa9e-4479-a89c-432364029a5d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:12.510580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3951122-fa9e-4479-a89c-432364029a5d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:12.511374 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3951122-fa9e-4479-a89c-432364029a5d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:12.511804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3951122-fa9e-4479-a89c-432364029a5d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:12.649714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b3951122-fa9e-4479-a89c-432364029a5d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:12.657707 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b3951122-fa9e-4479-a89c-432364029a5d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.158731 May 10 21:10:12.658365 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 89/190] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:12 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:13.676983 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-4067f3f9-d737-4853-8e14-2b29d331eb81 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:13.677664 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-4067f3f9-d737-4853-8e14-2b29d331eb81 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:13.683853 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4067f3f9-d737-4853-8e14-2b29d331eb81 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:13.684304 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4067f3f9-d737-4853-8e14-2b29d331eb81 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:13.685154 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4067f3f9-d737-4853-8e14-2b29d331eb81 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:13.685592 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4067f3f9-d737-4853-8e14-2b29d331eb81 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:13.816965 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-4067f3f9-d737-4853-8e14-2b29d331eb81 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:13.824524 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-4067f3f9-d737-4853-8e14-2b29d331eb81 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.153644 May 10 21:10:13.825101 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 102/191] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:13 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:10:14.015826 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-52929bea-7709-4288-8267-147b58747d9a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1824966403", "imageRef": "cb321ccf-1ce7-4dda-90d0-f05332eb6fe1", "flavorRef": "452", "networks": [{"uuid": "2f3240e6-359e-4de0-ab8c-6c2518aa9713"}]}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:10:14.077973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.network.neutron [None req-52929bea-7709-4288-8267-147b58747d9a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] validate_networks() for [('2f3240e6-359e-4de0-ab8c-6c2518aa9713', None, None, None, None, None)] {{(pid=117714) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:10:14.426656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-52929bea-7709-4288-8267-147b58747d9a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Flavor limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:10:14.427079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-52929bea-7709-4288-8267-147b58747d9a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Image limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:10:14.427609 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-52929bea-7709-4288-8267-147b58747d9a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Flavor pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:10:14.428017 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-52929bea-7709-4288-8267-147b58747d9a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Image pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:10:14.428660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-52929bea-7709-4288-8267-147b58747d9a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:10:14.437813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52929bea-7709-4288-8267-147b58747d9a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:14.438258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52929bea-7709-4288-8267-147b58747d9a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:14.440353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52929bea-7709-4288-8267-147b58747d9a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:14.440796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52929bea-7709-4288-8267-147b58747d9a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:14.458586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-52929bea-7709-4288-8267-147b58747d9a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Getting quotas for project b51f628be6144a698276671df56eac18. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:10:14.462573 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-52929bea-7709-4288-8267-147b58747d9a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Getting quotas for user 842fa4b1c86e4c208ab1f1f119d3bdd8 and project b51f628be6144a698276671df56eac18. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:10:14.473829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-52929bea-7709-4288-8267-147b58747d9a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Going to run 1 instances... {{(pid=117714) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:10:14.476110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-52929bea-7709-4288-8267-147b58747d9a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb321ccf-1ce7-4dda-90d0-f05332eb6fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117714) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:10:14.611924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-52929bea-7709-4288-8267-147b58747d9a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599783 May 10 21:10:14.612832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 90/192] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 21:10:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 21:10:14.622621 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a839d798-4a3d-4dfc-86af-57230f0bf926 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:14.623319 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a839d798-4a3d-4dfc-86af-57230f0bf926 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:14.680785 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-a839d798-4a3d-4dfc-86af-57230f0bf926 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:14.687768 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a839d798-4a3d-4dfc-86af-57230f0bf926 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109" status: 200 len: 1219 microversion: 2.1 time: 0.068997 May 10 21:10:14.688402 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 103/193] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:14 2022] GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:14.840914 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e30234ae-3b85-41bc-80a6-cd9775199f84 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:14.841841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e30234ae-3b85-41bc-80a6-cd9775199f84 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:14.848900 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e30234ae-3b85-41bc-80a6-cd9775199f84 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:14.849354 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e30234ae-3b85-41bc-80a6-cd9775199f84 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:14.850140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e30234ae-3b85-41bc-80a6-cd9775199f84 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:14.850556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e30234ae-3b85-41bc-80a6-cd9775199f84 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:14.984944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e30234ae-3b85-41bc-80a6-cd9775199f84 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:14.993619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e30234ae-3b85-41bc-80a6-cd9775199f84 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.156853 May 10 21:10:14.994182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 91/194] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:14 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:15.708017 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e7e6b4f4-490b-4029-9a93-7446c833cb8f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:15.708664 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e7e6b4f4-490b-4029-9a93-7446c833cb8f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:15.716660 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e7e6b4f4-490b-4029-9a93-7446c833cb8f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:15.717381 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e7e6b4f4-490b-4029-9a93-7446c833cb8f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:15.718634 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e7e6b4f4-490b-4029-9a93-7446c833cb8f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:15.719294 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e7e6b4f4-490b-4029-9a93-7446c833cb8f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:15.788536 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-e7e6b4f4-490b-4029-9a93-7446c833cb8f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:15.795911 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e7e6b4f4-490b-4029-9a93-7446c833cb8f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109" status: 200 len: 1223 microversion: 2.1 time: 0.093650 May 10 21:10:15.796511 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 104/195] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:15 2022] GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109 => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:16.012755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8dd832b0-c094-456e-bdaa-ff397ffae9c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:16.013537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8dd832b0-c094-456e-bdaa-ff397ffae9c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:16.022005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8dd832b0-c094-456e-bdaa-ff397ffae9c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:16.022604 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8dd832b0-c094-456e-bdaa-ff397ffae9c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:16.023593 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8dd832b0-c094-456e-bdaa-ff397ffae9c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:16.024123 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8dd832b0-c094-456e-bdaa-ff397ffae9c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:16.157220 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8dd832b0-c094-456e-bdaa-ff397ffae9c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:16.164962 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8dd832b0-c094-456e-bdaa-ff397ffae9c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.157232 May 10 21:10:16.165535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 92/196] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:16 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:16.813215 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-8ba77acd-ccdb-4df0-a0e9-ad4f9769180c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:16.813750 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-8ba77acd-ccdb-4df0-a0e9-ad4f9769180c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:16.819694 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8ba77acd-ccdb-4df0-a0e9-ad4f9769180c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:16.820137 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8ba77acd-ccdb-4df0-a0e9-ad4f9769180c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:16.820888 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8ba77acd-ccdb-4df0-a0e9-ad4f9769180c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:16.821320 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8ba77acd-ccdb-4df0-a0e9-ad4f9769180c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:16.880737 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-8ba77acd-ccdb-4df0-a0e9-ad4f9769180c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:16.888861 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-8ba77acd-ccdb-4df0-a0e9-ad4f9769180c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109" status: 200 len: 1215 microversion: 2.1 time: 0.078922 May 10 21:10:16.888861 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 105/197] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:16 2022] GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109 => generated 1215 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:17.181711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d6a43b06-6fe6-4315-b347-26db965c5df5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:17.182327 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d6a43b06-6fe6-4315-b347-26db965c5df5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:17.189547 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6a43b06-6fe6-4315-b347-26db965c5df5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:17.190005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6a43b06-6fe6-4315-b347-26db965c5df5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:17.190784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6a43b06-6fe6-4315-b347-26db965c5df5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:17.191247 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6a43b06-6fe6-4315-b347-26db965c5df5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:17.319567 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d6a43b06-6fe6-4315-b347-26db965c5df5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:17.326901 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d6a43b06-6fe6-4315-b347-26db965c5df5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.149108 May 10 21:10:17.327512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 93/198] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:17 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:17.909429 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-5c3424aa-6196-479c-a357-0d51f985d239 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:17.910053 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5c3424aa-6196-479c-a357-0d51f985d239 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:17.919552 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5c3424aa-6196-479c-a357-0d51f985d239 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:17.919552 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5c3424aa-6196-479c-a357-0d51f985d239 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:17.919552 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5c3424aa-6196-479c-a357-0d51f985d239 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:17.919552 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5c3424aa-6196-479c-a357-0d51f985d239 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:17.981812 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-5c3424aa-6196-479c-a357-0d51f985d239 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:17.990767 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-5c3424aa-6196-479c-a357-0d51f985d239 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109" status: 200 len: 1215 microversion: 2.1 time: 0.086157 May 10 21:10:17.991361 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 106/199] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:17 2022] GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109 => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:10:18.344260 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dee9d6fd-ae20-4053-8536-fa5d049d750c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:18.344869 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dee9d6fd-ae20-4053-8536-fa5d049d750c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:18.352044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dee9d6fd-ae20-4053-8536-fa5d049d750c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:18.352492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dee9d6fd-ae20-4053-8536-fa5d049d750c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:18.353256 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dee9d6fd-ae20-4053-8536-fa5d049d750c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:18.353694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dee9d6fd-ae20-4053-8536-fa5d049d750c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:18.480969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dee9d6fd-ae20-4053-8536-fa5d049d750c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:18.488823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dee9d6fd-ae20-4053-8536-fa5d049d750c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.148447 May 10 21:10:18.489388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 94/200] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:18 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:19.008266 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-90a59beb-5b71-433b-bbbc-c58d5524ec94 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:19.009050 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-90a59beb-5b71-433b-bbbc-c58d5524ec94 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:19.015319 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-90a59beb-5b71-433b-bbbc-c58d5524ec94 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:19.015783 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-90a59beb-5b71-433b-bbbc-c58d5524ec94 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:19.016563 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-90a59beb-5b71-433b-bbbc-c58d5524ec94 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:19.017002 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-90a59beb-5b71-433b-bbbc-c58d5524ec94 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:19.078336 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-90a59beb-5b71-433b-bbbc-c58d5524ec94 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:19.085802 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-90a59beb-5b71-433b-bbbc-c58d5524ec94 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109" status: 200 len: 1215 microversion: 2.1 time: 0.081563 May 10 21:10:19.086367 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 107/201] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:19 2022] GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109 => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:19.506159 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8bdf8013-1142-4b46-a0b0-0372587ff33e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:19.506780 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8bdf8013-1142-4b46-a0b0-0372587ff33e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:19.513525 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8bdf8013-1142-4b46-a0b0-0372587ff33e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:19.513974 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8bdf8013-1142-4b46-a0b0-0372587ff33e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:19.514768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8bdf8013-1142-4b46-a0b0-0372587ff33e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:19.515233 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8bdf8013-1142-4b46-a0b0-0372587ff33e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:19.659047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8bdf8013-1142-4b46-a0b0-0372587ff33e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:19.664763 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8bdf8013-1142-4b46-a0b0-0372587ff33e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.162961 May 10 21:10:19.674224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 95/202] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:19 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:20.103414 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-81cf0a3e-f220-4baa-b6a8-f3a3340fe3d8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:20.104562 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-81cf0a3e-f220-4baa-b6a8-f3a3340fe3d8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:20.110465 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-81cf0a3e-f220-4baa-b6a8-f3a3340fe3d8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:20.110919 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-81cf0a3e-f220-4baa-b6a8-f3a3340fe3d8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:20.112099 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-81cf0a3e-f220-4baa-b6a8-f3a3340fe3d8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:20.112542 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-81cf0a3e-f220-4baa-b6a8-f3a3340fe3d8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:20.202649 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-81cf0a3e-f220-4baa-b6a8-f3a3340fe3d8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:20.210760 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-81cf0a3e-f220-4baa-b6a8-f3a3340fe3d8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109" status: 200 len: 1277 microversion: 2.1 time: 0.112157 May 10 21:10:20.211349 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 108/203] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:20 2022] GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109 => generated 1277 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:20.681501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7551e456-bfcc-4b56-94d4-7d77e7f59924 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:20.688796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7551e456-bfcc-4b56-94d4-7d77e7f59924 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:20.689290 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7551e456-bfcc-4b56-94d4-7d77e7f59924 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:20.690369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7551e456-bfcc-4b56-94d4-7d77e7f59924 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:20.691173 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7551e456-bfcc-4b56-94d4-7d77e7f59924 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:20.691618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7551e456-bfcc-4b56-94d4-7d77e7f59924 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:20.890741 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7551e456-bfcc-4b56-94d4-7d77e7f59924 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:20.906153 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7551e456-bfcc-4b56-94d4-7d77e7f59924 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.221984 May 10 21:10:20.906153 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 96/204] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:20 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:21.228052 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-897ce67d-7877-4c1d-b324-db3ff5316d50 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:21.228680 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-897ce67d-7877-4c1d-b324-db3ff5316d50 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:21.234673 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-897ce67d-7877-4c1d-b324-db3ff5316d50 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:21.235162 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-897ce67d-7877-4c1d-b324-db3ff5316d50 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:21.235938 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-897ce67d-7877-4c1d-b324-db3ff5316d50 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:21.236916 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-897ce67d-7877-4c1d-b324-db3ff5316d50 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:21.369411 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-897ce67d-7877-4c1d-b324-db3ff5316d50 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:21.376700 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-897ce67d-7877-4c1d-b324-db3ff5316d50 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109" status: 200 len: 1319 microversion: 2.1 time: 0.152531 May 10 21:10:21.378571 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 109/205] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:21 2022] GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:21.921983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-38d98905-45be-473a-8245-d8a420ad4fbc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:21.922633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-38d98905-45be-473a-8245-d8a420ad4fbc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:21.929240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38d98905-45be-473a-8245-d8a420ad4fbc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:21.929691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38d98905-45be-473a-8245-d8a420ad4fbc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:21.930470 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38d98905-45be-473a-8245-d8a420ad4fbc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:21.930973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38d98905-45be-473a-8245-d8a420ad4fbc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:22.124606 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [req-9c5e85b5-ec84-4e1c-a9fa-c6ad9a235203 req-250be45e-9f7b-4a1a-adec-645b61fe5841 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbfaa131-2006-47ea-823a-ec96bb872109", "tag": "16470672-b800-4ec1-a6ce-4e13346ab757"}]} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:10:22.139675 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-9c5e85b5-ec84-4e1c-a9fa-c6ad9a235203 req-250be45e-9f7b-4a1a-adec-645b61fe5841 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:22.140116 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-9c5e85b5-ec84-4e1c-a9fa-c6ad9a235203 req-250be45e-9f7b-4a1a-adec-645b61fe5841 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:22.146662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-38d98905-45be-473a-8245-d8a420ad4fbc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:22.154329 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.compute.server_external_events [req-9c5e85b5-ec84-4e1c-a9fa-c6ad9a235203 req-250be45e-9f7b-4a1a-adec-645b61fe5841 service nova] Creating event network-changed:16470672-b800-4ec1-a6ce-4e13346ab757 for instance dbfaa131-2006-47ea-823a-ec96bb872109 on hv-cinder-82880 May 10 21:10:22.154815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-38d98905-45be-473a-8245-d8a420ad4fbc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.236647 May 10 21:10:22.155444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 97/206] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:21 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:22.163223 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [req-9c5e85b5-ec84-4e1c-a9fa-c6ad9a235203 req-250be45e-9f7b-4a1a-adec-645b61fe5841 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039480 May 10 21:10:22.163223 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 110/207] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:10:22.395070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bdda64d1-1a97-4acc-821f-06de681a527b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:22.395829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bdda64d1-1a97-4acc-821f-06de681a527b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:22.402133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bdda64d1-1a97-4acc-821f-06de681a527b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:22.402705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bdda64d1-1a97-4acc-821f-06de681a527b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:22.403698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bdda64d1-1a97-4acc-821f-06de681a527b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:22.404294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bdda64d1-1a97-4acc-821f-06de681a527b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:22.591187 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bdda64d1-1a97-4acc-821f-06de681a527b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:22.599631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bdda64d1-1a97-4acc-821f-06de681a527b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109" status: 200 len: 1319 microversion: 2.1 time: 0.209753 May 10 21:10:22.600222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 98/208] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:22 2022] GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:23.179916 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e32a688a-85da-4079-b136-c741da77e0fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:23.179916 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e32a688a-85da-4079-b136-c741da77e0fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:23.183506 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e32a688a-85da-4079-b136-c741da77e0fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:23.183954 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e32a688a-85da-4079-b136-c741da77e0fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:23.184716 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e32a688a-85da-4079-b136-c741da77e0fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:23.185151 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e32a688a-85da-4079-b136-c741da77e0fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:23.318221 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-e32a688a-85da-4079-b136-c741da77e0fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:23.325506 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e32a688a-85da-4079-b136-c741da77e0fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.155465 May 10 21:10:23.326063 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 111/209] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:23 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:23.616608 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-835fdd18-cf6f-4fc5-8a3b-782483a0b7eb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:23.617209 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-835fdd18-cf6f-4fc5-8a3b-782483a0b7eb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:23.624023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-835fdd18-cf6f-4fc5-8a3b-782483a0b7eb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:23.624480 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-835fdd18-cf6f-4fc5-8a3b-782483a0b7eb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:23.625295 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-835fdd18-cf6f-4fc5-8a3b-782483a0b7eb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:23.625769 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-835fdd18-cf6f-4fc5-8a3b-782483a0b7eb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:23.780411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-835fdd18-cf6f-4fc5-8a3b-782483a0b7eb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:23.788325 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-835fdd18-cf6f-4fc5-8a3b-782483a0b7eb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109" status: 200 len: 1319 microversion: 2.1 time: 0.175912 May 10 21:10:23.788805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 99/210] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:23 2022] GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:24.342006 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-49d9e85d-bb4b-49dd-b2d4-970eda5249ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:24.342708 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-49d9e85d-bb4b-49dd-b2d4-970eda5249ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:24.349318 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-49d9e85d-bb4b-49dd-b2d4-970eda5249ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:24.349772 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-49d9e85d-bb4b-49dd-b2d4-970eda5249ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:24.350726 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-49d9e85d-bb4b-49dd-b2d4-970eda5249ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:24.351190 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-49d9e85d-bb4b-49dd-b2d4-970eda5249ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:24.499887 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-49d9e85d-bb4b-49dd-b2d4-970eda5249ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:24.507467 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-49d9e85d-bb4b-49dd-b2d4-970eda5249ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.169434 May 10 21:10:24.508037 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 112/211] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:24 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:24.806890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-85631bde-b7f5-4da6-aa42-d1f777ae67c2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:24.807583 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-85631bde-b7f5-4da6-aa42-d1f777ae67c2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:24.814212 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-85631bde-b7f5-4da6-aa42-d1f777ae67c2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:24.814789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-85631bde-b7f5-4da6-aa42-d1f777ae67c2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:24.815722 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-85631bde-b7f5-4da6-aa42-d1f777ae67c2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:24.816161 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-85631bde-b7f5-4da6-aa42-d1f777ae67c2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:24.958868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-85631bde-b7f5-4da6-aa42-d1f777ae67c2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:24.966190 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-85631bde-b7f5-4da6-aa42-d1f777ae67c2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109" status: 200 len: 1319 microversion: 2.1 time: 0.164179 May 10 21:10:24.966758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 100/212] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:24 2022] GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:25.525178 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-8b20a7b4-6634-4cf8-a7c5-fc500cd9a1a8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:25.525877 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-8b20a7b4-6634-4cf8-a7c5-fc500cd9a1a8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:25.531690 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8b20a7b4-6634-4cf8-a7c5-fc500cd9a1a8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:25.532142 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8b20a7b4-6634-4cf8-a7c5-fc500cd9a1a8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:25.532909 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8b20a7b4-6634-4cf8-a7c5-fc500cd9a1a8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:25.533428 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8b20a7b4-6634-4cf8-a7c5-fc500cd9a1a8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:25.687163 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-8b20a7b4-6634-4cf8-a7c5-fc500cd9a1a8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:25.695706 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-8b20a7b4-6634-4cf8-a7c5-fc500cd9a1a8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.174392 May 10 21:10:25.696348 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 113/213] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:25 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:25.984951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b8d8b083-4a31-4cb6-88a0-eab8f2649637 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:25.986436 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b8d8b083-4a31-4cb6-88a0-eab8f2649637 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:25.997523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b8d8b083-4a31-4cb6-88a0-eab8f2649637 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:25.998244 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b8d8b083-4a31-4cb6-88a0-eab8f2649637 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:25.999301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b8d8b083-4a31-4cb6-88a0-eab8f2649637 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:26.000358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b8d8b083-4a31-4cb6-88a0-eab8f2649637 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:26.166267 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b8d8b083-4a31-4cb6-88a0-eab8f2649637 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:26.174651 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b8d8b083-4a31-4cb6-88a0-eab8f2649637 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109" status: 200 len: 1319 microversion: 2.1 time: 0.193092 May 10 21:10:26.175844 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 101/214] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:25 2022] GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:26.712735 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9bf793a8-f314-4671-8fe4-5f2c9f9daf90 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:26.714005 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-9bf793a8-f314-4671-8fe4-5f2c9f9daf90 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:26.723571 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9bf793a8-f314-4671-8fe4-5f2c9f9daf90 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:26.724141 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9bf793a8-f314-4671-8fe4-5f2c9f9daf90 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:26.725016 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9bf793a8-f314-4671-8fe4-5f2c9f9daf90 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:26.725582 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9bf793a8-f314-4671-8fe4-5f2c9f9daf90 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:26.865356 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-9bf793a8-f314-4671-8fe4-5f2c9f9daf90 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:26.872913 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9bf793a8-f314-4671-8fe4-5f2c9f9daf90 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1522 microversion: 2.1 time: 0.164415 May 10 21:10:26.880889 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 114/215] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:26 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:27.194915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c62831e3-414b-44b0-86cc-9cf947f3c561 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:27.196680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c62831e3-414b-44b0-86cc-9cf947f3c561 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:27.205561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c62831e3-414b-44b0-86cc-9cf947f3c561 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:27.206317 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c62831e3-414b-44b0-86cc-9cf947f3c561 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:27.207090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c62831e3-414b-44b0-86cc-9cf947f3c561 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:27.207609 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c62831e3-414b-44b0-86cc-9cf947f3c561 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:27.355721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c62831e3-414b-44b0-86cc-9cf947f3c561 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:27.364447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c62831e3-414b-44b0-86cc-9cf947f3c561 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109" status: 200 len: 1319 microversion: 2.1 time: 0.176031 May 10 21:10:27.365026 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 102/216] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:27 2022] GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:27.889909 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6c25cd44-ae39-4f82-acfc-a3c96a08a2ad tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:27.890540 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6c25cd44-ae39-4f82-acfc-a3c96a08a2ad tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:27.897899 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6c25cd44-ae39-4f82-acfc-a3c96a08a2ad tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:27.898380 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6c25cd44-ae39-4f82-acfc-a3c96a08a2ad tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:27.899168 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6c25cd44-ae39-4f82-acfc-a3c96a08a2ad tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:27.899609 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6c25cd44-ae39-4f82-acfc-a3c96a08a2ad tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:28.030098 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-6c25cd44-ae39-4f82-acfc-a3c96a08a2ad tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:28.038535 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6c25cd44-ae39-4f82-acfc-a3c96a08a2ad tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1502 microversion: 2.1 time: 0.152670 May 10 21:10:28.039105 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 115/217] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:27 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:28.055160 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-02c40c84-b503-4da0-ba7b-32476edc474d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:28.055802 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-02c40c84-b503-4da0-ba7b-32476edc474d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:28.062282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-02c40c84-b503-4da0-ba7b-32476edc474d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:28.062734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-02c40c84-b503-4da0-ba7b-32476edc474d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:28.063606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-02c40c84-b503-4da0-ba7b-32476edc474d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:28.064003 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-02c40c84-b503-4da0-ba7b-32476edc474d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:28.198191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-02c40c84-b503-4da0-ba7b-32476edc474d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:28.210053 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-02c40c84-b503-4da0-ba7b-32476edc474d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1516 microversion: 2.1 time: 0.158760 May 10 21:10:28.210720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 103/218] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:28 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:28.384184 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-5309f171-b621-4acf-8633-58b314ab8650 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:28.384793 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5309f171-b621-4acf-8633-58b314ab8650 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:28.390972 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5309f171-b621-4acf-8633-58b314ab8650 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:28.391428 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5309f171-b621-4acf-8633-58b314ab8650 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:28.392185 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5309f171-b621-4acf-8633-58b314ab8650 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:28.393409 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5309f171-b621-4acf-8633-58b314ab8650 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:28.526483 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-5309f171-b621-4acf-8633-58b314ab8650 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:28.534991 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-5309f171-b621-4acf-8633-58b314ab8650 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109" status: 200 len: 1319 microversion: 2.1 time: 0.154796 May 10 21:10:28.535603 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 116/219] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:28 2022] GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:28.639792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-bd12f027-c871-4304-bf86-ab64c7f06967 req-81cbae43-3856-4778-9db5-5b2328dc3f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbfaa131-2006-47ea-823a-ec96bb872109", "name": "network-vif-plugged", "status": "completed", "tag": "16470672-b800-4ec1-a6ce-4e13346ab757"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:10:28.648858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-bd12f027-c871-4304-bf86-ab64c7f06967 req-81cbae43-3856-4778-9db5-5b2328dc3f11 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:28.649407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-bd12f027-c871-4304-bf86-ab64c7f06967 req-81cbae43-3856-4778-9db5-5b2328dc3f11 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:28.661353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-bd12f027-c871-4304-bf86-ab64c7f06967 req-81cbae43-3856-4778-9db5-5b2328dc3f11 service nova] Creating event network-vif-plugged:16470672-b800-4ec1-a6ce-4e13346ab757 for instance dbfaa131-2006-47ea-823a-ec96bb872109 on hv-cinder-82880 May 10 21:10:28.666590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-bd12f027-c871-4304-bf86-ab64c7f06967 req-81cbae43-3856-4778-9db5-5b2328dc3f11 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030491 May 10 21:10:28.667213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 104/220] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:10:29.551947 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-cdbaa82f-b06d-41ac-ad8f-0eb4ef5827c8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:29.552590 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-cdbaa82f-b06d-41ac-ad8f-0eb4ef5827c8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:29.558580 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cdbaa82f-b06d-41ac-ad8f-0eb4ef5827c8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:29.559024 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cdbaa82f-b06d-41ac-ad8f-0eb4ef5827c8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:29.559822 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cdbaa82f-b06d-41ac-ad8f-0eb4ef5827c8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:29.560259 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cdbaa82f-b06d-41ac-ad8f-0eb4ef5827c8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:29.695411 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-cdbaa82f-b06d-41ac-ad8f-0eb4ef5827c8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:29.702829 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-cdbaa82f-b06d-41ac-ad8f-0eb4ef5827c8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109" status: 200 len: 1319 microversion: 2.1 time: 0.155307 May 10 21:10:29.703441 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 117/221] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:29 2022] GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:30.322368 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cb824198-36e4-4f11-b8e2-1047c476686d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:10:30.326220 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cb824198-36e4-4f11-b8e2-1047c476686d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:30.329651 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb824198-36e4-4f11-b8e2-1047c476686d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:30.330102 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb824198-36e4-4f11-b8e2-1047c476686d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:30.330859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb824198-36e4-4f11-b8e2-1047c476686d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:30.331322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb824198-36e4-4f11-b8e2-1047c476686d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:30.354443 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.objects.instance [None req-cb824198-36e4-4f11-b8e2-1047c476686d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lazy-loading 'flavor' on Instance uuid 2ee5480a-213a-489e-a366-5ffa59cf5487 {{(pid=117714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:10:30.657995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cb824198-36e4-4f11-b8e2-1047c476686d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "POST /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487/action" status: 200 len: 32 microversion: 2.1 time: 0.340406 May 10 21:10:30.658882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 105/222] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 21:10:30 2022] POST /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487/action => generated 32 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 21:10:30.669066 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-bbd3a05f-62e3-4368-938b-0c4fbae6061e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:30.669747 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-bbd3a05f-62e3-4368-938b-0c4fbae6061e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:30.676425 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bbd3a05f-62e3-4368-938b-0c4fbae6061e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:30.676873 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bbd3a05f-62e3-4368-938b-0c4fbae6061e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:30.677642 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bbd3a05f-62e3-4368-938b-0c4fbae6061e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:30.678078 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bbd3a05f-62e3-4368-938b-0c4fbae6061e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:30.720905 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-099031bf-395e-4202-9fce-a6562e4b0cc2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:30.721618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-099031bf-395e-4202-9fce-a6562e4b0cc2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:30.728653 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-099031bf-395e-4202-9fce-a6562e4b0cc2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:30.729111 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-099031bf-395e-4202-9fce-a6562e4b0cc2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:30.729955 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-099031bf-395e-4202-9fce-a6562e4b0cc2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:30.730399 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-099031bf-395e-4202-9fce-a6562e4b0cc2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:30.820724 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-bbd3a05f-62e3-4368-938b-0c4fbae6061e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:30.834551 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-bbd3a05f-62e3-4368-938b-0c4fbae6061e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1522 microversion: 2.1 time: 0.169350 May 10 21:10:30.856428 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 118/223] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:30 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:30.931213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-099031bf-395e-4202-9fce-a6562e4b0cc2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:30.940786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-099031bf-395e-4202-9fce-a6562e4b0cc2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109" status: 200 len: 1319 microversion: 2.1 time: 0.224051 May 10 21:10:30.954432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 106/224] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:30 2022] GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:31.873618 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-42677f84-8a17-431c-a4f0-725f43f5212c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:31.874231 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-42677f84-8a17-431c-a4f0-725f43f5212c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:31.880685 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-42677f84-8a17-431c-a4f0-725f43f5212c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:31.881199 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-42677f84-8a17-431c-a4f0-725f43f5212c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:31.881986 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-42677f84-8a17-431c-a4f0-725f43f5212c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:31.882428 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-42677f84-8a17-431c-a4f0-725f43f5212c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:31.958576 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3e056f88-5166-4258-89dd-86c950a33e13 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:31.964871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3e056f88-5166-4258-89dd-86c950a33e13 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:31.966097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3e056f88-5166-4258-89dd-86c950a33e13 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:31.966552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3e056f88-5166-4258-89dd-86c950a33e13 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:31.967422 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3e056f88-5166-4258-89dd-86c950a33e13 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:31.967867 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3e056f88-5166-4258-89dd-86c950a33e13 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:32.067430 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-42677f84-8a17-431c-a4f0-725f43f5212c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:32.076728 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-42677f84-8a17-431c-a4f0-725f43f5212c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1522 microversion: 2.1 time: 0.207026 May 10 21:10:32.077550 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 119/225] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:31 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:32.155981 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3e056f88-5166-4258-89dd-86c950a33e13 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:32.163973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3e056f88-5166-4258-89dd-86c950a33e13 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109" status: 200 len: 1509 microversion: 2.1 time: 0.210152 May 10 21:10:32.165687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 107/226] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:31 2022] GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109 => generated 1509 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:10:33.094085 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-cc20f336-17b4-49e1-9a5f-63fcb8b1bfcb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:33.094690 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-cc20f336-17b4-49e1-9a5f-63fcb8b1bfcb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:33.100825 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cc20f336-17b4-49e1-9a5f-63fcb8b1bfcb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:33.101270 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cc20f336-17b4-49e1-9a5f-63fcb8b1bfcb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:33.102204 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cc20f336-17b4-49e1-9a5f-63fcb8b1bfcb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:33.102641 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cc20f336-17b4-49e1-9a5f-63fcb8b1bfcb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:33.237713 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-cc20f336-17b4-49e1-9a5f-63fcb8b1bfcb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:33.245828 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-cc20f336-17b4-49e1-9a5f-63fcb8b1bfcb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1522 microversion: 2.1 time: 0.155699 May 10 21:10:33.246562 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 120/227] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:33 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:34.263829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-00195cff-42d7-42e8-b651-add6a74d6d9a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:34.264618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-00195cff-42d7-42e8-b651-add6a74d6d9a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:34.272124 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-00195cff-42d7-42e8-b651-add6a74d6d9a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:34.273723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-00195cff-42d7-42e8-b651-add6a74d6d9a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:34.273723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-00195cff-42d7-42e8-b651-add6a74d6d9a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:34.273900 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-00195cff-42d7-42e8-b651-add6a74d6d9a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:34.411156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-00195cff-42d7-42e8-b651-add6a74d6d9a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:34.418737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-00195cff-42d7-42e8-b651-add6a74d6d9a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1522 microversion: 2.1 time: 0.159002 May 10 21:10:34.419341 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 108/228] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:34 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:10:35.435854 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-4bed690e-25e3-4431-876f-a8f410857a8f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:35.436443 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-4bed690e-25e3-4431-876f-a8f410857a8f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:35.443366 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4bed690e-25e3-4431-876f-a8f410857a8f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:35.443820 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4bed690e-25e3-4431-876f-a8f410857a8f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:35.444619 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4bed690e-25e3-4431-876f-a8f410857a8f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:35.445058 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4bed690e-25e3-4431-876f-a8f410857a8f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:35.580034 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-4bed690e-25e3-4431-876f-a8f410857a8f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:35.588182 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-4bed690e-25e3-4431-876f-a8f410857a8f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1522 microversion: 2.1 time: 0.156350 May 10 21:10:35.589667 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 121/229] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:35 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:35.863762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3d01c525-f238-43c3-8561-ada760deaf33 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-367399356", "imageRef": "cb321ccf-1ce7-4dda-90d0-f05332eb6fe1", "flavorRef": "452"}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:10:36.606244 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-baa12bce-3e23-4dff-84f4-9816aaad223d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:36.606861 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-baa12bce-3e23-4dff-84f4-9816aaad223d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:36.613122 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-baa12bce-3e23-4dff-84f4-9816aaad223d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:36.613564 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-baa12bce-3e23-4dff-84f4-9816aaad223d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:36.614331 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-baa12bce-3e23-4dff-84f4-9816aaad223d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:36.615423 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-baa12bce-3e23-4dff-84f4-9816aaad223d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:36.742392 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-baa12bce-3e23-4dff-84f4-9816aaad223d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:36.750938 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-baa12bce-3e23-4dff-84f4-9816aaad223d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1522 microversion: 2.1 time: 0.148520 May 10 21:10:36.751551 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 122/230] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:36 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:37.768536 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-7ddcfae5-1128-43d4-a7b0-09e5cab24b28 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:37.769154 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-7ddcfae5-1128-43d4-a7b0-09e5cab24b28 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:37.774994 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7ddcfae5-1128-43d4-a7b0-09e5cab24b28 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:37.775480 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7ddcfae5-1128-43d4-a7b0-09e5cab24b28 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:37.776256 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7ddcfae5-1128-43d4-a7b0-09e5cab24b28 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:37.776699 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7ddcfae5-1128-43d4-a7b0-09e5cab24b28 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:37.920014 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-7ddcfae5-1128-43d4-a7b0-09e5cab24b28 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:37.927823 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-7ddcfae5-1128-43d4-a7b0-09e5cab24b28 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1522 microversion: 2.1 time: 0.163134 May 10 21:10:37.928388 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 123/231] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:37 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:10:38.949212 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-24828f3a-1792-4cac-be82-72962de2c94f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:38.949827 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-24828f3a-1792-4cac-be82-72962de2c94f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:38.955758 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-24828f3a-1792-4cac-be82-72962de2c94f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:38.956200 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-24828f3a-1792-4cac-be82-72962de2c94f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:38.961300 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-24828f3a-1792-4cac-be82-72962de2c94f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:38.961300 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-24828f3a-1792-4cac-be82-72962de2c94f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:39.091268 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-24828f3a-1792-4cac-be82-72962de2c94f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:39.099717 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-24828f3a-1792-4cac-be82-72962de2c94f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1522 microversion: 2.1 time: 0.155431 May 10 21:10:39.100279 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 124/232] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:38 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:10:40.117930 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c9b887e6-a831-46d0-b0b5-440340cd74c2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:40.118591 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c9b887e6-a831-46d0-b0b5-440340cd74c2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:40.125216 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c9b887e6-a831-46d0-b0b5-440340cd74c2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:40.125719 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c9b887e6-a831-46d0-b0b5-440340cd74c2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:40.126504 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c9b887e6-a831-46d0-b0b5-440340cd74c2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:40.126947 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c9b887e6-a831-46d0-b0b5-440340cd74c2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:40.255114 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-c9b887e6-a831-46d0-b0b5-440340cd74c2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:40.264155 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c9b887e6-a831-46d0-b0b5-440340cd74c2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1522 microversion: 2.1 time: 0.150522 May 10 21:10:40.266376 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 125/233] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:40 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:10:41.281040 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d30acaa0-b6f3-49bd-b518-eeac6c095cd3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:41.281673 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d30acaa0-b6f3-49bd-b518-eeac6c095cd3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:41.287581 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d30acaa0-b6f3-49bd-b518-eeac6c095cd3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:41.288009 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d30acaa0-b6f3-49bd-b518-eeac6c095cd3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:41.288765 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d30acaa0-b6f3-49bd-b518-eeac6c095cd3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:41.289295 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d30acaa0-b6f3-49bd-b518-eeac6c095cd3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:41.419359 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-d30acaa0-b6f3-49bd-b518-eeac6c095cd3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:41.426777 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d30acaa0-b6f3-49bd-b518-eeac6c095cd3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1522 microversion: 2.1 time: 0.149525 May 10 21:10:41.427382 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 126/234] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:41 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:10:42.444090 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-cce79459-0b37-4fe8-95c6-1982957ab66b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:42.444720 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-cce79459-0b37-4fe8-95c6-1982957ab66b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:42.450738 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cce79459-0b37-4fe8-95c6-1982957ab66b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:42.451223 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cce79459-0b37-4fe8-95c6-1982957ab66b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:42.451982 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cce79459-0b37-4fe8-95c6-1982957ab66b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:42.452417 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cce79459-0b37-4fe8-95c6-1982957ab66b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:42.724927 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-cce79459-0b37-4fe8-95c6-1982957ab66b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:42.733303 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-cce79459-0b37-4fe8-95c6-1982957ab66b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1522 microversion: 2.1 time: 0.293011 May 10 21:10:42.734670 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 127/235] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:42 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:10:43.750925 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-64137fc0-27c4-4080-8219-90b910f35843 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:43.751694 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-64137fc0-27c4-4080-8219-90b910f35843 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:43.758419 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-64137fc0-27c4-4080-8219-90b910f35843 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:43.759597 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-64137fc0-27c4-4080-8219-90b910f35843 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:43.760489 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-64137fc0-27c4-4080-8219-90b910f35843 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:43.760927 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-64137fc0-27c4-4080-8219-90b910f35843 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:43.890147 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-64137fc0-27c4-4080-8219-90b910f35843 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:43.897625 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-64137fc0-27c4-4080-8219-90b910f35843 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1522 microversion: 2.1 time: 0.150701 May 10 21:10:43.900582 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 128/236] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:43 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:10:44.916825 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-ab922ab9-eec8-451e-862f-68e8cbbd242f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:44.917897 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-ab922ab9-eec8-451e-862f-68e8cbbd242f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:44.924694 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ab922ab9-eec8-451e-862f-68e8cbbd242f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:44.925140 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ab922ab9-eec8-451e-862f-68e8cbbd242f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:44.925920 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ab922ab9-eec8-451e-862f-68e8cbbd242f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:44.926356 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ab922ab9-eec8-451e-862f-68e8cbbd242f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:45.060733 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-ab922ab9-eec8-451e-862f-68e8cbbd242f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:45.069268 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-ab922ab9-eec8-451e-862f-68e8cbbd242f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1522 microversion: 2.1 time: 0.157811 May 10 21:10:45.069828 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 129/237] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:44 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:46.086500 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-83609d6b-2544-4ae0-83c5-5ed866f08cae tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:46.088180 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-83609d6b-2544-4ae0-83c5-5ed866f08cae tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:46.094549 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-83609d6b-2544-4ae0-83c5-5ed866f08cae tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:46.095000 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-83609d6b-2544-4ae0-83c5-5ed866f08cae tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:46.095789 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-83609d6b-2544-4ae0-83c5-5ed866f08cae tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:46.096236 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-83609d6b-2544-4ae0-83c5-5ed866f08cae tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:46.236375 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-83609d6b-2544-4ae0-83c5-5ed866f08cae tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:46.244414 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-83609d6b-2544-4ae0-83c5-5ed866f08cae tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1522 microversion: 2.1 time: 0.161899 May 10 21:10:46.244980 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 130/238] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:46 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:10:47.261415 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-24a883d3-1839-4f3d-9789-ac16eb5f3851 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:47.262027 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-24a883d3-1839-4f3d-9789-ac16eb5f3851 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:47.268080 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-24a883d3-1839-4f3d-9789-ac16eb5f3851 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:47.268592 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-24a883d3-1839-4f3d-9789-ac16eb5f3851 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:47.269373 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-24a883d3-1839-4f3d-9789-ac16eb5f3851 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:47.269810 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-24a883d3-1839-4f3d-9789-ac16eb5f3851 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:47.402426 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-24a883d3-1839-4f3d-9789-ac16eb5f3851 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:47.409755 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-24a883d3-1839-4f3d-9789-ac16eb5f3851 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1522 microversion: 2.1 time: 0.152194 May 10 21:10:47.410314 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 131/239] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:47 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:10:47.813277 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.network.neutron [None req-3d01c525-f238-43c3-8561-ada760deaf33 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] validate_networks() for None {{(pid=117714) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:10:48.096244 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-3d01c525-f238-43c3-8561-ada760deaf33 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Flavor limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:10:48.096696 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-3d01c525-f238-43c3-8561-ada760deaf33 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Image limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:10:48.097166 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-3d01c525-f238-43c3-8561-ada760deaf33 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Flavor pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:10:48.097572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-3d01c525-f238-43c3-8561-ada760deaf33 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Image pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:10:48.097983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-3d01c525-f238-43c3-8561-ada760deaf33 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:10:48.106858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d01c525-f238-43c3-8561-ada760deaf33 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:48.107275 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d01c525-f238-43c3-8561-ada760deaf33 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:48.108069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d01c525-f238-43c3-8561-ada760deaf33 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:48.108508 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d01c525-f238-43c3-8561-ada760deaf33 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:48.125047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-3d01c525-f238-43c3-8561-ada760deaf33 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Getting quotas for project cdda59eab7384e89b971e2378d2d1397. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:10:48.129272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-3d01c525-f238-43c3-8561-ada760deaf33 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Getting quotas for user d60a202c34c9497da2e4b7be1f0f33cf and project cdda59eab7384e89b971e2378d2d1397. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:10:48.140858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3d01c525-f238-43c3-8561-ada760deaf33 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Going to run 1 instances... {{(pid=117714) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:10:48.143100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3d01c525-f238-43c3-8561-ada760deaf33 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb321ccf-1ce7-4dda-90d0-f05332eb6fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117714) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:10:48.253802 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3d01c525-f238-43c3-8561-ada760deaf33 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 12.393974 May 10 21:10:48.254449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 109/240] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 21:10:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 12395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 21:10:48.264698 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-849adbc8-7cb8-4a0f-aa54-95db41608e16 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:48.265323 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-849adbc8-7cb8-4a0f-aa54-95db41608e16 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:48.328646 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-849adbc8-7cb8-4a0f-aa54-95db41608e16 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a202c34c9497da2e4b7be1f0f33cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdda59eab7384e89b971e2378d2d1397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:48.337513 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-849adbc8-7cb8-4a0f-aa54-95db41608e16 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf" status: 200 len: 1214 microversion: 2.1 time: 0.076748 May 10 21:10:48.342401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 132/241] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:48 2022] GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:48.427762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d800c58d-e9c7-4247-a511-2092b99aff26 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:48.428413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d800c58d-e9c7-4247-a511-2092b99aff26 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:48.437875 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d800c58d-e9c7-4247-a511-2092b99aff26 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:48.438336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d800c58d-e9c7-4247-a511-2092b99aff26 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:48.439176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d800c58d-e9c7-4247-a511-2092b99aff26 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:48.439626 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d800c58d-e9c7-4247-a511-2092b99aff26 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:48.575733 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d800c58d-e9c7-4247-a511-2092b99aff26 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:48.583732 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d800c58d-e9c7-4247-a511-2092b99aff26 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1522 microversion: 2.1 time: 0.160021 May 10 21:10:48.584313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 110/242] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:48 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:49.342044 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-3fdc4684-0c55-4cda-86d7-f5624479ded2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:49.342730 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-3fdc4684-0c55-4cda-86d7-f5624479ded2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:49.349979 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3fdc4684-0c55-4cda-86d7-f5624479ded2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:49.349979 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3fdc4684-0c55-4cda-86d7-f5624479ded2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:49.350776 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3fdc4684-0c55-4cda-86d7-f5624479ded2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:49.351338 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3fdc4684-0c55-4cda-86d7-f5624479ded2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:49.355946 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-15cfc8d3-9f80-46dd-9f94-5096a22155a7 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:49.356451 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-15cfc8d3-9f80-46dd-9f94-5096a22155a7 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:49.363035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-15cfc8d3-9f80-46dd-9f94-5096a22155a7 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:49.363407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-15cfc8d3-9f80-46dd-9f94-5096a22155a7 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:49.364235 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-15cfc8d3-9f80-46dd-9f94-5096a22155a7 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:49.364911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-15cfc8d3-9f80-46dd-9f94-5096a22155a7 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:49.387945 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-3fdc4684-0c55-4cda-86d7-f5624479ded2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/ips" status: 200 len: 153 microversion: 2.20 time: 0.050236 May 10 21:10:49.389147 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 133/243] 10.222.0.49 () {60 vars in 1288 bytes} [Tue May 10 21:10:49 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/ips => generated 153 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:10:49.452257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-15cfc8d3-9f80-46dd-9f94-5096a22155a7 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a202c34c9497da2e4b7be1f0f33cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdda59eab7384e89b971e2378d2d1397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:49.459913 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-15cfc8d3-9f80-46dd-9f94-5096a22155a7 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf" status: 200 len: 1218 microversion: 2.1 time: 0.109358 May 10 21:10:49.460487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 111/244] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:49 2022] GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:10:49.601127 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-510aedf8-b5d0-4bd3-a9ef-3f7701e9ec12 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:49.601886 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-510aedf8-b5d0-4bd3-a9ef-3f7701e9ec12 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:49.611266 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-510aedf8-b5d0-4bd3-a9ef-3f7701e9ec12 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:49.611628 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-510aedf8-b5d0-4bd3-a9ef-3f7701e9ec12 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:49.612408 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-510aedf8-b5d0-4bd3-a9ef-3f7701e9ec12 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:49.612845 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-510aedf8-b5d0-4bd3-a9ef-3f7701e9ec12 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:49.973909 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-510aedf8-b5d0-4bd3-a9ef-3f7701e9ec12 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:49.982165 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-510aedf8-b5d0-4bd3-a9ef-3f7701e9ec12 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1522 microversion: 2.1 time: 0.384791 May 10 21:10:49.982901 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 134/245] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:49 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:50.477147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-44304000-20d7-479e-9af7-ddcd666d2615 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:50.477889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-44304000-20d7-479e-9af7-ddcd666d2615 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:50.485319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44304000-20d7-479e-9af7-ddcd666d2615 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:50.485774 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44304000-20d7-479e-9af7-ddcd666d2615 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:50.486548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44304000-20d7-479e-9af7-ddcd666d2615 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:50.487006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44304000-20d7-479e-9af7-ddcd666d2615 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:50.548901 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-44304000-20d7-479e-9af7-ddcd666d2615 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a202c34c9497da2e4b7be1f0f33cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdda59eab7384e89b971e2378d2d1397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:50.556653 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-44304000-20d7-479e-9af7-ddcd666d2615 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf" status: 200 len: 1266 microversion: 2.1 time: 0.083547 May 10 21:10:50.557934 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 112/246] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:50 2022] GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:51.000939 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a7ba3763-b574-40ab-a18e-9f4b808e65a1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:51.001531 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a7ba3763-b574-40ab-a18e-9f4b808e65a1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:51.007929 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a7ba3763-b574-40ab-a18e-9f4b808e65a1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:51.008181 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a7ba3763-b574-40ab-a18e-9f4b808e65a1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:51.008929 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a7ba3763-b574-40ab-a18e-9f4b808e65a1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:51.009364 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a7ba3763-b574-40ab-a18e-9f4b808e65a1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:51.218297 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-a7ba3763-b574-40ab-a18e-9f4b808e65a1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:51.226266 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a7ba3763-b574-40ab-a18e-9f4b808e65a1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1522 microversion: 2.1 time: 0.231029 May 10 21:10:51.227056 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 135/247] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:50 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:51.575642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5c41a660-f5ec-4a79-a0bf-a69b439a500d tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:51.576344 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5c41a660-f5ec-4a79-a0bf-a69b439a500d tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:51.584286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5c41a660-f5ec-4a79-a0bf-a69b439a500d tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:51.584811 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5c41a660-f5ec-4a79-a0bf-a69b439a500d tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:51.585622 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5c41a660-f5ec-4a79-a0bf-a69b439a500d tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:51.586065 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5c41a660-f5ec-4a79-a0bf-a69b439a500d tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:51.656905 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5c41a660-f5ec-4a79-a0bf-a69b439a500d tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a202c34c9497da2e4b7be1f0f33cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdda59eab7384e89b971e2378d2d1397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:51.664560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5c41a660-f5ec-4a79-a0bf-a69b439a500d tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf" status: 200 len: 1274 microversion: 2.1 time: 0.094095 May 10 21:10:51.665126 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 113/248] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:51 2022] GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf => generated 1274 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:51.993029 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-fc465012-f8f0-43eb-8b5d-35f7c927c4be tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:51.993569 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-fc465012-f8f0-43eb-8b5d-35f7c927c4be tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:52.000470 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fc465012-f8f0-43eb-8b5d-35f7c927c4be tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:52.000899 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fc465012-f8f0-43eb-8b5d-35f7c927c4be tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:52.001667 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fc465012-f8f0-43eb-8b5d-35f7c927c4be tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:52.002256 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fc465012-f8f0-43eb-8b5d-35f7c927c4be tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:52.026424 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-fc465012-f8f0-43eb-8b5d-35f7c927c4be tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932/ips" status: 200 len: 145 microversion: 2.1 time: 0.037148 May 10 21:10:52.032211 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 136/249] 10.222.0.49 () {58 vars in 1247 bytes} [Tue May 10 21:10:51 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:10:52.244808 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-acbcc0a5-12f3-4b67-a5a4-5b734a3afeef tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:52.245427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-acbcc0a5-12f3-4b67-a5a4-5b734a3afeef tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:52.252364 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-acbcc0a5-12f3-4b67-a5a4-5b734a3afeef tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:52.252824 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-acbcc0a5-12f3-4b67-a5a4-5b734a3afeef tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:52.253642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-acbcc0a5-12f3-4b67-a5a4-5b734a3afeef tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:52.254085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-acbcc0a5-12f3-4b67-a5a4-5b734a3afeef tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:52.468000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-acbcc0a5-12f3-4b67-a5a4-5b734a3afeef tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:52.477007 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-acbcc0a5-12f3-4b67-a5a4-5b734a3afeef tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1502 microversion: 2.1 time: 0.236295 May 10 21:10:52.477661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 114/250] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:52 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1502 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:52.498861 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-883d0310-fc82-4c56-9b05-2923f7c972cf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4210ef8-a7f9-4a81-8e4f-9d3a2c31be9e"}} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:10:52.500032 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-883d0310-fc82-4c56-9b05-2923f7c972cf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:52.506154 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-883d0310-fc82-4c56-9b05-2923f7c972cf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:52.506601 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-883d0310-fc82-4c56-9b05-2923f7c972cf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:52.507571 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-883d0310-fc82-4c56-9b05-2923f7c972cf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:52.508012 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-883d0310-fc82-4c56-9b05-2923f7c972cf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:52.532633 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.wsgi [None req-883d0310-fc82-4c56-9b05-2923f7c972cf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] HTTP exception thrown: Cannot 'attach_volume' instance 2ee5480a-213a-489e-a366-5ffa59cf5487 while it is in vm_state rescued May 10 21:10:52.534568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-883d0310-fc82-4c56-9b05-2923f7c972cf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Request method failure captured: May 10 21:10:52.534568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: request: POST /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487/os-volume_attachments HTTP/1.1 May 10 21:10:52.534568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Accept: application/json May 10 21:10:52.534568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Accept-Encoding: identity May 10 21:10:52.534568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Connection: close May 10 21:10:52.534568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Content-Length: 74 May 10 21:10:52.534568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Content-Type: application/json May 10 21:10:52.534568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Host: 10.222.0.49 May 10 21:10:52.534568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Openstack-System-Scope: None May 10 21:10:52.534568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: User-Agent: python-urllib3/1.26.9 May 10 21:10:52.534568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Auth-Token: gAAAAABietRu9ss3zgPFeC7849fUJOM8Q7EL5_flR4rJLt-W88oUCLUpwLmWbh98c8K1xLUyN74oKQGClHuOnEt6Xj1A1n_QZ5oD8Vcsq78BUnvY-1ELPjE6x7POzOrC2wKu1Ebpq6A7wmyq8_x_zbC73jSynu5MTHLRXN5eyRUhQ9bV1BQSx8s May 10 21:10:52.534568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Domain-Id: None May 10 21:10:52.534568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Domain-Name: None May 10 21:10:52.534568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Identity-Status: Confirmed May 10 21:10:52.534568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Is-Admin-Project: True May 10 21:10:52.534568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Domain-Id: default May 10 21:10:52.534568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Domain-Name: Default May 10 21:10:52.534568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Id: bba0283b32bc4c54ae7cfcb1f984db42 May 10 21:10:52.534568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-171931591 May 10 21:10:52.534568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Role: reader,member May 10 21:10:52.534568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Roles: reader,member May 10 21:10:52.536196 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bba0283b32bc4c54ae7cfcb1f984db42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bba0283b32bc4c54ae7cfcb1f984db42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bba0283b32bc4c54ae7cfcb1f984db42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bba0283b32bc4c54ae7cfcb1f984db42", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:10:52.536196 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Tenant: tempest-ServerRescueNegativeTestJSON-171931591 May 10 21:10:52.536196 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Tenant-Id: bba0283b32bc4c54ae7cfcb1f984db42 May 10 21:10:52.536196 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-171931591 May 10 21:10:52.536196 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User: tempest-ServerRescueNegativeTestJSON-171931591-project May 10 21:10:52.536196 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Domain-Id: default May 10 21:10:52.536196 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Domain-Name: Default May 10 21:10:52.536196 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Id: fe93eb8c93fb4cb4bec6f7cc2c03e1eb May 10 21:10:52.536196 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Name: tempest-ServerRescueNegativeTestJSON-171931591-project May 10 21:10:52.536196 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: May 10 21:10:52.536196 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: {"volumeAttachment": {"volumeId": "b4210ef8-a7f9-4a81-8e4f-9d3a2c31be9e"}} May 10 21:10:52.536196 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: method: > May 10 21:10:52.537046 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: exception: Cannot 'attach_volume' instance 2ee5480a-213a-489e-a366-5ffa59cf5487 while it is in vm_state rescued May 10 21:10:52.537046 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: action_args: {'server_id': '2ee5480a-213a-489e-a366-5ffa59cf5487', 'body': {'volumeAttachment': {'volumeId': 'b4210ef8-a7f9-4a81-8e4f-9d3a2c31be9e'}}} May 10 21:10:52.537046 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:10:52.537046 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:10:52.537046 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 21:10:52.537046 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 21:10:52.537046 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 21:10:52.537046 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 21:10:52.537046 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 21:10:52.537046 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 21:10:52.537046 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2ee5480a-213a-489e-a366-5ffa59cf5487 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 10 21:10:52.537046 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:10:52.537046 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:10:52.537046 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:10:52.537046 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:10:52.537046 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:10:52.537046 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:10:52.537046 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:10:52.537046 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:10:52.538352 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:10:52.538352 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:10:52.538352 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 21:10:52.538352 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 21:10:52.538352 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 21:10:52.538352 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 21:10:52.538352 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 21:10:52.538352 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 21:10:52.538352 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 10 21:10:52.538352 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 21:10:52.538352 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 21:10:52.538352 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 21:10:52.538352 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2ee5480a-213a-489e-a366-5ffa59cf5487 while it is in vm_state rescued May 10 21:10:52.538352 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:10:52.538352 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:10:52.538352 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:10:52.538352 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:10:52.538352 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:10:52.538352 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:10:52.539748 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:10:52.539748 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:10:52.539748 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2ee5480a-213a-489e-a366-5ffa59cf5487 while it is in vm_state rescued May 10 21:10:52.539748 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:10:52.540708 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-883d0310-fc82-4c56-9b05-2923f7c972cf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Returning 409 to user: Cannot 'attach_volume' instance 2ee5480a-213a-489e-a366-5ffa59cf5487 while it is in vm_state rescued {{(pid=117713) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:10:52.541560 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-883d0310-fc82-4c56-9b05-2923f7c972cf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "POST /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047164 May 10 21:10:52.542124 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 137/251] 10.222.0.49 () {60 vars in 1322 bytes} [Tue May 10 21:10:52 2022] POST /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 21:10:52.553947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b5382341-cd5b-4dfe-ac6e-ca7d89fb487c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:10:52.554862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b5382341-cd5b-4dfe-ac6e-ca7d89fb487c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:52.562117 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5382341-cd5b-4dfe-ac6e-ca7d89fb487c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:52.562567 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5382341-cd5b-4dfe-ac6e-ca7d89fb487c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:52.563371 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5382341-cd5b-4dfe-ac6e-ca7d89fb487c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:52.563804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5382341-cd5b-4dfe-ac6e-ca7d89fb487c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:52.681793 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a9edcbc6-07b9-446f-8183-b8460cf04e8f tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:52.682454 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a9edcbc6-07b9-446f-8183-b8460cf04e8f tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:52.688597 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a9edcbc6-07b9-446f-8183-b8460cf04e8f tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:52.689050 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a9edcbc6-07b9-446f-8183-b8460cf04e8f tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:52.689813 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a9edcbc6-07b9-446f-8183-b8460cf04e8f tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:52.690256 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a9edcbc6-07b9-446f-8183-b8460cf04e8f tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:52.759064 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-a9edcbc6-07b9-446f-8183-b8460cf04e8f tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a202c34c9497da2e4b7be1f0f33cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdda59eab7384e89b971e2378d2d1397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:52.767535 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a9edcbc6-07b9-446f-8183-b8460cf04e8f tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf" status: 200 len: 1272 microversion: 2.1 time: 0.089718 May 10 21:10:52.768093 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 138/252] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:52 2022] GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf => generated 1272 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:10:52.812447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b5382341-cd5b-4dfe-ac6e-ca7d89fb487c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "POST /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487/action" status: 202 len: 0 microversion: 2.1 time: 0.264285 May 10 21:10:52.813387 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 115/253] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 21:10:52 2022] POST /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:10:52.821095 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-7a54dfd8-005c-4852-b2ed-64ef9e56599f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:52.821712 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-7a54dfd8-005c-4852-b2ed-64ef9e56599f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:52.830111 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7a54dfd8-005c-4852-b2ed-64ef9e56599f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:52.830111 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7a54dfd8-005c-4852-b2ed-64ef9e56599f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:52.830731 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7a54dfd8-005c-4852-b2ed-64ef9e56599f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:52.831396 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7a54dfd8-005c-4852-b2ed-64ef9e56599f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:52.990331 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-7a54dfd8-005c-4852-b2ed-64ef9e56599f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:52.998647 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-7a54dfd8-005c-4852-b2ed-64ef9e56599f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1510 microversion: 2.1 time: 0.181268 May 10 21:10:52.999559 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 139/254] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:52 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1510 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:53.225069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2c09184f-149e-46c6-95fa-7a63085ef0c9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:10:53.225696 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2c09184f-149e-46c6-95fa-7a63085ef0c9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:53.232443 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c09184f-149e-46c6-95fa-7a63085ef0c9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:53.232855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c09184f-149e-46c6-95fa-7a63085ef0c9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:53.233621 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c09184f-149e-46c6-95fa-7a63085ef0c9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:53.234060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c09184f-149e-46c6-95fa-7a63085ef0c9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:53.256148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.objects.instance [None req-2c09184f-149e-46c6-95fa-7a63085ef0c9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lazy-loading 'flavor' on Instance uuid 688d836a-358b-4815-80e9-f43bd14f5f93 {{(pid=117714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:10:53.785882 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-5202b1c9-8d6b-4a9a-993b-569439e710d2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:53.786751 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5202b1c9-8d6b-4a9a-993b-569439e710d2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:53.792754 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5202b1c9-8d6b-4a9a-993b-569439e710d2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:53.793779 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5202b1c9-8d6b-4a9a-993b-569439e710d2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:53.794483 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5202b1c9-8d6b-4a9a-993b-569439e710d2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:53.794915 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5202b1c9-8d6b-4a9a-993b-569439e710d2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:53.868307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2c09184f-149e-46c6-95fa-7a63085ef0c9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "POST /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/action" status: 202 len: 0 microversion: 2.20 time: 0.647337 May 10 21:10:53.869237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 116/255] 10.222.0.49 () {62 vars in 1318 bytes} [Tue May 10 21:10:53 2022] POST /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/action => generated 0 bytes in 649 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 21:10:53.879586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d32de187-9671-4303-9df8-de03d125b792 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:53.881528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d32de187-9671-4303-9df8-de03d125b792 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:53.893690 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d32de187-9671-4303-9df8-de03d125b792 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:53.894147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d32de187-9671-4303-9df8-de03d125b792 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:53.894975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d32de187-9671-4303-9df8-de03d125b792 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:53.895450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d32de187-9671-4303-9df8-de03d125b792 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:53.997839 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-5202b1c9-8d6b-4a9a-993b-569439e710d2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a202c34c9497da2e4b7be1f0f33cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdda59eab7384e89b971e2378d2d1397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:54.005972 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-5202b1c9-8d6b-4a9a-993b-569439e710d2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf" status: 200 len: 1314 microversion: 2.1 time: 0.224005 May 10 21:10:54.015607 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 140/256] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:53 2022] GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:10:54.021971 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-41739f66-fd54-4764-8fd4-e0ce46228cf7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:54.022911 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-41739f66-fd54-4764-8fd4-e0ce46228cf7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:54.031605 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-41739f66-fd54-4764-8fd4-e0ce46228cf7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:54.032060 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-41739f66-fd54-4764-8fd4-e0ce46228cf7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:54.032857 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-41739f66-fd54-4764-8fd4-e0ce46228cf7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:54.033286 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-41739f66-fd54-4764-8fd4-e0ce46228cf7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:54.123370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d32de187-9671-4303-9df8-de03d125b792 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:54.131373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d32de187-9671-4303-9df8-de03d125b792 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:54.132870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d32de187-9671-4303-9df8-de03d125b792 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:54.134223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d32de187-9671-4303-9df8-de03d125b792 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1725 microversion: 2.20 time: 0.260547 May 10 21:10:54.135305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 117/257] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:10:53 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1725 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:10:54.193916 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-41739f66-fd54-4764-8fd4-e0ce46228cf7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:54.203010 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-41739f66-fd54-4764-8fd4-e0ce46228cf7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1510 microversion: 2.1 time: 0.185189 May 10 21:10:54.203624 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 141/258] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:54 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1510 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:54.442222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-291f6305-751b-45ba-bda2-5b6534ea1096 req-2f3a98ba-0e7b-40a2-b767-bff57d4dafe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5b9902c-9fde-4793-b50a-2a9cb43c5aaf", "tag": "3f4011b8-8af6-42ec-8f9e-e7e2ad2cc3c7"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:10:54.451294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-291f6305-751b-45ba-bda2-5b6534ea1096 req-2f3a98ba-0e7b-40a2-b767-bff57d4dafe6 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:54.452350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-291f6305-751b-45ba-bda2-5b6534ea1096 req-2f3a98ba-0e7b-40a2-b767-bff57d4dafe6 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:54.466152 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-291f6305-751b-45ba-bda2-5b6534ea1096 req-2f3a98ba-0e7b-40a2-b767-bff57d4dafe6 service nova] Creating event network-changed:3f4011b8-8af6-42ec-8f9e-e7e2ad2cc3c7 for instance b5b9902c-9fde-4793-b50a-2a9cb43c5aaf on hv-cinder-82880 May 10 21:10:54.471631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-291f6305-751b-45ba-bda2-5b6534ea1096 req-2f3a98ba-0e7b-40a2-b767-bff57d4dafe6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034404 May 10 21:10:54.472612 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 118/259] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:10:55.024607 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-2360018a-a9d4-4253-87fb-b59e8f7ea553 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:55.025720 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-2360018a-a9d4-4253-87fb-b59e8f7ea553 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:55.032168 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2360018a-a9d4-4253-87fb-b59e8f7ea553 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:55.032623 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2360018a-a9d4-4253-87fb-b59e8f7ea553 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:55.033453 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2360018a-a9d4-4253-87fb-b59e8f7ea553 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:55.033893 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2360018a-a9d4-4253-87fb-b59e8f7ea553 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:55.154319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-330eb28e-0337-4d67-ae39-bd7d5c43a50e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:55.155015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-330eb28e-0337-4d67-ae39-bd7d5c43a50e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:55.161668 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-2360018a-a9d4-4253-87fb-b59e8f7ea553 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a202c34c9497da2e4b7be1f0f33cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdda59eab7384e89b971e2378d2d1397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:55.162115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-330eb28e-0337-4d67-ae39-bd7d5c43a50e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:55.162613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-330eb28e-0337-4d67-ae39-bd7d5c43a50e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:55.163416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-330eb28e-0337-4d67-ae39-bd7d5c43a50e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:55.163930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-330eb28e-0337-4d67-ae39-bd7d5c43a50e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:55.169149 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-2360018a-a9d4-4253-87fb-b59e8f7ea553 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf" status: 200 len: 1314 microversion: 2.1 time: 0.148644 May 10 21:10:55.169720 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 142/260] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:55 2022] GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:55.220823 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-df65d34f-c567-4da4-a9d0-1397e8323ad6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:55.224904 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-df65d34f-c567-4da4-a9d0-1397e8323ad6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:55.232305 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-df65d34f-c567-4da4-a9d0-1397e8323ad6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:55.232831 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-df65d34f-c567-4da4-a9d0-1397e8323ad6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:55.233881 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-df65d34f-c567-4da4-a9d0-1397e8323ad6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:55.237331 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-df65d34f-c567-4da4-a9d0-1397e8323ad6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:55.302006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-330eb28e-0337-4d67-ae39-bd7d5c43a50e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:55.311000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-330eb28e-0337-4d67-ae39-bd7d5c43a50e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:55.312861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-330eb28e-0337-4d67-ae39-bd7d5c43a50e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:55.314058 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-330eb28e-0337-4d67-ae39-bd7d5c43a50e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1725 microversion: 2.20 time: 0.165173 May 10 21:10:55.314688 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 119/261] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:10:55 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:10:55.371610 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-df65d34f-c567-4da4-a9d0-1397e8323ad6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:55.378971 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-df65d34f-c567-4da4-a9d0-1397e8323ad6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1510 microversion: 2.1 time: 0.161939 May 10 21:10:55.379572 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 143/262] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:55 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:55.895215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1cd9e8ea-2aa8-42ef-8863-5d18bb33223a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:55.895786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1cd9e8ea-2aa8-42ef-8863-5d18bb33223a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:55.901716 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1cd9e8ea-2aa8-42ef-8863-5d18bb33223a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:55.902158 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1cd9e8ea-2aa8-42ef-8863-5d18bb33223a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:55.903609 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1cd9e8ea-2aa8-42ef-8863-5d18bb33223a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:55.904040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1cd9e8ea-2aa8-42ef-8863-5d18bb33223a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:55.929413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1cd9e8ea-2aa8-42ef-8863-5d18bb33223a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/ips" status: 200 len: 150 microversion: 2.1 time: 0.036873 May 10 21:10:55.929413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 120/263] 10.222.0.49 () {58 vars in 1247 bytes} [Tue May 10 21:10:55 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:10:56.190113 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-7929d639-15ca-4166-a284-e67cc49afcf5 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:56.190729 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-7929d639-15ca-4166-a284-e67cc49afcf5 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:56.196798 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7929d639-15ca-4166-a284-e67cc49afcf5 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:56.197253 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7929d639-15ca-4166-a284-e67cc49afcf5 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:56.198047 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7929d639-15ca-4166-a284-e67cc49afcf5 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:56.198496 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7929d639-15ca-4166-a284-e67cc49afcf5 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:56.328692 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-7929d639-15ca-4166-a284-e67cc49afcf5 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a202c34c9497da2e4b7be1f0f33cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdda59eab7384e89b971e2378d2d1397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:56.332909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8dff7e8e-73ec-4a75-b762-012f4ecdd82a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:56.333569 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8dff7e8e-73ec-4a75-b762-012f4ecdd82a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:56.336330 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-7929d639-15ca-4166-a284-e67cc49afcf5 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf" status: 200 len: 1314 microversion: 2.1 time: 0.150385 May 10 21:10:56.340673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8dff7e8e-73ec-4a75-b762-012f4ecdd82a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:56.341188 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8dff7e8e-73ec-4a75-b762-012f4ecdd82a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:56.342092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8dff7e8e-73ec-4a75-b762-012f4ecdd82a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:56.342592 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8dff7e8e-73ec-4a75-b762-012f4ecdd82a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:56.345972 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 144/264] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:56 2022] GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:56.396933 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-3bded5bb-4a8e-4d45-8540-0925b8ea235e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:56.397453 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-3bded5bb-4a8e-4d45-8540-0925b8ea235e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:56.404366 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3bded5bb-4a8e-4d45-8540-0925b8ea235e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:56.404816 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3bded5bb-4a8e-4d45-8540-0925b8ea235e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:56.405693 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3bded5bb-4a8e-4d45-8540-0925b8ea235e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:56.406065 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3bded5bb-4a8e-4d45-8540-0925b8ea235e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:56.478494 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8dff7e8e-73ec-4a75-b762-012f4ecdd82a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:56.486887 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8dff7e8e-73ec-4a75-b762-012f4ecdd82a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:56.488498 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8dff7e8e-73ec-4a75-b762-012f4ecdd82a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:56.489662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8dff7e8e-73ec-4a75-b762-012f4ecdd82a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1725 microversion: 2.20 time: 0.160671 May 10 21:10:56.490527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 121/265] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:10:56 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:10:56.545486 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-3bded5bb-4a8e-4d45-8540-0925b8ea235e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:56.554800 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-3bded5bb-4a8e-4d45-8540-0925b8ea235e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1510 microversion: 2.1 time: 0.162041 May 10 21:10:56.555561 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 145/266] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:56 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:10:57.353201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-945a984d-2a9e-40a6-9e3b-15a6d370db9c tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:57.353813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-945a984d-2a9e-40a6-9e3b-15a6d370db9c tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:57.363270 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-945a984d-2a9e-40a6-9e3b-15a6d370db9c tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:57.363270 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-945a984d-2a9e-40a6-9e3b-15a6d370db9c tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:57.363270 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-945a984d-2a9e-40a6-9e3b-15a6d370db9c tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:57.363270 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-945a984d-2a9e-40a6-9e3b-15a6d370db9c tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:57.492676 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-945a984d-2a9e-40a6-9e3b-15a6d370db9c tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a202c34c9497da2e4b7be1f0f33cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdda59eab7384e89b971e2378d2d1397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:57.500176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-945a984d-2a9e-40a6-9e3b-15a6d370db9c tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf" status: 200 len: 1314 microversion: 2.1 time: 0.150802 May 10 21:10:57.500757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 122/267] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:57 2022] GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:57.507895 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-20b17d9c-1f5f-43f8-a2cb-8117c55f85aa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:57.508506 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-20b17d9c-1f5f-43f8-a2cb-8117c55f85aa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:57.515331 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-20b17d9c-1f5f-43f8-a2cb-8117c55f85aa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:57.515782 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-20b17d9c-1f5f-43f8-a2cb-8117c55f85aa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:57.516543 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-20b17d9c-1f5f-43f8-a2cb-8117c55f85aa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:57.516974 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-20b17d9c-1f5f-43f8-a2cb-8117c55f85aa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:57.571966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-753487a1-26ab-4369-8c76-2ed646ac4fed tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:57.572586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-753487a1-26ab-4369-8c76-2ed646ac4fed tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:57.579849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-753487a1-26ab-4369-8c76-2ed646ac4fed tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:57.580326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-753487a1-26ab-4369-8c76-2ed646ac4fed tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:57.581083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-753487a1-26ab-4369-8c76-2ed646ac4fed tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:57.581526 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-753487a1-26ab-4369-8c76-2ed646ac4fed tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:57.649445 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-20b17d9c-1f5f-43f8-a2cb-8117c55f85aa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:57.657717 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-20b17d9c-1f5f-43f8-a2cb-8117c55f85aa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:57.659268 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-20b17d9c-1f5f-43f8-a2cb-8117c55f85aa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:57.660438 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-20b17d9c-1f5f-43f8-a2cb-8117c55f85aa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1725 microversion: 2.20 time: 0.156487 May 10 21:10:57.661000 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 146/268] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:10:57 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:10:57.714154 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-753487a1-26ab-4369-8c76-2ed646ac4fed tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:57.721415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-753487a1-26ab-4369-8c76-2ed646ac4fed tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1510 microversion: 2.1 time: 0.153417 May 10 21:10:57.721981 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 123/269] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:57 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:58.517203 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-b5eae6c0-a0c4-4bed-b0e6-36e0acddfd13 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:58.517789 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-b5eae6c0-a0c4-4bed-b0e6-36e0acddfd13 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:58.523779 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b5eae6c0-a0c4-4bed-b0e6-36e0acddfd13 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:58.524219 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b5eae6c0-a0c4-4bed-b0e6-36e0acddfd13 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:58.524966 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b5eae6c0-a0c4-4bed-b0e6-36e0acddfd13 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:58.525398 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b5eae6c0-a0c4-4bed-b0e6-36e0acddfd13 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:58.651944 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-b5eae6c0-a0c4-4bed-b0e6-36e0acddfd13 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a202c34c9497da2e4b7be1f0f33cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdda59eab7384e89b971e2378d2d1397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:58.660222 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-b5eae6c0-a0c4-4bed-b0e6-36e0acddfd13 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf" status: 200 len: 1314 microversion: 2.1 time: 0.146900 May 10 21:10:58.660778 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 147/270] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:58 2022] GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:10:58.677531 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f88aff23-d620-475b-a326-4abe5d9e0029 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:58.678141 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f88aff23-d620-475b-a326-4abe5d9e0029 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:58.684708 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f88aff23-d620-475b-a326-4abe5d9e0029 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:58.685155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f88aff23-d620-475b-a326-4abe5d9e0029 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:58.685924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f88aff23-d620-475b-a326-4abe5d9e0029 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:58.686391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f88aff23-d620-475b-a326-4abe5d9e0029 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:58.737707 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-3c31cff6-4813-416b-8bc7-9f1fd16c4c0c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:58.738324 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-3c31cff6-4813-416b-8bc7-9f1fd16c4c0c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:58.744233 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3c31cff6-4813-416b-8bc7-9f1fd16c4c0c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:58.744679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3c31cff6-4813-416b-8bc7-9f1fd16c4c0c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:58.745476 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3c31cff6-4813-416b-8bc7-9f1fd16c4c0c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:58.745955 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3c31cff6-4813-416b-8bc7-9f1fd16c4c0c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:58.820410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f88aff23-d620-475b-a326-4abe5d9e0029 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:58.828620 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f88aff23-d620-475b-a326-4abe5d9e0029 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:58.830137 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f88aff23-d620-475b-a326-4abe5d9e0029 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:58.831352 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f88aff23-d620-475b-a326-4abe5d9e0029 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1725 microversion: 2.20 time: 0.157618 May 10 21:10:58.831918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 124/271] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:10:58 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:10:58.877501 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-3c31cff6-4813-416b-8bc7-9f1fd16c4c0c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:58.885318 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-3c31cff6-4813-416b-8bc7-9f1fd16c4c0c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1510 microversion: 2.1 time: 0.151388 May 10 21:10:58.885826 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 148/272] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:58 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:10:59.677801 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-92808b71-a8c3-454b-88fa-092e997806f2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:59.678417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-92808b71-a8c3-454b-88fa-092e997806f2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:59.685820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-92808b71-a8c3-454b-88fa-092e997806f2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:59.686276 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-92808b71-a8c3-454b-88fa-092e997806f2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:59.687372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-92808b71-a8c3-454b-88fa-092e997806f2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:59.687810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-92808b71-a8c3-454b-88fa-092e997806f2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:59.826049 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-92808b71-a8c3-454b-88fa-092e997806f2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a202c34c9497da2e4b7be1f0f33cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdda59eab7384e89b971e2378d2d1397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:10:59.833290 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-92808b71-a8c3-454b-88fa-092e997806f2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf" status: 200 len: 1314 microversion: 2.1 time: 0.159470 May 10 21:10:59.833854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 125/273] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:59 2022] GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:10:59.849601 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d192f9b8-0f77-43cb-b661-7af8262f6f2f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:59.850276 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d192f9b8-0f77-43cb-b661-7af8262f6f2f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:59.856889 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d192f9b8-0f77-43cb-b661-7af8262f6f2f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:59.857333 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d192f9b8-0f77-43cb-b661-7af8262f6f2f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:59.858091 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d192f9b8-0f77-43cb-b661-7af8262f6f2f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:59.858522 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d192f9b8-0f77-43cb-b661-7af8262f6f2f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:59.901824 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b46f03a0-0292-456b-bb21-43e879e296d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:10:59.902426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b46f03a0-0292-456b-bb21-43e879e296d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:10:59.908954 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b46f03a0-0292-456b-bb21-43e879e296d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:59.909396 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b46f03a0-0292-456b-bb21-43e879e296d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:59.910159 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b46f03a0-0292-456b-bb21-43e879e296d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:10:59.910649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b46f03a0-0292-456b-bb21-43e879e296d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:10:59.992716 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-d192f9b8-0f77-43cb-b661-7af8262f6f2f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:00.000833 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-d192f9b8-0f77-43cb-b661-7af8262f6f2f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:00.002349 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-d192f9b8-0f77-43cb-b661-7af8262f6f2f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:00.003551 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d192f9b8-0f77-43cb-b661-7af8262f6f2f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1725 microversion: 2.20 time: 0.157739 May 10 21:11:00.004110 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 149/274] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:10:59 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:00.081763 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b46f03a0-0292-456b-bb21-43e879e296d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:00.089735 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b46f03a0-0292-456b-bb21-43e879e296d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1516 microversion: 2.1 time: 0.191673 May 10 21:11:00.090393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 126/275] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:10:59 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1516 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:11:00.851402 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-2f2eec57-7d35-4f0d-8175-37a750e39dda tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:00.852177 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-2f2eec57-7d35-4f0d-8175-37a750e39dda tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:00.858434 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2f2eec57-7d35-4f0d-8175-37a750e39dda tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:00.858879 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2f2eec57-7d35-4f0d-8175-37a750e39dda tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:00.859720 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2f2eec57-7d35-4f0d-8175-37a750e39dda tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:00.860156 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2f2eec57-7d35-4f0d-8175-37a750e39dda tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:00.990394 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-2f2eec57-7d35-4f0d-8175-37a750e39dda tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a202c34c9497da2e4b7be1f0f33cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdda59eab7384e89b971e2378d2d1397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:00.998499 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-2f2eec57-7d35-4f0d-8175-37a750e39dda tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf" status: 200 len: 1314 microversion: 2.1 time: 0.151089 May 10 21:11:00.999086 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 150/276] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:00 2022] GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:01.021681 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-51bec44f-ea6d-4b56-bfcf-1f92be56e083 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:01.022351 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-51bec44f-ea6d-4b56-bfcf-1f92be56e083 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:01.029300 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51bec44f-ea6d-4b56-bfcf-1f92be56e083 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:01.029759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51bec44f-ea6d-4b56-bfcf-1f92be56e083 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:01.030526 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51bec44f-ea6d-4b56-bfcf-1f92be56e083 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:01.030963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51bec44f-ea6d-4b56-bfcf-1f92be56e083 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:01.158549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-51bec44f-ea6d-4b56-bfcf-1f92be56e083 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:01.166274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-51bec44f-ea6d-4b56-bfcf-1f92be56e083 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:01.167818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-51bec44f-ea6d-4b56-bfcf-1f92be56e083 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:01.169901 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-51bec44f-ea6d-4b56-bfcf-1f92be56e083 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1725 microversion: 2.20 time: 0.151212 May 10 21:11:01.170467 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 127/277] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:01 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:02.016434 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-83ea902b-feb9-48e8-807d-720656f397f1 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:02.016956 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-83ea902b-feb9-48e8-807d-720656f397f1 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:02.023102 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-83ea902b-feb9-48e8-807d-720656f397f1 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:02.023576 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-83ea902b-feb9-48e8-807d-720656f397f1 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:02.024329 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-83ea902b-feb9-48e8-807d-720656f397f1 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:02.024761 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-83ea902b-feb9-48e8-807d-720656f397f1 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:02.153961 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-83ea902b-feb9-48e8-807d-720656f397f1 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a202c34c9497da2e4b7be1f0f33cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdda59eab7384e89b971e2378d2d1397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:02.161164 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-83ea902b-feb9-48e8-807d-720656f397f1 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf" status: 200 len: 1314 microversion: 2.1 time: 0.149261 May 10 21:11:02.161723 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 151/278] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:02 2022] GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:02.188640 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ecf6a26e-2487-4f6f-9534-2823737385d2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:02.189238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ecf6a26e-2487-4f6f-9534-2823737385d2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:02.195568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ecf6a26e-2487-4f6f-9534-2823737385d2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:02.196014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ecf6a26e-2487-4f6f-9534-2823737385d2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:02.196775 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ecf6a26e-2487-4f6f-9534-2823737385d2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:02.197207 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ecf6a26e-2487-4f6f-9534-2823737385d2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:02.331378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ecf6a26e-2487-4f6f-9534-2823737385d2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:02.339819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ecf6a26e-2487-4f6f-9534-2823737385d2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:02.341963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ecf6a26e-2487-4f6f-9534-2823737385d2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:02.343361 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ecf6a26e-2487-4f6f-9534-2823737385d2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1725 microversion: 2.20 time: 0.159402 May 10 21:11:02.344117 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 128/279] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:02 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:03.178167 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a37f1503-7dce-41d3-8c53-9c9d0e0ad2f5 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:03.179219 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a37f1503-7dce-41d3-8c53-9c9d0e0ad2f5 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:03.185862 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a37f1503-7dce-41d3-8c53-9c9d0e0ad2f5 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:03.186305 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a37f1503-7dce-41d3-8c53-9c9d0e0ad2f5 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:03.187366 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a37f1503-7dce-41d3-8c53-9c9d0e0ad2f5 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:03.187807 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a37f1503-7dce-41d3-8c53-9c9d0e0ad2f5 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:03.315643 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-a37f1503-7dce-41d3-8c53-9c9d0e0ad2f5 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a202c34c9497da2e4b7be1f0f33cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdda59eab7384e89b971e2378d2d1397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:03.323129 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a37f1503-7dce-41d3-8c53-9c9d0e0ad2f5 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf" status: 200 len: 1314 microversion: 2.1 time: 0.148890 May 10 21:11:03.324125 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 152/280] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:03 2022] GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:03.340537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-653096dc-d31b-4869-a770-3d148b01039a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e14853cf-d569-45eb-86dd-4ed81c516b00"}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:11:03.341918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-653096dc-d31b-4869-a770-3d148b01039a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:03.348211 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-653096dc-d31b-4869-a770-3d148b01039a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:03.349190 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-653096dc-d31b-4869-a770-3d148b01039a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:03.349485 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-653096dc-d31b-4869-a770-3d148b01039a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:03.349924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-653096dc-d31b-4869-a770-3d148b01039a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:03.362372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f5cd765a-a62a-429d-8676-13866b93b736 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:03.362982 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f5cd765a-a62a-429d-8676-13866b93b736 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:03.368862 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f5cd765a-a62a-429d-8676-13866b93b736 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:03.369319 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f5cd765a-a62a-429d-8676-13866b93b736 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:03.370079 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f5cd765a-a62a-429d-8676-13866b93b736 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:03.370514 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f5cd765a-a62a-429d-8676-13866b93b736 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:03.515790 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-f5cd765a-a62a-429d-8676-13866b93b736 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:03.523678 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-f5cd765a-a62a-429d-8676-13866b93b736 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:03.525248 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-f5cd765a-a62a-429d-8676-13866b93b736 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:03.526392 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f5cd765a-a62a-429d-8676-13866b93b736 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1725 microversion: 2.20 time: 0.167933 May 10 21:11:03.526942 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 153/281] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:03 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:11:03.531815 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-56c97d8f-b703-4238-87d5-2dc19f0b50d9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a05716f-c46f-429d-9bc6-0953ce8b9bc8", "device": "/dev/sdb"}} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:11:03.533448 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-56c97d8f-b703-4238-87d5-2dc19f0b50d9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:03.539464 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-56c97d8f-b703-4238-87d5-2dc19f0b50d9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:03.541479 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-56c97d8f-b703-4238-87d5-2dc19f0b50d9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:03.541479 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-56c97d8f-b703-4238-87d5-2dc19f0b50d9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:03.541479 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-56c97d8f-b703-4238-87d5-2dc19f0b50d9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:04.176548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-653096dc-d31b-4869-a770-3d148b01039a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "POST /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.839758 May 10 21:11:04.177243 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 129/282] 10.222.0.49 () {60 vars in 1322 bytes} [Tue May 10 21:11:03 2022] POST /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932/os-volume_attachments => generated 194 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:11:04.182258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fd2d59b8-0f38-4f43-8f7a-3d67fb0f2057 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Action: 'create', calling method: .version_select at 0x7f85d5dc3790>, body: {"keypair": {"name": "tempest-keypair-424622357", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTNY3iDAS07wxmpZB3k6fyFaUlqMQvy46nlaqp70E/aIyvzOBXvFAeN5CI65Ne4lDo/ytoFwrfSY5eotPyFr2KX9dr7PRbuh4ym3WTllJa/V8qGuxJoQr6093dDno2VRA=="}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:11:04.201368 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-fd2d59b8-0f38-4f43-8f7a-3d67fb0f2057 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Getting quotas for project bba0283b32bc4c54ae7cfcb1f984db42. Resources: {'key_pairs'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:11:04.205100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-fd2d59b8-0f38-4f43-8f7a-3d67fb0f2057 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Getting quotas for user fe93eb8c93fb4cb4bec6f7cc2c03e1eb and project bba0283b32bc4c54ae7cfcb1f984db42. Resources: {'key_pairs'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:11:04.352640 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fd2d59b8-0f38-4f43-8f7a-3d67fb0f2057 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.172678 May 10 21:11:04.353434 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-56c97d8f-b703-4238-87d5-2dc19f0b50d9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "POST /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.825184 May 10 21:11:04.364007 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 130/283] 10.222.0.49 () {60 vars in 1158 bytes} [Tue May 10 21:11:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:11:04.364601 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 154/284] 10.222.0.49 () {60 vars in 1322 bytes} [Tue May 10 21:11:03 2022] POST /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109/os-volume_attachments => generated 194 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:11:04.364601 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-33563564-1186-48b2-90cd-c9efa3655edc tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:04.364601 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-33563564-1186-48b2-90cd-c9efa3655edc tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:04.380008 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-69278fe5-4048-42eb-841a-3e520632cc1f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "678a2357-0815-4dbd-af6f-4f32d017941d"}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:11:04.382815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-69278fe5-4048-42eb-841a-3e520632cc1f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:04.385105 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-33563564-1186-48b2-90cd-c9efa3655edc tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:04.385364 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-33563564-1186-48b2-90cd-c9efa3655edc tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:04.386037 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-33563564-1186-48b2-90cd-c9efa3655edc tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:04.386573 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-33563564-1186-48b2-90cd-c9efa3655edc tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:04.392149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-69278fe5-4048-42eb-841a-3e520632cc1f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:04.393036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-69278fe5-4048-42eb-841a-3e520632cc1f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:04.393994 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-69278fe5-4048-42eb-841a-3e520632cc1f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:04.394423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-69278fe5-4048-42eb-841a-3e520632cc1f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:04.554289 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-33563564-1186-48b2-90cd-c9efa3655edc tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a202c34c9497da2e4b7be1f0f33cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdda59eab7384e89b971e2378d2d1397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:04.563509 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-33563564-1186-48b2-90cd-c9efa3655edc tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf" status: 200 len: 1314 microversion: 2.1 time: 0.207967 May 10 21:11:04.564685 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 155/285] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:04 2022] GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:04.569440 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-8512cb1a-e63d-4f05-93c7-c76681a52461 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:04.570183 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-8512cb1a-e63d-4f05-93c7-c76681a52461 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:04.577171 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8512cb1a-e63d-4f05-93c7-c76681a52461 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:04.580964 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8512cb1a-e63d-4f05-93c7-c76681a52461 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:04.582044 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8512cb1a-e63d-4f05-93c7-c76681a52461 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:04.582709 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8512cb1a-e63d-4f05-93c7-c76681a52461 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:04.770429 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-8512cb1a-e63d-4f05-93c7-c76681a52461 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:04.789496 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-8512cb1a-e63d-4f05-93c7-c76681a52461 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:04.791105 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-8512cb1a-e63d-4f05-93c7-c76681a52461 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:04.792320 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-8512cb1a-e63d-4f05-93c7-c76681a52461 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1725 microversion: 2.20 time: 0.226476 May 10 21:11:04.793038 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 156/286] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:04 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:05.256642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-69278fe5-4048-42eb-841a-3e520632cc1f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "POST /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.901077 May 10 21:11:05.260240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 131/287] 10.222.0.49 () {60 vars in 1322 bytes} [Tue May 10 21:11:04 2022] POST /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 194 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:11:05.581354 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-5eeece9e-268f-4ab6-9e70-78b563a0ea66 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:05.581978 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5eeece9e-268f-4ab6-9e70-78b563a0ea66 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:05.587945 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5eeece9e-268f-4ab6-9e70-78b563a0ea66 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:05.588422 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5eeece9e-268f-4ab6-9e70-78b563a0ea66 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:05.589175 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5eeece9e-268f-4ab6-9e70-78b563a0ea66 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:05.589618 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5eeece9e-268f-4ab6-9e70-78b563a0ea66 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:05.739198 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-5eeece9e-268f-4ab6-9e70-78b563a0ea66 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a202c34c9497da2e4b7be1f0f33cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdda59eab7384e89b971e2378d2d1397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:05.746576 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-5eeece9e-268f-4ab6-9e70-78b563a0ea66 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf" status: 200 len: 1314 microversion: 2.1 time: 0.169124 May 10 21:11:05.747183 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 157/288] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:05 2022] GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:05.815173 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1dff0d4b-fe22-4959-9989-40fd178c7cce tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:05.816029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1dff0d4b-fe22-4959-9989-40fd178c7cce tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:05.822123 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1dff0d4b-fe22-4959-9989-40fd178c7cce tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:05.822677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1dff0d4b-fe22-4959-9989-40fd178c7cce tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:05.823670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1dff0d4b-fe22-4959-9989-40fd178c7cce tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:05.824108 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1dff0d4b-fe22-4959-9989-40fd178c7cce tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:05.962489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1dff0d4b-fe22-4959-9989-40fd178c7cce tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:05.970990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1dff0d4b-fe22-4959-9989-40fd178c7cce tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:05.972540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1dff0d4b-fe22-4959-9989-40fd178c7cce tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:05.973695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1dff0d4b-fe22-4959-9989-40fd178c7cce tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1725 microversion: 2.20 time: 0.164620 May 10 21:11:05.974400 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 132/289] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:05 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:06.764960 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-1b1bdcd2-9bca-4326-8ac8-06af7f3ae486 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:06.765578 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-1b1bdcd2-9bca-4326-8ac8-06af7f3ae486 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:06.780374 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1b1bdcd2-9bca-4326-8ac8-06af7f3ae486 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:06.791841 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1b1bdcd2-9bca-4326-8ac8-06af7f3ae486 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:06.793888 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1b1bdcd2-9bca-4326-8ac8-06af7f3ae486 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:06.795335 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1b1bdcd2-9bca-4326-8ac8-06af7f3ae486 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:06.892705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-39ed58f5-1e87-45a0-855d-23ad79c8ccfa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-479408857", "imageRef": "cb321ccf-1ce7-4dda-90d0-f05332eb6fe1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dced4eda-1dfb-4abc-8242-f161f1463db0"}], "security_groups": [{"name": "tempest-securitygroup--1753536795"}], "key_name": "tempest-keypair-424622357", "user_data": "}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:11:06.983042 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-1b1bdcd2-9bca-4326-8ac8-06af7f3ae486 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a202c34c9497da2e4b7be1f0f33cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdda59eab7384e89b971e2378d2d1397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:06.990815 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-1b1bdcd2-9bca-4326-8ac8-06af7f3ae486 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf" status: 200 len: 1314 microversion: 2.1 time: 0.231171 May 10 21:11:06.994038 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 158/290] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:06 2022] GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:06.995845 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [req-5fe0ff11-32eb-496d-a30e-13c83f885309 req-395a44d5-82da-46ab-ab7d-38f23f9e533d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b9902c-9fde-4793-b50a-2a9cb43c5aaf", "name": "network-vif-plugged", "status": "completed", "tag": "3f4011b8-8af6-42ec-8f9e-e7e2ad2cc3c7"}]} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:11:07.003952 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-5fe0ff11-32eb-496d-a30e-13c83f885309 req-395a44d5-82da-46ab-ab7d-38f23f9e533d service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:07.004408 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-5fe0ff11-32eb-496d-a30e-13c83f885309 req-395a44d5-82da-46ab-ab7d-38f23f9e533d service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:07.019962 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.compute.server_external_events [req-5fe0ff11-32eb-496d-a30e-13c83f885309 req-395a44d5-82da-46ab-ab7d-38f23f9e533d service nova] Creating event network-vif-plugged:3f4011b8-8af6-42ec-8f9e-e7e2ad2cc3c7 for instance b5b9902c-9fde-4793-b50a-2a9cb43c5aaf on hv-cinder-82880 May 10 21:11:07.021739 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [req-5fe0ff11-32eb-496d-a30e-13c83f885309 req-395a44d5-82da-46ab-ab7d-38f23f9e533d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029079 May 10 21:11:07.023797 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 159/291] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:11:07.029761 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.network.neutron [None req-39ed58f5-1e87-45a0-855d-23ad79c8ccfa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] validate_networks() for [('dced4eda-1dfb-4abc-8242-f161f1463db0', None, None, None, None, None)] {{(pid=117714) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:11:07.033433 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d97fd1ff-6e01-4a8f-bd3a-1afb60e92b37 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:07.039715 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d97fd1ff-6e01-4a8f-bd3a-1afb60e92b37 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:07.053588 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d97fd1ff-6e01-4a8f-bd3a-1afb60e92b37 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:07.053955 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d97fd1ff-6e01-4a8f-bd3a-1afb60e92b37 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:07.054757 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d97fd1ff-6e01-4a8f-bd3a-1afb60e92b37 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:07.056029 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d97fd1ff-6e01-4a8f-bd3a-1afb60e92b37 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:07.203901 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-d97fd1ff-6e01-4a8f-bd3a-1afb60e92b37 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:07.212898 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-d97fd1ff-6e01-4a8f-bd3a-1afb60e92b37 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:07.214518 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-d97fd1ff-6e01-4a8f-bd3a-1afb60e92b37 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:07.215838 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d97fd1ff-6e01-4a8f-bd3a-1afb60e92b37 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1725 microversion: 2.20 time: 0.187773 May 10 21:11:07.217304 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 160/292] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:07 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:07.518935 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-39ed58f5-1e87-45a0-855d-23ad79c8ccfa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Flavor limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:11:07.519393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-39ed58f5-1e87-45a0-855d-23ad79c8ccfa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Image limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:11:07.519906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-39ed58f5-1e87-45a0-855d-23ad79c8ccfa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Flavor pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:11:07.520316 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-39ed58f5-1e87-45a0-855d-23ad79c8ccfa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Image pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:11:07.520728 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-39ed58f5-1e87-45a0-855d-23ad79c8ccfa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:11:07.530363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39ed58f5-1e87-45a0-855d-23ad79c8ccfa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:07.530812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39ed58f5-1e87-45a0-855d-23ad79c8ccfa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:07.531728 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39ed58f5-1e87-45a0-855d-23ad79c8ccfa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:07.532161 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39ed58f5-1e87-45a0-855d-23ad79c8ccfa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:07.549549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-39ed58f5-1e87-45a0-855d-23ad79c8ccfa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Getting quotas for project bba0283b32bc4c54ae7cfcb1f984db42. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:11:07.553477 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-39ed58f5-1e87-45a0-855d-23ad79c8ccfa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Getting quotas for user fe93eb8c93fb4cb4bec6f7cc2c03e1eb and project bba0283b32bc4c54ae7cfcb1f984db42. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:11:07.564824 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-39ed58f5-1e87-45a0-855d-23ad79c8ccfa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Going to run 1 instances... {{(pid=117714) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:11:07.567166 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-39ed58f5-1e87-45a0-855d-23ad79c8ccfa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb321ccf-1ce7-4dda-90d0-f05332eb6fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117714) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:11:07.690429 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-39ed58f5-1e87-45a0-855d-23ad79c8ccfa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.803415 May 10 21:11:07.691308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 133/293] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 21:11:06 2022] POST /compute/v2.1/servers => generated 409 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 21:11:07.701562 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-95619918-4f39-41a2-8f8e-4e4df10810f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:07.702337 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-95619918-4f39-41a2-8f8e-4e4df10810f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:07.755346 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-95619918-4f39-41a2-8f8e-4e4df10810f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:07.761987 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-95619918-4f39-41a2-8f8e-4e4df10810f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1244 microversion: 2.1 time: 0.064958 May 10 21:11:07.762586 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 161/294] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:07 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1244 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:08.008916 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0f3ed69c-1ecc-4d5d-839c-bcb6d2e8c3e2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:08.009522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0f3ed69c-1ecc-4d5d-839c-bcb6d2e8c3e2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:08.016843 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f3ed69c-1ecc-4d5d-839c-bcb6d2e8c3e2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:08.017294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f3ed69c-1ecc-4d5d-839c-bcb6d2e8c3e2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:08.020679 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f3ed69c-1ecc-4d5d-839c-bcb6d2e8c3e2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:08.020679 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f3ed69c-1ecc-4d5d-839c-bcb6d2e8c3e2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:08.154129 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0f3ed69c-1ecc-4d5d-839c-bcb6d2e8c3e2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a202c34c9497da2e4b7be1f0f33cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdda59eab7384e89b971e2378d2d1397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:08.161501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0f3ed69c-1ecc-4d5d-839c-bcb6d2e8c3e2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf" status: 200 len: 1314 microversion: 2.1 time: 0.156940 May 10 21:11:08.162093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 134/295] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:08 2022] GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:08.235565 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-684b06c7-bdc5-4d40-8080-e15656e1eb6a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:08.236188 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-684b06c7-bdc5-4d40-8080-e15656e1eb6a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:08.243388 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-684b06c7-bdc5-4d40-8080-e15656e1eb6a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:08.243845 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-684b06c7-bdc5-4d40-8080-e15656e1eb6a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:08.244649 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-684b06c7-bdc5-4d40-8080-e15656e1eb6a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:08.245091 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-684b06c7-bdc5-4d40-8080-e15656e1eb6a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:08.377032 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-684b06c7-bdc5-4d40-8080-e15656e1eb6a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:08.384980 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-684b06c7-bdc5-4d40-8080-e15656e1eb6a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:08.386482 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-684b06c7-bdc5-4d40-8080-e15656e1eb6a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:08.387697 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-684b06c7-bdc5-4d40-8080-e15656e1eb6a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1725 microversion: 2.20 time: 0.156307 May 10 21:11:08.389706 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 162/296] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:08 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:08.780189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-98a6f6b3-afc8-48a8-a7f1-0aec003ec3b1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:08.780805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-98a6f6b3-afc8-48a8-a7f1-0aec003ec3b1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:08.786801 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-98a6f6b3-afc8-48a8-a7f1-0aec003ec3b1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:08.787295 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-98a6f6b3-afc8-48a8-a7f1-0aec003ec3b1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:08.788069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-98a6f6b3-afc8-48a8-a7f1-0aec003ec3b1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:08.788513 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-98a6f6b3-afc8-48a8-a7f1-0aec003ec3b1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:08.848534 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-98a6f6b3-afc8-48a8-a7f1-0aec003ec3b1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:08.855813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-98a6f6b3-afc8-48a8-a7f1-0aec003ec3b1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1248 microversion: 2.1 time: 0.080472 May 10 21:11:08.856331 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 135/297] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:08 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1248 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:09.178607 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c2148a57-1376-4afc-ae87-d357f061c252 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:09.179265 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c2148a57-1376-4afc-ae87-d357f061c252 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:09.185181 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c2148a57-1376-4afc-ae87-d357f061c252 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:09.185723 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c2148a57-1376-4afc-ae87-d357f061c252 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:09.186498 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c2148a57-1376-4afc-ae87-d357f061c252 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:09.187281 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c2148a57-1376-4afc-ae87-d357f061c252 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:09.311281 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-c2148a57-1376-4afc-ae87-d357f061c252 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a202c34c9497da2e4b7be1f0f33cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdda59eab7384e89b971e2378d2d1397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:09.318842 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c2148a57-1376-4afc-ae87-d357f061c252 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf" status: 200 len: 1314 microversion: 2.1 time: 0.144101 May 10 21:11:09.319449 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 163/298] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:09 2022] GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:09.408143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ee5c99df-631a-44cf-8ce1-e85c8316e66b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:09.408840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ee5c99df-631a-44cf-8ce1-e85c8316e66b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:09.415370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee5c99df-631a-44cf-8ce1-e85c8316e66b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:09.415849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee5c99df-631a-44cf-8ce1-e85c8316e66b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:09.416627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee5c99df-631a-44cf-8ce1-e85c8316e66b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:09.417066 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee5c99df-631a-44cf-8ce1-e85c8316e66b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:09.549312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ee5c99df-631a-44cf-8ce1-e85c8316e66b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:09.556955 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ee5c99df-631a-44cf-8ce1-e85c8316e66b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:09.558524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ee5c99df-631a-44cf-8ce1-e85c8316e66b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:09.559795 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ee5c99df-631a-44cf-8ce1-e85c8316e66b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1725 microversion: 2.20 time: 0.156691 May 10 21:11:09.567332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 136/299] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:09 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:09.874082 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e0733c69-9c18-4e18-832a-1e266b1821c8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:09.874687 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e0733c69-9c18-4e18-832a-1e266b1821c8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:09.880673 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e0733c69-9c18-4e18-832a-1e266b1821c8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:09.881118 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e0733c69-9c18-4e18-832a-1e266b1821c8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:09.881872 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e0733c69-9c18-4e18-832a-1e266b1821c8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:09.882304 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e0733c69-9c18-4e18-832a-1e266b1821c8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:09.942950 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-e0733c69-9c18-4e18-832a-1e266b1821c8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:09.950164 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e0733c69-9c18-4e18-832a-1e266b1821c8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1248 microversion: 2.1 time: 0.080552 May 10 21:11:09.950765 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 164/300] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:09 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1248 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:10.337336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bf970de0-5126-4029-809a-ad321add6273 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:10.337943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bf970de0-5126-4029-809a-ad321add6273 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:10.344677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf970de0-5126-4029-809a-ad321add6273 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:10.345074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf970de0-5126-4029-809a-ad321add6273 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:10.345855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf970de0-5126-4029-809a-ad321add6273 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:10.346297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf970de0-5126-4029-809a-ad321add6273 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:10.478405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bf970de0-5126-4029-809a-ad321add6273 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a202c34c9497da2e4b7be1f0f33cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdda59eab7384e89b971e2378d2d1397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:10.486190 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bf970de0-5126-4029-809a-ad321add6273 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf" status: 200 len: 1314 microversion: 2.1 time: 0.153851 May 10 21:11:10.486752 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 137/301] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:10 2022] GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:10.578277 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-09aa6cd4-f972-4bd4-ae3d-86a2c50bddfb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:10.578903 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-09aa6cd4-f972-4bd4-ae3d-86a2c50bddfb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:10.585283 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-09aa6cd4-f972-4bd4-ae3d-86a2c50bddfb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:10.585721 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-09aa6cd4-f972-4bd4-ae3d-86a2c50bddfb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:10.586503 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-09aa6cd4-f972-4bd4-ae3d-86a2c50bddfb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:10.586948 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-09aa6cd4-f972-4bd4-ae3d-86a2c50bddfb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:10.717360 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-09aa6cd4-f972-4bd4-ae3d-86a2c50bddfb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:10.725518 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-09aa6cd4-f972-4bd4-ae3d-86a2c50bddfb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:10.727369 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-09aa6cd4-f972-4bd4-ae3d-86a2c50bddfb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:10.728285 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-09aa6cd4-f972-4bd4-ae3d-86a2c50bddfb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1725 microversion: 2.20 time: 0.154576 May 10 21:11:10.728846 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 165/302] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:10 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:10.967513 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0dc10ae6-2694-4c25-a2cf-e77ce3e3c1c9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:10.968064 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0dc10ae6-2694-4c25-a2cf-e77ce3e3c1c9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:10.974084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0dc10ae6-2694-4c25-a2cf-e77ce3e3c1c9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:10.974529 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0dc10ae6-2694-4c25-a2cf-e77ce3e3c1c9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:10.975322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0dc10ae6-2694-4c25-a2cf-e77ce3e3c1c9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:10.975760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0dc10ae6-2694-4c25-a2cf-e77ce3e3c1c9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:11.035867 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0dc10ae6-2694-4c25-a2cf-e77ce3e3c1c9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:11.042958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0dc10ae6-2694-4c25-a2cf-e77ce3e3c1c9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1248 microversion: 2.1 time: 0.079985 May 10 21:11:11.043550 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 138/303] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:10 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1248 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:11.503587 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f1254a20-9230-457a-8d22-2fc2d1c7ab05 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:11.504358 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f1254a20-9230-457a-8d22-2fc2d1c7ab05 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:11.510351 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f1254a20-9230-457a-8d22-2fc2d1c7ab05 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:11.510799 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f1254a20-9230-457a-8d22-2fc2d1c7ab05 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:11.511592 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f1254a20-9230-457a-8d22-2fc2d1c7ab05 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:11.512032 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f1254a20-9230-457a-8d22-2fc2d1c7ab05 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:11.701828 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-f1254a20-9230-457a-8d22-2fc2d1c7ab05 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a202c34c9497da2e4b7be1f0f33cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdda59eab7384e89b971e2378d2d1397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:11.710267 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f1254a20-9230-457a-8d22-2fc2d1c7ab05 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf" status: 200 len: 1314 microversion: 2.1 time: 0.210516 May 10 21:11:11.711339 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 166/304] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:11 2022] GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:11.746444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dfc4e41d-1688-48e5-b180-6a659ab1eb7b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:11.747062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dfc4e41d-1688-48e5-b180-6a659ab1eb7b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:11.753522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dfc4e41d-1688-48e5-b180-6a659ab1eb7b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:11.754022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dfc4e41d-1688-48e5-b180-6a659ab1eb7b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:11.754755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dfc4e41d-1688-48e5-b180-6a659ab1eb7b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:11.755241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dfc4e41d-1688-48e5-b180-6a659ab1eb7b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:11.895766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dfc4e41d-1688-48e5-b180-6a659ab1eb7b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:11.904013 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dfc4e41d-1688-48e5-b180-6a659ab1eb7b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:11.905642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dfc4e41d-1688-48e5-b180-6a659ab1eb7b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:11.906923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dfc4e41d-1688-48e5-b180-6a659ab1eb7b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1725 microversion: 2.20 time: 0.164269 May 10 21:11:11.907659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 139/305] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:11 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:12.059837 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-dcf40c14-6919-4de1-b1d0-ccc586fdf94b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:12.060374 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-dcf40c14-6919-4de1-b1d0-ccc586fdf94b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:12.066505 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-dcf40c14-6919-4de1-b1d0-ccc586fdf94b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:12.066952 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-dcf40c14-6919-4de1-b1d0-ccc586fdf94b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:12.067817 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-dcf40c14-6919-4de1-b1d0-ccc586fdf94b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:12.068255 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-dcf40c14-6919-4de1-b1d0-ccc586fdf94b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:12.133306 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-dcf40c14-6919-4de1-b1d0-ccc586fdf94b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:12.141247 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-dcf40c14-6919-4de1-b1d0-ccc586fdf94b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1240 microversion: 2.1 time: 0.085296 May 10 21:11:12.141814 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 167/306] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:12 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:12.728872 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-27f9aaaf-a7dd-416f-b551-e5d2a28287af tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:12.729574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-27f9aaaf-a7dd-416f-b551-e5d2a28287af tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:12.737004 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27f9aaaf-a7dd-416f-b551-e5d2a28287af tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:12.737654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27f9aaaf-a7dd-416f-b551-e5d2a28287af tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:12.738737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27f9aaaf-a7dd-416f-b551-e5d2a28287af tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:12.739307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27f9aaaf-a7dd-416f-b551-e5d2a28287af tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:12.881157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-27f9aaaf-a7dd-416f-b551-e5d2a28287af tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a202c34c9497da2e4b7be1f0f33cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdda59eab7384e89b971e2378d2d1397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:12.888856 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-27f9aaaf-a7dd-416f-b551-e5d2a28287af tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf" status: 200 len: 1464 microversion: 2.1 time: 0.164093 May 10 21:11:12.901193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 140/307] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:12 2022] GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf => generated 1464 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:12.926011 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-fb94c37c-568f-40ba-9a77-c1521909475c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:12.926621 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-fb94c37c-568f-40ba-9a77-c1521909475c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:12.930230 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-afdacb71-3a18-4c28-bdc7-1d5e463886d2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:12.930764 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-afdacb71-3a18-4c28-bdc7-1d5e463886d2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:12.933049 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fb94c37c-568f-40ba-9a77-c1521909475c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:12.933496 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fb94c37c-568f-40ba-9a77-c1521909475c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:12.934261 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fb94c37c-568f-40ba-9a77-c1521909475c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:12.934690 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fb94c37c-568f-40ba-9a77-c1521909475c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:12.937881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-afdacb71-3a18-4c28-bdc7-1d5e463886d2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:12.938335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-afdacb71-3a18-4c28-bdc7-1d5e463886d2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:12.939113 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-afdacb71-3a18-4c28-bdc7-1d5e463886d2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:12.939584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-afdacb71-3a18-4c28-bdc7-1d5e463886d2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:12.965651 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-afdacb71-3a18-4c28-bdc7-1d5e463886d2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Going to try to terminate instance {{(pid=117714) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:11:13.067783 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-fb94c37c-568f-40ba-9a77-c1521909475c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:13.075431 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-fb94c37c-568f-40ba-9a77-c1521909475c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:13.077650 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-fb94c37c-568f-40ba-9a77-c1521909475c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:13.078803 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-fb94c37c-568f-40ba-9a77-c1521909475c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1725 microversion: 2.20 time: 0.156685 May 10 21:11:13.079379 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 168/308] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:12 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:13.158573 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-28d6e70d-f682-4905-9724-e8565fadfb09 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:13.159220 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-28d6e70d-f682-4905-9724-e8565fadfb09 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:13.165133 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-28d6e70d-f682-4905-9724-e8565fadfb09 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:13.165578 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-28d6e70d-f682-4905-9724-e8565fadfb09 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:13.166332 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-28d6e70d-f682-4905-9724-e8565fadfb09 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:13.166793 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-28d6e70d-f682-4905-9724-e8565fadfb09 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:13.238043 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-28d6e70d-f682-4905-9724-e8565fadfb09 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:13.247004 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-28d6e70d-f682-4905-9724-e8565fadfb09 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1296 microversion: 2.1 time: 0.092983 May 10 21:11:13.248259 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 169/309] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:13 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1296 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:11:13.311369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-afdacb71-3a18-4c28-bdc7-1d5e463886d2 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf" status: 204 len: 0 microversion: 2.1 time: 0.384054 May 10 21:11:13.312192 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 141/310] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 21:11:12 2022] DELETE /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 21:11:13.327049 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9c8f348c-6eec-4455-9851-2271a5ad636c tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:13.327699 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-9c8f348c-6eec-4455-9851-2271a5ad636c tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:13.333680 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9c8f348c-6eec-4455-9851-2271a5ad636c tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:13.334195 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9c8f348c-6eec-4455-9851-2271a5ad636c tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:13.335714 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9c8f348c-6eec-4455-9851-2271a5ad636c tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:13.336163 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9c8f348c-6eec-4455-9851-2271a5ad636c tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:13.465283 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-9c8f348c-6eec-4455-9851-2271a5ad636c tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a202c34c9497da2e4b7be1f0f33cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdda59eab7384e89b971e2378d2d1397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:13.473180 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9c8f348c-6eec-4455-9851-2271a5ad636c tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf" status: 200 len: 1470 microversion: 2.1 time: 0.150764 May 10 21:11:13.473745 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 170/311] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:13 2022] GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:13.837776 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-64465783-e4e3-4432-9046-0559e899f840 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:11:13.845106 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-64465783-e4e3-4432-9046-0559e899f840 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:13.845557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-64465783-e4e3-4432-9046-0559e899f840 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:13.906620 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-64465783-e4e3-4432-9046-0559e899f840 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Going to try to stop instance {{(pid=117714) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 21:11:14.097397 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-b033d7b9-5aee-49a3-b9c4-a6f4a9e50367 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:14.098007 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-b033d7b9-5aee-49a3-b9c4-a6f4a9e50367 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:14.104361 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b033d7b9-5aee-49a3-b9c4-a6f4a9e50367 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:14.104802 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b033d7b9-5aee-49a3-b9c4-a6f4a9e50367 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:14.105568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b033d7b9-5aee-49a3-b9c4-a6f4a9e50367 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:14.106003 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b033d7b9-5aee-49a3-b9c4-a6f4a9e50367 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:14.108459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-64465783-e4e3-4432-9046-0559e899f840 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "POST /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932/action" status: 202 len: 0 microversion: 2.1 time: 0.274819 May 10 21:11:14.109231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 142/312] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 21:11:13 2022] POST /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:11:14.117921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-253e90ba-2456-4ad1-8605-23b2cf0874f3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:14.118903 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-253e90ba-2456-4ad1-8605-23b2cf0874f3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:14.125549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-253e90ba-2456-4ad1-8605-23b2cf0874f3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:14.126048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-253e90ba-2456-4ad1-8605-23b2cf0874f3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:14.126828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-253e90ba-2456-4ad1-8605-23b2cf0874f3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:14.127332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-253e90ba-2456-4ad1-8605-23b2cf0874f3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:14.238302 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-b033d7b9-5aee-49a3-b9c4-a6f4a9e50367 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:14.245947 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-b033d7b9-5aee-49a3-b9c4-a6f4a9e50367 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:14.247463 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-b033d7b9-5aee-49a3-b9c4-a6f4a9e50367 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:14.249228 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-b033d7b9-5aee-49a3-b9c4-a6f4a9e50367 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1725 microversion: 2.20 time: 0.155841 May 10 21:11:14.249785 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 171/313] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:14 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:11:14.257029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-253e90ba-2456-4ad1-8605-23b2cf0874f3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:14.264376 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d56529ac-c976-4232-b86e-5072c46c84fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:14.265192 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d56529ac-c976-4232-b86e-5072c46c84fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:14.265943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-253e90ba-2456-4ad1-8605-23b2cf0874f3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1723 microversion: 2.1 time: 0.152564 May 10 21:11:14.266516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 143/314] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:14 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:11:14.271100 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d56529ac-c976-4232-b86e-5072c46c84fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:14.271585 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d56529ac-c976-4232-b86e-5072c46c84fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:14.272372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d56529ac-c976-4232-b86e-5072c46c84fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:14.272813 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d56529ac-c976-4232-b86e-5072c46c84fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:14.333507 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-d56529ac-c976-4232-b86e-5072c46c84fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:14.340938 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d56529ac-c976-4232-b86e-5072c46c84fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1304 microversion: 2.1 time: 0.080878 May 10 21:11:14.341513 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 172/315] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:14 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1304 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:11:14.491378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9337586a-2286-487e-b713-542a65671e0d tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:14.491907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9337586a-2286-487e-b713-542a65671e0d tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:14.497717 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9337586a-2286-487e-b713-542a65671e0d tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:14.498971 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9337586a-2286-487e-b713-542a65671e0d tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:14.499749 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9337586a-2286-487e-b713-542a65671e0d tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:14.500184 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9337586a-2286-487e-b713-542a65671e0d tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:14.640162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9337586a-2286-487e-b713-542a65671e0d tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a202c34c9497da2e4b7be1f0f33cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdda59eab7384e89b971e2378d2d1397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:14.647416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9337586a-2286-487e-b713-542a65671e0d tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf" status: 200 len: 1470 microversion: 2.1 time: 0.160104 May 10 21:11:14.647986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 144/316] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:14 2022] GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:15.268176 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9f49ffe5-b554-45ca-a734-7f23cbd63214 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:15.268870 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-9f49ffe5-b554-45ca-a734-7f23cbd63214 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:15.275453 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9f49ffe5-b554-45ca-a734-7f23cbd63214 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:15.275908 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9f49ffe5-b554-45ca-a734-7f23cbd63214 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:15.278213 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9f49ffe5-b554-45ca-a734-7f23cbd63214 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:15.278213 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9f49ffe5-b554-45ca-a734-7f23cbd63214 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:15.284583 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6e5a9631-4e7e-4db9-9f7e-48f101c8352b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:15.285198 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6e5a9631-4e7e-4db9-9f7e-48f101c8352b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:15.291820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6e5a9631-4e7e-4db9-9f7e-48f101c8352b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:15.292754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6e5a9631-4e7e-4db9-9f7e-48f101c8352b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:15.293038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6e5a9631-4e7e-4db9-9f7e-48f101c8352b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:15.293475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6e5a9631-4e7e-4db9-9f7e-48f101c8352b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:15.495511 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-9f49ffe5-b554-45ca-a734-7f23cbd63214 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:15.504718 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-9f49ffe5-b554-45ca-a734-7f23cbd63214 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:15.506491 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-9f49ffe5-b554-45ca-a734-7f23cbd63214 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:15.507696 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9f49ffe5-b554-45ca-a734-7f23cbd63214 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1725 microversion: 2.20 time: 0.244046 May 10 21:11:15.508263 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 173/317] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:15 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1725 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:15.512588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6e5a9631-4e7e-4db9-9f7e-48f101c8352b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:15.519331 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f42c5817-5e46-49fa-8697-b6631a4ac53a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:15.520054 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f42c5817-5e46-49fa-8697-b6631a4ac53a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:15.524925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6e5a9631-4e7e-4db9-9f7e-48f101c8352b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1723 microversion: 2.1 time: 0.245238 May 10 21:11:15.526280 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f42c5817-5e46-49fa-8697-b6631a4ac53a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:15.526741 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f42c5817-5e46-49fa-8697-b6631a4ac53a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:15.527465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 145/318] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:15 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:11:15.537957 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f42c5817-5e46-49fa-8697-b6631a4ac53a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:15.538557 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f42c5817-5e46-49fa-8697-b6631a4ac53a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:15.633041 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-f42c5817-5e46-49fa-8697-b6631a4ac53a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:15.645502 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f42c5817-5e46-49fa-8697-b6631a4ac53a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1302 microversion: 2.1 time: 0.132175 May 10 21:11:15.646810 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 174/319] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:15 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1302 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:15.664712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0dbde1b0-d341-4112-9023-19af503ba869 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:15.665548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0dbde1b0-d341-4112-9023-19af503ba869 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:15.672969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0dbde1b0-d341-4112-9023-19af503ba869 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:15.673587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0dbde1b0-d341-4112-9023-19af503ba869 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:15.674279 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0dbde1b0-d341-4112-9023-19af503ba869 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:15.674713 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0dbde1b0-d341-4112-9023-19af503ba869 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:15.894982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0dbde1b0-d341-4112-9023-19af503ba869 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a202c34c9497da2e4b7be1f0f33cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdda59eab7384e89b971e2378d2d1397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:15.902669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0dbde1b0-d341-4112-9023-19af503ba869 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf" status: 200 len: 1470 microversion: 2.1 time: 0.241742 May 10 21:11:15.913549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 146/320] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:15 2022] GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf => generated 1470 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:16.012095 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [req-6975ebb5-038a-4e40-8f9b-17ef66f6100a req-901e6566-af34-47f0-9334-2b9b0adf5b4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b9902c-9fde-4793-b50a-2a9cb43c5aaf", "name": "network-vif-deleted", "tag": "3f4011b8-8af6-42ec-8f9e-e7e2ad2cc3c7"}]} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:11:16.027350 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-6975ebb5-038a-4e40-8f9b-17ef66f6100a req-901e6566-af34-47f0-9334-2b9b0adf5b4e service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:16.028822 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-6975ebb5-038a-4e40-8f9b-17ef66f6100a req-901e6566-af34-47f0-9334-2b9b0adf5b4e service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:16.043730 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.compute.server_external_events [req-6975ebb5-038a-4e40-8f9b-17ef66f6100a req-901e6566-af34-47f0-9334-2b9b0adf5b4e service nova] Creating event network-vif-deleted:3f4011b8-8af6-42ec-8f9e-e7e2ad2cc3c7 for instance b5b9902c-9fde-4793-b50a-2a9cb43c5aaf on hv-cinder-82880 May 10 21:11:16.050994 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [req-6975ebb5-038a-4e40-8f9b-17ef66f6100a req-901e6566-af34-47f0-9334-2b9b0adf5b4e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042908 May 10 21:11:16.052547 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 175/321] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:11:16.526115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-70506fcc-382a-48a0-8f2b-5af040b2f663 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:16.526726 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-70506fcc-382a-48a0-8f2b-5af040b2f663 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:16.533735 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-70506fcc-382a-48a0-8f2b-5af040b2f663 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:16.534189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-70506fcc-382a-48a0-8f2b-5af040b2f663 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:16.534962 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-70506fcc-382a-48a0-8f2b-5af040b2f663 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:16.535434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-70506fcc-382a-48a0-8f2b-5af040b2f663 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:16.544798 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-dad1150b-b648-421a-a550-3ed61625ea60 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:16.545507 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-dad1150b-b648-421a-a550-3ed61625ea60 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:16.553557 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-dad1150b-b648-421a-a550-3ed61625ea60 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:16.555619 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-dad1150b-b648-421a-a550-3ed61625ea60 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:16.556619 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-dad1150b-b648-421a-a550-3ed61625ea60 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:16.557191 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-dad1150b-b648-421a-a550-3ed61625ea60 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:16.672286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-70506fcc-382a-48a0-8f2b-5af040b2f663 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:16.681009 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-70506fcc-382a-48a0-8f2b-5af040b2f663 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:16.682848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-70506fcc-382a-48a0-8f2b-5af040b2f663 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:16.684339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-70506fcc-382a-48a0-8f2b-5af040b2f663 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1746 microversion: 2.20 time: 0.162208 May 10 21:11:16.685456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 147/322] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:16 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:16.691582 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8bfe31f8-4170-4d46-80cf-6915cc73e457 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:16.692265 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8bfe31f8-4170-4d46-80cf-6915cc73e457 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:16.698296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8bfe31f8-4170-4d46-80cf-6915cc73e457 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:16.699005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8bfe31f8-4170-4d46-80cf-6915cc73e457 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:16.699973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8bfe31f8-4170-4d46-80cf-6915cc73e457 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:16.700415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8bfe31f8-4170-4d46-80cf-6915cc73e457 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:16.711374 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-dad1150b-b648-421a-a550-3ed61625ea60 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:16.723010 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-dad1150b-b648-421a-a550-3ed61625ea60 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1723 microversion: 2.1 time: 0.182779 May 10 21:11:16.724785 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 176/323] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:16 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:16.916950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8bfe31f8-4170-4d46-80cf-6915cc73e457 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:16.924329 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-ccb58393-fc61-45b3-b233-6d2c10a9b378 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:16.924871 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-ccb58393-fc61-45b3-b233-6d2c10a9b378 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:16.928409 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8bfe31f8-4170-4d46-80cf-6915cc73e457 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1370 microversion: 2.1 time: 0.241921 May 10 21:11:16.929275 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 148/324] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:16 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1370 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:16.939543 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ccb58393-fc61-45b3-b233-6d2c10a9b378 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:16.939543 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ccb58393-fc61-45b3-b233-6d2c10a9b378 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:16.939543 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ccb58393-fc61-45b3-b233-6d2c10a9b378 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:16.939543 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ccb58393-fc61-45b3-b233-6d2c10a9b378 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:16.982300 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ccb58393-fc61-45b3-b233-6d2c10a9b378 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:16.982300 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ccb58393-fc61-45b3-b233-6d2c10a9b378 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:16.982300 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.objects.instance [None req-ccb58393-fc61-45b3-b233-6d2c10a9b378 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lazy-loading 'fault' on Instance uuid b5b9902c-9fde-4793-b50a-2a9cb43c5aaf {{(pid=117713) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:11:17.040800 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-ccb58393-fc61-45b3-b233-6d2c10a9b378 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a202c34c9497da2e4b7be1f0f33cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdda59eab7384e89b971e2378d2d1397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:17.048194 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-ccb58393-fc61-45b3-b233-6d2c10a9b378 tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf" status: 200 len: 1304 microversion: 2.1 time: 0.131217 May 10 21:11:17.048769 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 177/325] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:16 2022] GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf => generated 1304 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:17.658615 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-cf2a2a87-94bf-4c96-9dd3-6983d0d9a243 req-aace0648-8ef9-4ae9-92ac-14a0018f9571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf6fc652-5ef0-417d-af13-69c7c058d50e", "tag": "ced08b04-cda9-4a73-82de-1764e13bc529"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:11:17.673906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-cf2a2a87-94bf-4c96-9dd3-6983d0d9a243 req-aace0648-8ef9-4ae9-92ac-14a0018f9571 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:17.674721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-cf2a2a87-94bf-4c96-9dd3-6983d0d9a243 req-aace0648-8ef9-4ae9-92ac-14a0018f9571 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:17.688132 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-cf2a2a87-94bf-4c96-9dd3-6983d0d9a243 req-aace0648-8ef9-4ae9-92ac-14a0018f9571 service nova] Creating event network-changed:ced08b04-cda9-4a73-82de-1764e13bc529 for instance cf6fc652-5ef0-417d-af13-69c7c058d50e on hv-cinder-82880 May 10 21:11:17.694392 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-cf2a2a87-94bf-4c96-9dd3-6983d0d9a243 req-aace0648-8ef9-4ae9-92ac-14a0018f9571 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041133 May 10 21:11:17.695392 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 149/326] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:11:17.705710 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-0d04ca49-86fd-4d68-94bd-726e317a33df tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:17.706317 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-0d04ca49-86fd-4d68-94bd-726e317a33df tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:17.715224 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0d04ca49-86fd-4d68-94bd-726e317a33df tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:17.715713 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0d04ca49-86fd-4d68-94bd-726e317a33df tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:17.716494 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0d04ca49-86fd-4d68-94bd-726e317a33df tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:17.717133 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0d04ca49-86fd-4d68-94bd-726e317a33df tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:17.745282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ead9dd00-caec-4f74-ba58-adfbc3581c3d tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:17.746125 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ead9dd00-caec-4f74-ba58-adfbc3581c3d tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:17.753800 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ead9dd00-caec-4f74-ba58-adfbc3581c3d tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:17.754514 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ead9dd00-caec-4f74-ba58-adfbc3581c3d tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:17.755497 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ead9dd00-caec-4f74-ba58-adfbc3581c3d tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:17.755930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ead9dd00-caec-4f74-ba58-adfbc3581c3d tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:17.884645 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-0d04ca49-86fd-4d68-94bd-726e317a33df tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:17.893485 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-0d04ca49-86fd-4d68-94bd-726e317a33df tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:17.894969 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-0d04ca49-86fd-4d68-94bd-726e317a33df tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:17.896230 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-0d04ca49-86fd-4d68-94bd-726e317a33df tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1746 microversion: 2.20 time: 0.195310 May 10 21:11:17.896799 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 178/327] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:17 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1746 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:11:17.947016 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e84e19ac-bbda-49ad-9d12-21fd08c3c6e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:17.947582 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e84e19ac-bbda-49ad-9d12-21fd08c3c6e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:17.953519 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e84e19ac-bbda-49ad-9d12-21fd08c3c6e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:17.954037 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e84e19ac-bbda-49ad-9d12-21fd08c3c6e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:17.954743 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e84e19ac-bbda-49ad-9d12-21fd08c3c6e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:17.955221 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e84e19ac-bbda-49ad-9d12-21fd08c3c6e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:18.049782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ead9dd00-caec-4f74-ba58-adfbc3581c3d tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:18.058524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ead9dd00-caec-4f74-ba58-adfbc3581c3d tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1723 microversion: 2.1 time: 0.321218 May 10 21:11:18.059448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 150/328] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:17 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1723 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:11:18.066534 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8e6d51b2-f31a-4b6e-b90a-332c6a874d8e tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:18.067376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8e6d51b2-f31a-4b6e-b90a-332c6a874d8e tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] [instance: b5b9902c-9fde-4793-b50a-2a9cb43c5aaf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:18.073969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e6d51b2-f31a-4b6e-b90a-332c6a874d8e tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:18.074576 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e6d51b2-f31a-4b6e-b90a-332c6a874d8e tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:18.075403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e6d51b2-f31a-4b6e-b90a-332c6a874d8e tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:18.076006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e6d51b2-f31a-4b6e-b90a-332c6a874d8e tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:18.090494 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-8e6d51b2-f31a-4b6e-b90a-332c6a874d8e tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] HTTP exception thrown: Instance b5b9902c-9fde-4793-b50a-2a9cb43c5aaf could not be found. May 10 21:11:18.093760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8e6d51b2-f31a-4b6e-b90a-332c6a874d8e tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Request method failure captured: May 10 21:11:18.093760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf HTTP/1.1 May 10 21:11:18.093760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:11:18.093760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:11:18.093760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:11:18.093760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:11:18.093760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:11:18.093760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:11:18.093760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:11:18.093760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:11:18.093760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietTJU_32SVnawkaS10h7QBKGbV4Rm1YY8wkDwOSJrkppuRnnULIoiPb4OQOAEezU5yf5a3fs_EzONEeSnukwKFjoO7ksmI2tdduJlgdJJlI_Ot-x_5x_8Kwdk86GZGBKBmh3Enpp5ffGjhNMSSQBWFGMhuSDvaVUSK30rIlzywJh9hw May 10 21:11:18.093760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:11:18.093760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:11:18.093760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:11:18.093760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:11:18.093760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:11:18.093760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:11:18.093760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: cdda59eab7384e89b971e2378d2d1397 May 10 21:11:18.093760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-VolumesNegativeTest-859951999 May 10 21:11:18.093760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:11:18.093760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:11:18.100176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdda59eab7384e89b971e2378d2d1397"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cdda59eab7384e89b971e2378d2d1397"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdda59eab7384e89b971e2378d2d1397"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cdda59eab7384e89b971e2378d2d1397", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:11:18.100176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-VolumesNegativeTest-859951999 May 10 21:11:18.100176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: cdda59eab7384e89b971e2378d2d1397 May 10 21:11:18.100176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-VolumesNegativeTest-859951999 May 10 21:11:18.100176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-VolumesNegativeTest-859951999-project May 10 21:11:18.100176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:11:18.100176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:11:18.100176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: d60a202c34c9497da2e4b7be1f0f33cf May 10 21:11:18.100176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-VolumesNegativeTest-859951999-project May 10 21:11:18.100176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:11:18.100176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance b5b9902c-9fde-4793-b50a-2a9cb43c5aaf could not be found. May 10 21:11:18.100176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': 'b5b9902c-9fde-4793-b50a-2a9cb43c5aaf'} May 10 21:11:18.101149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:11:18.101149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:11:18.101149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:11:18.101149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:11:18.101149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:11:18.101149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:11:18.101149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:11:18.101149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:11:18.101149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:11:18.101149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:11:18.101149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5b9902c-9fde-4793-b50a-2a9cb43c5aaf could not be found. May 10 21:11:18.101149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:11:18.101149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:11:18.101149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:11:18.101149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:11:18.101149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:11:18.101149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:11:18.101149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:11:18.101149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:11:18.101149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:11:18.102619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:11:18.102619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:11:18.102619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:11:18.102619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:11:18.102619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:11:18.102619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:11:18.102619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:11:18.102619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5b9902c-9fde-4793-b50a-2a9cb43c5aaf could not be found. May 10 21:11:18.102619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:11:18.102619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:11:18.102619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:11:18.102619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:11:18.102619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:11:18.102619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:11:18.102619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:11:18.102619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:11:18.102619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5b9902c-9fde-4793-b50a-2a9cb43c5aaf could not be found. May 10 21:11:18.102619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:11:18.103955 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8e6d51b2-f31a-4b6e-b90a-332c6a874d8e tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] Returning 404 to user: Instance b5b9902c-9fde-4793-b50a-2a9cb43c5aaf could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:11:18.103955 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8e6d51b2-f31a-4b6e-b90a-332c6a874d8e tempest-VolumesNegativeTest-859951999 tempest-VolumesNegativeTest-859951999-project] 10.222.0.49 "GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf" status: 404 len: 111 microversion: 2.1 time: 0.032997 May 10 21:11:18.103955 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 151/329] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:18 2022] GET /compute/v2.1/servers/b5b9902c-9fde-4793-b50a-2a9cb43c5aaf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:11:18.162816 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-e84e19ac-bbda-49ad-9d12-21fd08c3c6e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:18.171638 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e84e19ac-bbda-49ad-9d12-21fd08c3c6e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1370 microversion: 2.1 time: 0.227692 May 10 21:11:18.172385 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 179/330] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:17 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1370 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:11:18.915753 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-10ff8e9e-602d-4ccf-a41c-af915fed1bb4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:18.919527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-10ff8e9e-602d-4ccf-a41c-af915fed1bb4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:18.930522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-10ff8e9e-602d-4ccf-a41c-af915fed1bb4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:18.931609 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-10ff8e9e-602d-4ccf-a41c-af915fed1bb4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:18.932659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-10ff8e9e-602d-4ccf-a41c-af915fed1bb4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:18.933368 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-10ff8e9e-602d-4ccf-a41c-af915fed1bb4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:19.076802 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-95f32c33-052f-46ca-8432-358341d2e042 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:19.078075 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-95f32c33-052f-46ca-8432-358341d2e042 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:19.086533 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-95f32c33-052f-46ca-8432-358341d2e042 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:19.087553 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-95f32c33-052f-46ca-8432-358341d2e042 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:19.089245 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-95f32c33-052f-46ca-8432-358341d2e042 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:19.090071 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-95f32c33-052f-46ca-8432-358341d2e042 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:19.128476 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-10ff8e9e-602d-4ccf-a41c-af915fed1bb4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:19.146860 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-10ff8e9e-602d-4ccf-a41c-af915fed1bb4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:19.146860 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-10ff8e9e-602d-4ccf-a41c-af915fed1bb4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:19.152787 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-10ff8e9e-602d-4ccf-a41c-af915fed1bb4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1741 microversion: 2.20 time: 0.240951 May 10 21:11:19.153537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 152/331] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:18 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1741 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:19.189574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ca45ddeb-9e6b-45c0-bca8-58d630957bc9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:19.190469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ca45ddeb-9e6b-45c0-bca8-58d630957bc9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:19.197030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ca45ddeb-9e6b-45c0-bca8-58d630957bc9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:19.199762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ca45ddeb-9e6b-45c0-bca8-58d630957bc9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:19.200582 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ca45ddeb-9e6b-45c0-bca8-58d630957bc9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:19.203485 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ca45ddeb-9e6b-45c0-bca8-58d630957bc9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:19.430870 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-95f32c33-052f-46ca-8432-358341d2e042 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:19.440865 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-95f32c33-052f-46ca-8432-358341d2e042 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1723 microversion: 2.1 time: 0.368508 May 10 21:11:19.444369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ca45ddeb-9e6b-45c0-bca8-58d630957bc9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:19.456394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ca45ddeb-9e6b-45c0-bca8-58d630957bc9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1370 microversion: 2.1 time: 0.271410 May 10 21:11:19.459174 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 180/332] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:19 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1723 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:19.459331 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 153/333] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:19 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1370 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:20.181220 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-efc884d3-493b-4c3d-ab94-520612b35b21 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:20.182576 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-efc884d3-493b-4c3d-ab94-520612b35b21 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:20.197958 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-efc884d3-493b-4c3d-ab94-520612b35b21 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:20.201028 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-efc884d3-493b-4c3d-ab94-520612b35b21 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:20.202444 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-efc884d3-493b-4c3d-ab94-520612b35b21 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:20.203621 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-efc884d3-493b-4c3d-ab94-520612b35b21 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:20.367068 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-efc884d3-493b-4c3d-ab94-520612b35b21 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:20.376563 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-efc884d3-493b-4c3d-ab94-520612b35b21 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:20.390377 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-efc884d3-493b-4c3d-ab94-520612b35b21 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:20.390377 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-efc884d3-493b-4c3d-ab94-520612b35b21 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1741 microversion: 2.20 time: 0.213681 May 10 21:11:20.390377 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 181/334] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:20 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1741 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:20.475556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9987f088-b480-4a3e-b9a9-1223ecb9e30c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:20.480739 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9c9b1d6e-1e98-4f3f-aaed-e8d447c899a8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:20.481602 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-9c9b1d6e-1e98-4f3f-aaed-e8d447c899a8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:20.481841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9987f088-b480-4a3e-b9a9-1223ecb9e30c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:20.491318 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9987f088-b480-4a3e-b9a9-1223ecb9e30c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:20.495176 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9c9b1d6e-1e98-4f3f-aaed-e8d447c899a8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:20.495827 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9c9b1d6e-1e98-4f3f-aaed-e8d447c899a8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:20.496554 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9987f088-b480-4a3e-b9a9-1223ecb9e30c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:20.497577 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9c9b1d6e-1e98-4f3f-aaed-e8d447c899a8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:20.498616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9987f088-b480-4a3e-b9a9-1223ecb9e30c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:20.499373 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9c9b1d6e-1e98-4f3f-aaed-e8d447c899a8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:20.502072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9987f088-b480-4a3e-b9a9-1223ecb9e30c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:20.681487 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-9c9b1d6e-1e98-4f3f-aaed-e8d447c899a8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:20.695305 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9c9b1d6e-1e98-4f3f-aaed-e8d447c899a8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1723 microversion: 2.1 time: 0.218297 May 10 21:11:20.696662 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 182/335] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:20 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:20.714205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9987f088-b480-4a3e-b9a9-1223ecb9e30c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:20.727658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9987f088-b480-4a3e-b9a9-1223ecb9e30c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1370 microversion: 2.1 time: 0.254685 May 10 21:11:20.738105 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 154/336] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:20 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1370 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:20.878631 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [req-31426978-2da5-48f7-a3ce-acda26aa7940 req-cb01a340-7dbd-4e5a-a0a4-61eeaf38e51f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688d836a-358b-4815-80e9-f43bd14f5f93", "name": "network-vif-plugged", "status": "completed", "tag": "8d78546f-3c5c-4f44-9d56-4eb5e6c1e96f"}]} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:11:20.887448 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-31426978-2da5-48f7-a3ce-acda26aa7940 req-cb01a340-7dbd-4e5a-a0a4-61eeaf38e51f service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:20.888285 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-31426978-2da5-48f7-a3ce-acda26aa7940 req-cb01a340-7dbd-4e5a-a0a4-61eeaf38e51f service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:20.901679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.compute.server_external_events [req-31426978-2da5-48f7-a3ce-acda26aa7940 req-cb01a340-7dbd-4e5a-a0a4-61eeaf38e51f service nova] Creating event network-vif-plugged:8d78546f-3c5c-4f44-9d56-4eb5e6c1e96f for instance 688d836a-358b-4815-80e9-f43bd14f5f93 on hv-cinder-82880 May 10 21:11:20.908176 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [req-31426978-2da5-48f7-a3ce-acda26aa7940 req-cb01a340-7dbd-4e5a-a0a4-61eeaf38e51f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033868 May 10 21:11:20.908864 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 183/337] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:11:21.410892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9b349f91-22ea-47f1-951a-56ce5e904edb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:21.411437 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9b349f91-22ea-47f1-951a-56ce5e904edb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:21.417441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9b349f91-22ea-47f1-951a-56ce5e904edb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:21.425408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9b349f91-22ea-47f1-951a-56ce5e904edb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:21.425408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9b349f91-22ea-47f1-951a-56ce5e904edb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:21.425408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9b349f91-22ea-47f1-951a-56ce5e904edb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:21.593225 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9b349f91-22ea-47f1-951a-56ce5e904edb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:21.602363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9b349f91-22ea-47f1-951a-56ce5e904edb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:21.603995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9b349f91-22ea-47f1-951a-56ce5e904edb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:21.605587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9b349f91-22ea-47f1-951a-56ce5e904edb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1741 microversion: 2.20 time: 0.199044 May 10 21:11:21.606322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 155/338] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:21 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1741 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:11:21.715266 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-08b034b2-fd0c-4b36-bd77-1df4735a804a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:21.716367 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-08b034b2-fd0c-4b36-bd77-1df4735a804a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:21.725699 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-08b034b2-fd0c-4b36-bd77-1df4735a804a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:21.726336 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-08b034b2-fd0c-4b36-bd77-1df4735a804a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:21.727349 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-08b034b2-fd0c-4b36-bd77-1df4735a804a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:21.727941 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-08b034b2-fd0c-4b36-bd77-1df4735a804a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:21.747112 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ec49c578-09d3-4b82-86a3-4446d2c0d1b0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:21.747972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ec49c578-09d3-4b82-86a3-4446d2c0d1b0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:21.754497 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec49c578-09d3-4b82-86a3-4446d2c0d1b0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:21.755254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec49c578-09d3-4b82-86a3-4446d2c0d1b0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:21.756195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec49c578-09d3-4b82-86a3-4446d2c0d1b0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:21.756792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec49c578-09d3-4b82-86a3-4446d2c0d1b0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:21.960609 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-08b034b2-fd0c-4b36-bd77-1df4735a804a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:21.972965 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-08b034b2-fd0c-4b36-bd77-1df4735a804a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1723 microversion: 2.1 time: 0.262878 May 10 21:11:21.973633 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 184/339] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:21 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:22.022605 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ec49c578-09d3-4b82-86a3-4446d2c0d1b0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:22.031563 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ec49c578-09d3-4b82-86a3-4446d2c0d1b0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1370 microversion: 2.1 time: 0.288974 May 10 21:11:22.032152 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 156/340] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:21 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1370 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:11:22.623824 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-40774eb6-9340-4bb9-b249-83943c34b021 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:22.624432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-40774eb6-9340-4bb9-b249-83943c34b021 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:22.630369 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-40774eb6-9340-4bb9-b249-83943c34b021 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:22.630811 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-40774eb6-9340-4bb9-b249-83943c34b021 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:22.631591 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-40774eb6-9340-4bb9-b249-83943c34b021 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:22.632030 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-40774eb6-9340-4bb9-b249-83943c34b021 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:22.767698 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-40774eb6-9340-4bb9-b249-83943c34b021 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:22.780556 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-40774eb6-9340-4bb9-b249-83943c34b021 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:22.782725 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-40774eb6-9340-4bb9-b249-83943c34b021 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:22.787468 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-40774eb6-9340-4bb9-b249-83943c34b021 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1741 microversion: 2.20 time: 0.164037 May 10 21:11:22.787468 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 185/341] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:22 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:22.997378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3dd99d9c-7be1-4371-b340-be2c8c5f244b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:22.997378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3dd99d9c-7be1-4371-b340-be2c8c5f244b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:23.005292 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3dd99d9c-7be1-4371-b340-be2c8c5f244b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:23.005746 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3dd99d9c-7be1-4371-b340-be2c8c5f244b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:23.008490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3dd99d9c-7be1-4371-b340-be2c8c5f244b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:23.009100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3dd99d9c-7be1-4371-b340-be2c8c5f244b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:23.054765 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-886fe26c-c814-4bfa-b6d1-619c1c58721f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:23.061176 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-886fe26c-c814-4bfa-b6d1-619c1c58721f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:23.077420 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-886fe26c-c814-4bfa-b6d1-619c1c58721f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:23.084470 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-886fe26c-c814-4bfa-b6d1-619c1c58721f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:23.085683 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-886fe26c-c814-4bfa-b6d1-619c1c58721f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:23.086839 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-886fe26c-c814-4bfa-b6d1-619c1c58721f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:23.262137 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3dd99d9c-7be1-4371-b340-be2c8c5f244b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:23.272148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3dd99d9c-7be1-4371-b340-be2c8c5f244b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1723 microversion: 2.1 time: 0.284874 May 10 21:11:23.273019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 157/342] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:22 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:23.329023 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-886fe26c-c814-4bfa-b6d1-619c1c58721f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:23.339405 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-886fe26c-c814-4bfa-b6d1-619c1c58721f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1370 microversion: 2.1 time: 0.294024 May 10 21:11:23.353612 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 186/343] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:23 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1370 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:23.805811 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e6038a02-9b1a-43d8-bf96-607c528e1e88 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:23.806440 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e6038a02-9b1a-43d8-bf96-607c528e1e88 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:23.814082 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e6038a02-9b1a-43d8-bf96-607c528e1e88 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:23.814540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e6038a02-9b1a-43d8-bf96-607c528e1e88 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:23.815449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e6038a02-9b1a-43d8-bf96-607c528e1e88 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:23.815889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e6038a02-9b1a-43d8-bf96-607c528e1e88 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:24.233936 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e6038a02-9b1a-43d8-bf96-607c528e1e88 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:24.245792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e6038a02-9b1a-43d8-bf96-607c528e1e88 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:24.247422 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e6038a02-9b1a-43d8-bf96-607c528e1e88 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:24.248768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e6038a02-9b1a-43d8-bf96-607c528e1e88 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1741 microversion: 2.20 time: 0.449887 May 10 21:11:24.249607 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 158/344] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:23 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1741 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:24.290669 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-93384bf3-8cf9-4f56-8f7e-90f45023adbd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:24.291853 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-93384bf3-8cf9-4f56-8f7e-90f45023adbd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:24.303728 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-93384bf3-8cf9-4f56-8f7e-90f45023adbd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:24.304474 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-93384bf3-8cf9-4f56-8f7e-90f45023adbd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:24.305410 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-93384bf3-8cf9-4f56-8f7e-90f45023adbd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:24.305980 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-93384bf3-8cf9-4f56-8f7e-90f45023adbd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:24.356924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a0ea91e5-5c70-47f6-b136-7f172032e456 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:24.357952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a0ea91e5-5c70-47f6-b136-7f172032e456 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:24.366652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0ea91e5-5c70-47f6-b136-7f172032e456 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:24.377191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0ea91e5-5c70-47f6-b136-7f172032e456 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:24.378140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0ea91e5-5c70-47f6-b136-7f172032e456 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:24.378673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0ea91e5-5c70-47f6-b136-7f172032e456 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:24.474063 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-93384bf3-8cf9-4f56-8f7e-90f45023adbd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:24.484600 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-93384bf3-8cf9-4f56-8f7e-90f45023adbd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1723 microversion: 2.1 time: 0.198388 May 10 21:11:24.494830 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 187/345] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:24 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:24.566495 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a0ea91e5-5c70-47f6-b136-7f172032e456 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:24.574081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a0ea91e5-5c70-47f6-b136-7f172032e456 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1370 microversion: 2.1 time: 0.221060 May 10 21:11:24.574881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 159/346] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:24 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1370 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:25.267686 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-ed77e2aa-20d3-4445-b1e7-70df32e881fd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:25.268300 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-ed77e2aa-20d3-4445-b1e7-70df32e881fd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:25.274684 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ed77e2aa-20d3-4445-b1e7-70df32e881fd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:25.275411 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ed77e2aa-20d3-4445-b1e7-70df32e881fd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:25.276191 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ed77e2aa-20d3-4445-b1e7-70df32e881fd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:25.276630 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ed77e2aa-20d3-4445-b1e7-70df32e881fd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:25.417799 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-ed77e2aa-20d3-4445-b1e7-70df32e881fd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:25.430329 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-ed77e2aa-20d3-4445-b1e7-70df32e881fd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:25.432150 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-ed77e2aa-20d3-4445-b1e7-70df32e881fd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:25.433377 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-ed77e2aa-20d3-4445-b1e7-70df32e881fd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1741 microversion: 2.20 time: 0.170094 May 10 21:11:25.433963 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 188/347] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:25 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1741 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:25.501896 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7eee2d00-b972-412d-b188-170a067714dc tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:25.502509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7eee2d00-b972-412d-b188-170a067714dc tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:25.509530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7eee2d00-b972-412d-b188-170a067714dc tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:25.509985 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7eee2d00-b972-412d-b188-170a067714dc tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:25.510777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7eee2d00-b972-412d-b188-170a067714dc tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:25.511256 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7eee2d00-b972-412d-b188-170a067714dc tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:25.592715 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f0252169-beb9-41ba-a318-2ce93ed4b5c8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:25.594647 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f0252169-beb9-41ba-a318-2ce93ed4b5c8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:25.616811 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f0252169-beb9-41ba-a318-2ce93ed4b5c8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:25.617377 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f0252169-beb9-41ba-a318-2ce93ed4b5c8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:25.618431 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f0252169-beb9-41ba-a318-2ce93ed4b5c8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:25.619617 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f0252169-beb9-41ba-a318-2ce93ed4b5c8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:25.676791 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7eee2d00-b972-412d-b188-170a067714dc tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:25.686545 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7eee2d00-b972-412d-b188-170a067714dc tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1723 microversion: 2.1 time: 0.188478 May 10 21:11:25.687918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 160/348] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:25 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:25.794590 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-f0252169-beb9-41ba-a318-2ce93ed4b5c8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:25.803047 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f0252169-beb9-41ba-a318-2ce93ed4b5c8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1370 microversion: 2.1 time: 0.215756 May 10 21:11:25.812654 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 189/349] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:25 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1370 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:11:26.452059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a4b6dece-81ac-47ce-8d4a-a1b32da346f2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:26.452608 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a4b6dece-81ac-47ce-8d4a-a1b32da346f2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:26.459233 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a4b6dece-81ac-47ce-8d4a-a1b32da346f2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:26.459682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a4b6dece-81ac-47ce-8d4a-a1b32da346f2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:26.460438 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a4b6dece-81ac-47ce-8d4a-a1b32da346f2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:26.460871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a4b6dece-81ac-47ce-8d4a-a1b32da346f2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:26.588824 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a4b6dece-81ac-47ce-8d4a-a1b32da346f2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:26.597626 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a4b6dece-81ac-47ce-8d4a-a1b32da346f2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:26.599227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a4b6dece-81ac-47ce-8d4a-a1b32da346f2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:26.600474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a4b6dece-81ac-47ce-8d4a-a1b32da346f2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1741 microversion: 2.20 time: 0.152416 May 10 21:11:26.601180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 161/350] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:26 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1741 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:26.705622 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-98b2b64c-de9d-4126-a12f-f465ba428236 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:26.707023 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-98b2b64c-de9d-4126-a12f-f465ba428236 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:26.714158 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-98b2b64c-de9d-4126-a12f-f465ba428236 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:26.714872 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-98b2b64c-de9d-4126-a12f-f465ba428236 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:26.715880 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-98b2b64c-de9d-4126-a12f-f465ba428236 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:26.716323 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-98b2b64c-de9d-4126-a12f-f465ba428236 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:26.822686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-63b5c144-fa4f-45e2-87ab-e64f4089266c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:26.823623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-63b5c144-fa4f-45e2-87ab-e64f4089266c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:26.838834 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-63b5c144-fa4f-45e2-87ab-e64f4089266c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:26.839827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-63b5c144-fa4f-45e2-87ab-e64f4089266c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:26.840848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-63b5c144-fa4f-45e2-87ab-e64f4089266c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:26.841515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-63b5c144-fa4f-45e2-87ab-e64f4089266c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:26.860676 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-98b2b64c-de9d-4126-a12f-f465ba428236 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:26.869638 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-98b2b64c-de9d-4126-a12f-f465ba428236 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1723 microversion: 2.1 time: 0.168633 May 10 21:11:26.870219 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 190/351] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:26 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:26.989819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-63b5c144-fa4f-45e2-87ab-e64f4089266c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:26.997686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-63b5c144-fa4f-45e2-87ab-e64f4089266c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1370 microversion: 2.1 time: 0.179925 May 10 21:11:27.008071 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 162/352] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:26 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:11:27.618164 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-5799d1bf-4a57-4b64-86fb-ef99122f3a8f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:27.618782 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5799d1bf-4a57-4b64-86fb-ef99122f3a8f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:27.627794 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5799d1bf-4a57-4b64-86fb-ef99122f3a8f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:27.629081 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5799d1bf-4a57-4b64-86fb-ef99122f3a8f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:27.629081 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5799d1bf-4a57-4b64-86fb-ef99122f3a8f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:27.629421 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5799d1bf-4a57-4b64-86fb-ef99122f3a8f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:27.783149 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-5799d1bf-4a57-4b64-86fb-ef99122f3a8f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:27.792186 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-5799d1bf-4a57-4b64-86fb-ef99122f3a8f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:27.793727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-5799d1bf-4a57-4b64-86fb-ef99122f3a8f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:27.794875 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-5799d1bf-4a57-4b64-86fb-ef99122f3a8f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1741 microversion: 2.20 time: 0.180639 May 10 21:11:27.795490 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 191/353] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:27 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:27.887959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c850cc3f-1987-4777-9951-88c3feb03d33 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:27.888566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c850cc3f-1987-4777-9951-88c3feb03d33 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:27.895967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c850cc3f-1987-4777-9951-88c3feb03d33 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:27.896414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c850cc3f-1987-4777-9951-88c3feb03d33 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:27.897176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c850cc3f-1987-4777-9951-88c3feb03d33 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:27.897610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c850cc3f-1987-4777-9951-88c3feb03d33 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:28.015233 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-99f2abe6-7d6f-48de-8f2a-38943db95f29 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:28.016749 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-99f2abe6-7d6f-48de-8f2a-38943db95f29 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:28.024437 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-99f2abe6-7d6f-48de-8f2a-38943db95f29 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:28.025147 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-99f2abe6-7d6f-48de-8f2a-38943db95f29 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:28.026204 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-99f2abe6-7d6f-48de-8f2a-38943db95f29 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:28.026843 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-99f2abe6-7d6f-48de-8f2a-38943db95f29 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:28.043085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c850cc3f-1987-4777-9951-88c3feb03d33 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:28.053413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c850cc3f-1987-4777-9951-88c3feb03d33 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1723 microversion: 2.1 time: 0.169252 May 10 21:11:28.070130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 163/354] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:27 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:28.191599 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-99f2abe6-7d6f-48de-8f2a-38943db95f29 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:28.199930 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-99f2abe6-7d6f-48de-8f2a-38943db95f29 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1370 microversion: 2.1 time: 0.189156 May 10 21:11:28.201677 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 192/355] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:28 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1370 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:11:28.815570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5248e633-b907-4351-9470-22d7aef07011 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:28.816180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5248e633-b907-4351-9470-22d7aef07011 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:28.830899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5248e633-b907-4351-9470-22d7aef07011 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:28.831619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5248e633-b907-4351-9470-22d7aef07011 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:28.832552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5248e633-b907-4351-9470-22d7aef07011 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:28.833088 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5248e633-b907-4351-9470-22d7aef07011 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:28.992611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5248e633-b907-4351-9470-22d7aef07011 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:29.003375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5248e633-b907-4351-9470-22d7aef07011 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:29.005254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5248e633-b907-4351-9470-22d7aef07011 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:29.006858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5248e633-b907-4351-9470-22d7aef07011 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1741 microversion: 2.20 time: 0.196861 May 10 21:11:29.007674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 164/356] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:28 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1741 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:29.071476 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-cc949ccc-d638-464f-9f90-3c537a9980a8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:29.072078 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-cc949ccc-d638-464f-9f90-3c537a9980a8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:29.078710 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cc949ccc-d638-464f-9f90-3c537a9980a8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:29.079184 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cc949ccc-d638-464f-9f90-3c537a9980a8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:29.079962 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cc949ccc-d638-464f-9f90-3c537a9980a8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:29.080396 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cc949ccc-d638-464f-9f90-3c537a9980a8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:29.220149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cd538d0d-bf83-4dd6-8037-97790c0d557d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:29.221207 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cd538d0d-bf83-4dd6-8037-97790c0d557d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:29.227966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd538d0d-bf83-4dd6-8037-97790c0d557d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:29.228638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd538d0d-bf83-4dd6-8037-97790c0d557d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:29.230032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd538d0d-bf83-4dd6-8037-97790c0d557d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:29.230631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd538d0d-bf83-4dd6-8037-97790c0d557d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:29.236555 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-cc949ccc-d638-464f-9f90-3c537a9980a8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:29.247472 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-cc949ccc-d638-464f-9f90-3c537a9980a8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1723 microversion: 2.1 time: 0.180007 May 10 21:11:29.248311 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 193/357] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:29 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:29.403555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cd538d0d-bf83-4dd6-8037-97790c0d557d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:29.411955 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cd538d0d-bf83-4dd6-8037-97790c0d557d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1370 microversion: 2.1 time: 0.196391 May 10 21:11:29.412546 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 165/358] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:29 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1370 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:29.806146 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [req-c7db0b8a-20f3-40a6-a309-d4a548a42572 req-7e825da6-7b90-4c6b-8a39-d8d0473fa7cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf6fc652-5ef0-417d-af13-69c7c058d50e", "name": "network-vif-plugged", "status": "completed", "tag": "ced08b04-cda9-4a73-82de-1764e13bc529"}]} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:11:29.815104 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-c7db0b8a-20f3-40a6-a309-d4a548a42572 req-7e825da6-7b90-4c6b-8a39-d8d0473fa7cd service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:29.815580 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-c7db0b8a-20f3-40a6-a309-d4a548a42572 req-7e825da6-7b90-4c6b-8a39-d8d0473fa7cd service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:29.826001 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.compute.server_external_events [req-c7db0b8a-20f3-40a6-a309-d4a548a42572 req-7e825da6-7b90-4c6b-8a39-d8d0473fa7cd service nova] Creating event network-vif-plugged:ced08b04-cda9-4a73-82de-1764e13bc529 for instance cf6fc652-5ef0-417d-af13-69c7c058d50e on hv-cinder-82880 May 10 21:11:29.831638 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [req-c7db0b8a-20f3-40a6-a309-d4a548a42572 req-7e825da6-7b90-4c6b-8a39-d8d0473fa7cd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029272 May 10 21:11:29.832211 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 194/359] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:11:30.027440 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-056c4da9-d14c-4818-beb6-d17f9392a313 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:30.028057 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-056c4da9-d14c-4818-beb6-d17f9392a313 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:30.034512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-056c4da9-d14c-4818-beb6-d17f9392a313 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:30.034965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-056c4da9-d14c-4818-beb6-d17f9392a313 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:30.035790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-056c4da9-d14c-4818-beb6-d17f9392a313 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:30.036232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-056c4da9-d14c-4818-beb6-d17f9392a313 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:30.167090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-056c4da9-d14c-4818-beb6-d17f9392a313 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:30.175928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-056c4da9-d14c-4818-beb6-d17f9392a313 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:30.177505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-056c4da9-d14c-4818-beb6-d17f9392a313 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:30.178678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-056c4da9-d14c-4818-beb6-d17f9392a313 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1741 microversion: 2.20 time: 0.155161 May 10 21:11:30.189656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 166/360] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:30 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:30.275430 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a4525fd4-41fc-4326-b846-601194c5f489 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:30.276415 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a4525fd4-41fc-4326-b846-601194c5f489 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:30.286078 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a4525fd4-41fc-4326-b846-601194c5f489 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:30.286530 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a4525fd4-41fc-4326-b846-601194c5f489 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:30.287350 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a4525fd4-41fc-4326-b846-601194c5f489 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:30.287815 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a4525fd4-41fc-4326-b846-601194c5f489 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:30.429507 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-49fa6ec4-a544-42ec-8b02-0214ee181d12 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:30.430205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-49fa6ec4-a544-42ec-8b02-0214ee181d12 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:30.440717 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-49fa6ec4-a544-42ec-8b02-0214ee181d12 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:30.441446 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-49fa6ec4-a544-42ec-8b02-0214ee181d12 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:30.442603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-49fa6ec4-a544-42ec-8b02-0214ee181d12 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:30.443230 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-49fa6ec4-a544-42ec-8b02-0214ee181d12 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:30.459275 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-a4525fd4-41fc-4326-b846-601194c5f489 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:30.471844 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a4525fd4-41fc-4326-b846-601194c5f489 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1723 microversion: 2.1 time: 0.204255 May 10 21:11:30.475702 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 195/361] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:30 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:30.596948 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-49fa6ec4-a544-42ec-8b02-0214ee181d12 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:30.604566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-49fa6ec4-a544-42ec-8b02-0214ee181d12 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1370 microversion: 2.1 time: 0.179219 May 10 21:11:30.605385 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 167/362] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:30 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:31.197495 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d862fd0d-29bb-4e53-87c9-48729947bf63 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:31.197853 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d862fd0d-29bb-4e53-87c9-48729947bf63 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:31.204050 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d862fd0d-29bb-4e53-87c9-48729947bf63 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:31.204499 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d862fd0d-29bb-4e53-87c9-48729947bf63 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:31.205334 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d862fd0d-29bb-4e53-87c9-48729947bf63 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:31.205911 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d862fd0d-29bb-4e53-87c9-48729947bf63 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:31.341241 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-d862fd0d-29bb-4e53-87c9-48729947bf63 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:31.349228 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-d862fd0d-29bb-4e53-87c9-48729947bf63 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:31.350699 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-d862fd0d-29bb-4e53-87c9-48729947bf63 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:31.353640 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d862fd0d-29bb-4e53-87c9-48729947bf63 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1741 microversion: 2.20 time: 0.158917 May 10 21:11:31.353640 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 196/363] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:31 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1741 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:31.488575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5b613000-923e-42c0-a5b9-48fbf743e566 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:31.489191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5b613000-923e-42c0-a5b9-48fbf743e566 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:31.495525 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b613000-923e-42c0-a5b9-48fbf743e566 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:31.495989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b613000-923e-42c0-a5b9-48fbf743e566 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:31.496752 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b613000-923e-42c0-a5b9-48fbf743e566 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:31.497191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b613000-923e-42c0-a5b9-48fbf743e566 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:31.621514 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-625326de-1e69-49d4-9529-765c51cc40f4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:31.622282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-625326de-1e69-49d4-9529-765c51cc40f4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:31.624592 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5b613000-923e-42c0-a5b9-48fbf743e566 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:31.629084 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-625326de-1e69-49d4-9529-765c51cc40f4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:31.629528 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-625326de-1e69-49d4-9529-765c51cc40f4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:31.630298 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-625326de-1e69-49d4-9529-765c51cc40f4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:31.630764 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-625326de-1e69-49d4-9529-765c51cc40f4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:31.633213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5b613000-923e-42c0-a5b9-48fbf743e566 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1723 microversion: 2.1 time: 0.148478 May 10 21:11:31.633855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 168/364] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:31 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:31.753250 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-625326de-1e69-49d4-9529-765c51cc40f4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:31.760563 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-625326de-1e69-49d4-9529-765c51cc40f4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1370 microversion: 2.1 time: 0.142933 May 10 21:11:31.761125 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 197/365] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:31 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1370 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:11:32.369702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b5676516-a9da-44e9-b42c-0e9c44171113 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:32.370324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b5676516-a9da-44e9-b42c-0e9c44171113 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:32.376374 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5676516-a9da-44e9-b42c-0e9c44171113 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:32.376829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5676516-a9da-44e9-b42c-0e9c44171113 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:32.377597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5676516-a9da-44e9-b42c-0e9c44171113 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:32.378035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5676516-a9da-44e9-b42c-0e9c44171113 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:32.505842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b5676516-a9da-44e9-b42c-0e9c44171113 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:32.513532 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b5676516-a9da-44e9-b42c-0e9c44171113 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:32.515028 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b5676516-a9da-44e9-b42c-0e9c44171113 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:32.516797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b5676516-a9da-44e9-b42c-0e9c44171113 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1741 microversion: 2.20 time: 0.151011 May 10 21:11:32.517374 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 169/366] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:32 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1741 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:32.650188 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-2beac216-1ac3-4a0b-b5a0-bc74081056e8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:32.650725 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-2beac216-1ac3-4a0b-b5a0-bc74081056e8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:32.657617 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2beac216-1ac3-4a0b-b5a0-bc74081056e8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:32.658061 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2beac216-1ac3-4a0b-b5a0-bc74081056e8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:32.658847 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2beac216-1ac3-4a0b-b5a0-bc74081056e8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:32.659341 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2beac216-1ac3-4a0b-b5a0-bc74081056e8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:32.777392 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6a9b6f9a-5bfb-4f64-ad59-871bd2fa50a1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:32.778020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6a9b6f9a-5bfb-4f64-ad59-871bd2fa50a1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:32.786526 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a9b6f9a-5bfb-4f64-ad59-871bd2fa50a1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:32.787303 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a9b6f9a-5bfb-4f64-ad59-871bd2fa50a1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:32.788325 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a9b6f9a-5bfb-4f64-ad59-871bd2fa50a1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:32.788919 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a9b6f9a-5bfb-4f64-ad59-871bd2fa50a1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:32.807502 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-2beac216-1ac3-4a0b-b5a0-bc74081056e8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:32.824980 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-2beac216-1ac3-4a0b-b5a0-bc74081056e8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1723 microversion: 2.1 time: 0.178602 May 10 21:11:32.831173 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 198/367] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:32 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:32.954371 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6a9b6f9a-5bfb-4f64-ad59-871bd2fa50a1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:32.962879 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6a9b6f9a-5bfb-4f64-ad59-871bd2fa50a1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1370 microversion: 2.1 time: 0.189466 May 10 21:11:32.963524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 170/368] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:32 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1370 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:33.534950 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-718e623b-6cdf-443c-a009-d3eec8ee1874 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:33.535522 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-718e623b-6cdf-443c-a009-d3eec8ee1874 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:33.541850 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-718e623b-6cdf-443c-a009-d3eec8ee1874 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:33.542266 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-718e623b-6cdf-443c-a009-d3eec8ee1874 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:33.542979 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-718e623b-6cdf-443c-a009-d3eec8ee1874 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:33.543548 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-718e623b-6cdf-443c-a009-d3eec8ee1874 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:33.668275 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-718e623b-6cdf-443c-a009-d3eec8ee1874 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:33.676016 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-718e623b-6cdf-443c-a009-d3eec8ee1874 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:33.677519 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-718e623b-6cdf-443c-a009-d3eec8ee1874 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:33.678676 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-718e623b-6cdf-443c-a009-d3eec8ee1874 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1741 microversion: 2.20 time: 0.147930 May 10 21:11:33.679288 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 199/369] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:33 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1741 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:33.841767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-05d06e19-7b98-4110-ad3e-465403dbf151 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:33.842391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-05d06e19-7b98-4110-ad3e-465403dbf151 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:33.848989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-05d06e19-7b98-4110-ad3e-465403dbf151 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:33.849471 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-05d06e19-7b98-4110-ad3e-465403dbf151 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:33.850241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-05d06e19-7b98-4110-ad3e-465403dbf151 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:33.850678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-05d06e19-7b98-4110-ad3e-465403dbf151 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:33.980831 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-3f20c18d-03a6-4f20-837c-d4753cc56824 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:33.981520 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-3f20c18d-03a6-4f20-837c-d4753cc56824 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:33.984040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-05d06e19-7b98-4110-ad3e-465403dbf151 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:33.988068 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3f20c18d-03a6-4f20-837c-d4753cc56824 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:33.988604 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3f20c18d-03a6-4f20-837c-d4753cc56824 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:33.989466 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3f20c18d-03a6-4f20-837c-d4753cc56824 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:33.989985 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3f20c18d-03a6-4f20-837c-d4753cc56824 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:33.993263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-05d06e19-7b98-4110-ad3e-465403dbf151 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1700 microversion: 2.1 time: 0.155438 May 10 21:11:33.993838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 171/370] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:33 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1700 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:34.010318 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0eb3805e-b90b-4bff-ad78-0b7daee6d6bc tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:11:34.017215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0eb3805e-b90b-4bff-ad78-0b7daee6d6bc tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:34.017671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0eb3805e-b90b-4bff-ad78-0b7daee6d6bc tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:34.040074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0eb3805e-b90b-4bff-ad78-0b7daee6d6bc tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Going to try to start instance {{(pid=117714) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 21:11:34.124305 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-3f20c18d-03a6-4f20-837c-d4753cc56824 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:34.132666 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-3f20c18d-03a6-4f20-837c-d4753cc56824 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1370 microversion: 2.1 time: 0.155718 May 10 21:11:34.133235 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 200/371] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:33 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:11:34.252171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0eb3805e-b90b-4bff-ad78-0b7daee6d6bc tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "POST /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932/action" status: 202 len: 0 microversion: 2.1 time: 0.243230 May 10 21:11:34.252171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 172/372] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 21:11:34 2022] POST /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 21:11:34.258961 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-46e9ae79-a576-4098-81bf-45ace37b9b66 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:34.259607 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-46e9ae79-a576-4098-81bf-45ace37b9b66 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:34.265796 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-46e9ae79-a576-4098-81bf-45ace37b9b66 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:34.266255 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-46e9ae79-a576-4098-81bf-45ace37b9b66 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:34.267022 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-46e9ae79-a576-4098-81bf-45ace37b9b66 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:34.267574 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-46e9ae79-a576-4098-81bf-45ace37b9b66 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:34.398948 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-46e9ae79-a576-4098-81bf-45ace37b9b66 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:34.407745 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-46e9ae79-a576-4098-81bf-45ace37b9b66 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1709 microversion: 2.1 time: 0.152442 May 10 21:11:34.408259 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 201/373] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:34 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1709 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:34.697730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-99ae40fd-8fda-4dc4-93ec-ff959a9978c7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:34.698441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-99ae40fd-8fda-4dc4-93ec-ff959a9978c7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:34.705757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-99ae40fd-8fda-4dc4-93ec-ff959a9978c7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:34.706205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-99ae40fd-8fda-4dc4-93ec-ff959a9978c7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:34.706970 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-99ae40fd-8fda-4dc4-93ec-ff959a9978c7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:34.707436 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-99ae40fd-8fda-4dc4-93ec-ff959a9978c7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:34.838704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-99ae40fd-8fda-4dc4-93ec-ff959a9978c7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:34.848320 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-99ae40fd-8fda-4dc4-93ec-ff959a9978c7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:34.849825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-99ae40fd-8fda-4dc4-93ec-ff959a9978c7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:34.851010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-99ae40fd-8fda-4dc4-93ec-ff959a9978c7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1741 microversion: 2.20 time: 0.157619 May 10 21:11:34.851601 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 173/374] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:34 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:35.150551 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9dfef8b5-aff2-4f01-99d1-64bf7fe1be75 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:35.151186 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-9dfef8b5-aff2-4f01-99d1-64bf7fe1be75 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:35.158259 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9dfef8b5-aff2-4f01-99d1-64bf7fe1be75 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:35.158705 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9dfef8b5-aff2-4f01-99d1-64bf7fe1be75 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:35.159487 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9dfef8b5-aff2-4f01-99d1-64bf7fe1be75 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:35.159922 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9dfef8b5-aff2-4f01-99d1-64bf7fe1be75 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:35.286668 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-9dfef8b5-aff2-4f01-99d1-64bf7fe1be75 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:35.293939 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9dfef8b5-aff2-4f01-99d1-64bf7fe1be75 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1370 microversion: 2.1 time: 0.147301 May 10 21:11:35.294498 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 202/375] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:35 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:35.424706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-76d40ed2-7890-42d6-91a2-8ba86604860e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:35.425247 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-76d40ed2-7890-42d6-91a2-8ba86604860e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:35.431225 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76d40ed2-7890-42d6-91a2-8ba86604860e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:35.431683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76d40ed2-7890-42d6-91a2-8ba86604860e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:35.432447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76d40ed2-7890-42d6-91a2-8ba86604860e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:35.432885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76d40ed2-7890-42d6-91a2-8ba86604860e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:35.557812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-76d40ed2-7890-42d6-91a2-8ba86604860e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:35.565799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-76d40ed2-7890-42d6-91a2-8ba86604860e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1709 microversion: 2.1 time: 0.144937 May 10 21:11:35.566358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 174/376] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:35 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1709 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:35.874035 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-961ec4e5-4809-42bf-8608-085d83d6e668 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:35.874645 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-961ec4e5-4809-42bf-8608-085d83d6e668 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:35.881789 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-961ec4e5-4809-42bf-8608-085d83d6e668 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:35.882242 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-961ec4e5-4809-42bf-8608-085d83d6e668 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:35.883145 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-961ec4e5-4809-42bf-8608-085d83d6e668 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:35.883604 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-961ec4e5-4809-42bf-8608-085d83d6e668 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:36.019818 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-961ec4e5-4809-42bf-8608-085d83d6e668 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:36.027697 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-961ec4e5-4809-42bf-8608-085d83d6e668 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:36.029203 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-961ec4e5-4809-42bf-8608-085d83d6e668 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:36.030349 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-961ec4e5-4809-42bf-8608-085d83d6e668 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1741 microversion: 2.20 time: 0.160311 May 10 21:11:36.030960 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 203/377] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:35 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1741 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:36.311642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0e0df721-6bc4-4def-a833-d20d069a06c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:36.312257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0e0df721-6bc4-4def-a833-d20d069a06c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:36.319525 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0e0df721-6bc4-4def-a833-d20d069a06c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:36.319994 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0e0df721-6bc4-4def-a833-d20d069a06c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:36.320787 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0e0df721-6bc4-4def-a833-d20d069a06c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:36.321231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0e0df721-6bc4-4def-a833-d20d069a06c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:36.462549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0e0df721-6bc4-4def-a833-d20d069a06c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:36.470496 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0e0df721-6bc4-4def-a833-d20d069a06c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1370 microversion: 2.1 time: 0.162956 May 10 21:11:36.472070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 175/378] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:36 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:36.583025 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-62c8a123-cc68-43fd-a449-9d1a0edb62f8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:36.583677 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-62c8a123-cc68-43fd-a449-9d1a0edb62f8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:36.590038 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-62c8a123-cc68-43fd-a449-9d1a0edb62f8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:36.590495 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-62c8a123-cc68-43fd-a449-9d1a0edb62f8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:36.591303 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-62c8a123-cc68-43fd-a449-9d1a0edb62f8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:36.591751 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-62c8a123-cc68-43fd-a449-9d1a0edb62f8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:36.722333 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-62c8a123-cc68-43fd-a449-9d1a0edb62f8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:36.730448 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-62c8a123-cc68-43fd-a449-9d1a0edb62f8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1709 microversion: 2.1 time: 0.151916 May 10 21:11:36.731007 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 204/379] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:36 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1709 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:37.049552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-72afbe20-535a-47d2-a4bc-5512b5144e23 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:37.050083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-72afbe20-535a-47d2-a4bc-5512b5144e23 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:37.056038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-72afbe20-535a-47d2-a4bc-5512b5144e23 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:37.056487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-72afbe20-535a-47d2-a4bc-5512b5144e23 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:37.057243 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-72afbe20-535a-47d2-a4bc-5512b5144e23 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:37.057674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-72afbe20-535a-47d2-a4bc-5512b5144e23 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:37.185457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-72afbe20-535a-47d2-a4bc-5512b5144e23 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:37.193909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-72afbe20-535a-47d2-a4bc-5512b5144e23 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:37.195426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-72afbe20-535a-47d2-a4bc-5512b5144e23 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:37.196569 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-72afbe20-535a-47d2-a4bc-5512b5144e23 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1723 microversion: 2.20 time: 0.151167 May 10 21:11:37.197124 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 176/380] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:37 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:37.487240 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-4cb374e2-14e7-474e-9bdf-6945e81a78b2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:37.487852 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-4cb374e2-14e7-474e-9bdf-6945e81a78b2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:37.493735 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4cb374e2-14e7-474e-9bdf-6945e81a78b2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:37.494187 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4cb374e2-14e7-474e-9bdf-6945e81a78b2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:37.494951 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4cb374e2-14e7-474e-9bdf-6945e81a78b2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:37.495420 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4cb374e2-14e7-474e-9bdf-6945e81a78b2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:37.629926 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-4cb374e2-14e7-474e-9bdf-6945e81a78b2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:37.637393 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-4cb374e2-14e7-474e-9bdf-6945e81a78b2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1370 microversion: 2.1 time: 0.154243 May 10 21:11:37.637954 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 205/381] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:37 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:37.747398 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2f5341fe-be23-4a27-a388-bfc5a9076039 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:37.747936 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2f5341fe-be23-4a27-a388-bfc5a9076039 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:37.755351 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2f5341fe-be23-4a27-a388-bfc5a9076039 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:37.755807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2f5341fe-be23-4a27-a388-bfc5a9076039 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:37.760032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2f5341fe-be23-4a27-a388-bfc5a9076039 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:37.760032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2f5341fe-be23-4a27-a388-bfc5a9076039 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:37.895486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2f5341fe-be23-4a27-a388-bfc5a9076039 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:37.903479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2f5341fe-be23-4a27-a388-bfc5a9076039 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1709 microversion: 2.1 time: 0.159881 May 10 21:11:37.904045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 177/382] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:37 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1709 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:38.215539 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-fd152501-e948-4a3f-97b7-f42c1ada0def tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:38.216159 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-fd152501-e948-4a3f-97b7-f42c1ada0def tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:38.222956 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fd152501-e948-4a3f-97b7-f42c1ada0def tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:38.223444 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fd152501-e948-4a3f-97b7-f42c1ada0def tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:38.224401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fd152501-e948-4a3f-97b7-f42c1ada0def tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:38.225013 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fd152501-e948-4a3f-97b7-f42c1ada0def tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:38.276479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-b17b64c9-401a-432f-aa37-c37c1646bce9 req-c5369cbc-62ae-4c52-9c6d-00f1632349bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688d836a-358b-4815-80e9-f43bd14f5f93", "name": "network-vif-unplugged", "status": "completed", "tag": "8d78546f-3c5c-4f44-9d56-4eb5e6c1e96f"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:11:38.285584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-b17b64c9-401a-432f-aa37-c37c1646bce9 req-c5369cbc-62ae-4c52-9c6d-00f1632349bb service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:38.286025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-b17b64c9-401a-432f-aa37-c37c1646bce9 req-c5369cbc-62ae-4c52-9c6d-00f1632349bb service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:38.298002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-b17b64c9-401a-432f-aa37-c37c1646bce9 req-c5369cbc-62ae-4c52-9c6d-00f1632349bb service nova] Creating event network-vif-unplugged:8d78546f-3c5c-4f44-9d56-4eb5e6c1e96f for instance 688d836a-358b-4815-80e9-f43bd14f5f93 on hv-cinder-82880 May 10 21:11:38.303414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-b17b64c9-401a-432f-aa37-c37c1646bce9 req-c5369cbc-62ae-4c52-9c6d-00f1632349bb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030799 May 10 21:11:38.304015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 178/383] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:11:38.370049 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-fd152501-e948-4a3f-97b7-f42c1ada0def tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:38.380176 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-fd152501-e948-4a3f-97b7-f42c1ada0def tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:38.381967 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-fd152501-e948-4a3f-97b7-f42c1ada0def tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:38.383553 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-fd152501-e948-4a3f-97b7-f42c1ada0def tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1723 microversion: 2.20 time: 0.171897 May 10 21:11:38.384437 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 206/384] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:38 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:38.655983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a9394319-906e-4536-81a0-30125b034a8b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:38.657301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a9394319-906e-4536-81a0-30125b034a8b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:38.663620 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a9394319-906e-4536-81a0-30125b034a8b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:38.664090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a9394319-906e-4536-81a0-30125b034a8b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:38.664973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a9394319-906e-4536-81a0-30125b034a8b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:38.665406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a9394319-906e-4536-81a0-30125b034a8b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:38.799544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a9394319-906e-4536-81a0-30125b034a8b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:38.807488 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a9394319-906e-4536-81a0-30125b034a8b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1370 microversion: 2.1 time: 0.156324 May 10 21:11:38.808385 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 179/385] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:38 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:38.921629 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-7512538d-5e0c-4e21-a13e-4071a7bbfbb0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:38.922809 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-7512538d-5e0c-4e21-a13e-4071a7bbfbb0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:38.929137 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7512538d-5e0c-4e21-a13e-4071a7bbfbb0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:38.929590 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7512538d-5e0c-4e21-a13e-4071a7bbfbb0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:38.930367 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7512538d-5e0c-4e21-a13e-4071a7bbfbb0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:38.930808 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7512538d-5e0c-4e21-a13e-4071a7bbfbb0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:39.066833 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-7512538d-5e0c-4e21-a13e-4071a7bbfbb0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:39.074737 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-7512538d-5e0c-4e21-a13e-4071a7bbfbb0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1709 microversion: 2.1 time: 0.156914 May 10 21:11:39.075330 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 207/386] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:38 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1709 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:11:39.402361 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0c59c976-c66d-433e-9dc4-3534421156c9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:39.403147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0c59c976-c66d-433e-9dc4-3534421156c9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:39.410860 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c59c976-c66d-433e-9dc4-3534421156c9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:39.411350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c59c976-c66d-433e-9dc4-3534421156c9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:39.412265 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c59c976-c66d-433e-9dc4-3534421156c9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:39.412698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c59c976-c66d-433e-9dc4-3534421156c9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:39.635562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0c59c976-c66d-433e-9dc4-3534421156c9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:39.644178 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0c59c976-c66d-433e-9dc4-3534421156c9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:39.645691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0c59c976-c66d-433e-9dc4-3534421156c9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:39.646860 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0c59c976-c66d-433e-9dc4-3534421156c9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1723 microversion: 2.20 time: 0.248773 May 10 21:11:39.647455 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 180/387] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:39 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:39.824608 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-abe70ecd-89f2-4726-8b4e-c31db5914940 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:39.825222 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-abe70ecd-89f2-4726-8b4e-c31db5914940 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:39.831809 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-abe70ecd-89f2-4726-8b4e-c31db5914940 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:39.832260 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-abe70ecd-89f2-4726-8b4e-c31db5914940 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:39.833026 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-abe70ecd-89f2-4726-8b4e-c31db5914940 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:39.833467 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-abe70ecd-89f2-4726-8b4e-c31db5914940 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:39.972206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2722a07d-164c-4539-a5a0-68dac002dbdc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Action: 'create', calling method: .version_select at 0x7f85d5e818b0>, body: {"keypair": {"name": "tempest-keypair-1354916562", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcmBqjEE6LTv8uBNyt76jzVdc10kCX5PUcA7SrM7dseCkFWnVpt90B3/pU9T2aO3/lv/PKJDVqE9vhIdes70Nxwx4Al8fASYMYf6C55a9mYz8EMH/tuqAN6VNS+6aFU3A=="}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:11:39.989073 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-2722a07d-164c-4539-a5a0-68dac002dbdc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Getting quotas for project 9582743483fa4fb88f4e91d3f787c945. Resources: {'key_pairs'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:11:39.993925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-2722a07d-164c-4539-a5a0-68dac002dbdc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Getting quotas for user 62bc5605a22d408f9b4bac69a0f5f486 and project 9582743483fa4fb88f4e91d3f787c945. Resources: {'key_pairs'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:11:40.026286 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-abe70ecd-89f2-4726-8b4e-c31db5914940 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:40.034767 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-abe70ecd-89f2-4726-8b4e-c31db5914940 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1370 microversion: 2.1 time: 0.213974 May 10 21:11:40.035365 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 208/388] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:39 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1370 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:40.092041 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e55551c6-f81e-4143-9ab0-01c270022297 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:40.092720 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e55551c6-f81e-4143-9ab0-01c270022297 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:40.101331 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e55551c6-f81e-4143-9ab0-01c270022297 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:40.101331 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e55551c6-f81e-4143-9ab0-01c270022297 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:40.101331 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e55551c6-f81e-4143-9ab0-01c270022297 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:40.101991 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2722a07d-164c-4539-a5a0-68dac002dbdc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.133568 May 10 21:11:40.102146 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e55551c6-f81e-4143-9ab0-01c270022297 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:40.102774 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 181/389] 10.222.0.49 () {60 vars in 1158 bytes} [Tue May 10 21:11:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:11:40.346450 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-e55551c6-f81e-4143-9ab0-01c270022297 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:40.354318 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e55551c6-f81e-4143-9ab0-01c270022297 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1709 microversion: 2.1 time: 0.266345 May 10 21:11:40.354892 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 209/390] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:40 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1709 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:11:40.665811 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-08bd29b5-0752-4cbb-aeff-e3342c238db4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:40.666448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-08bd29b5-0752-4cbb-aeff-e3342c238db4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:40.673157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-08bd29b5-0752-4cbb-aeff-e3342c238db4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:40.673836 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-08bd29b5-0752-4cbb-aeff-e3342c238db4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:40.675442 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-08bd29b5-0752-4cbb-aeff-e3342c238db4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:40.675442 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-08bd29b5-0752-4cbb-aeff-e3342c238db4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:40.822809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-08bd29b5-0752-4cbb-aeff-e3342c238db4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:40.833460 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-08bd29b5-0752-4cbb-aeff-e3342c238db4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:40.835034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-08bd29b5-0752-4cbb-aeff-e3342c238db4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:40.836296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-08bd29b5-0752-4cbb-aeff-e3342c238db4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1723 microversion: 2.20 time: 0.174540 May 10 21:11:40.836893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 182/391] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:40 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:41.051993 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-88d0422e-4f65-4a14-9a29-e8a45fff2725 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:41.053216 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-88d0422e-4f65-4a14-9a29-e8a45fff2725 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:41.059999 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-88d0422e-4f65-4a14-9a29-e8a45fff2725 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:41.060596 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-88d0422e-4f65-4a14-9a29-e8a45fff2725 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:41.061427 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-88d0422e-4f65-4a14-9a29-e8a45fff2725 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:41.061940 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-88d0422e-4f65-4a14-9a29-e8a45fff2725 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:41.371934 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-56bd2c49-252c-4b5e-acce-625e7efea5f0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:41.373421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-56bd2c49-252c-4b5e-acce-625e7efea5f0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:41.380296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-56bd2c49-252c-4b5e-acce-625e7efea5f0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:41.380761 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-56bd2c49-252c-4b5e-acce-625e7efea5f0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:41.381556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-56bd2c49-252c-4b5e-acce-625e7efea5f0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:41.382154 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-56bd2c49-252c-4b5e-acce-625e7efea5f0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:41.385439 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-88d0422e-4f65-4a14-9a29-e8a45fff2725 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:41.395020 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-88d0422e-4f65-4a14-9a29-e8a45fff2725 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1370 microversion: 2.1 time: 0.346925 May 10 21:11:41.395733 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 210/392] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:41 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1370 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:41.520564 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-56bd2c49-252c-4b5e-acce-625e7efea5f0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:41.528829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-56bd2c49-252c-4b5e-acce-625e7efea5f0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1709 microversion: 2.1 time: 0.160817 May 10 21:11:41.529396 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 183/393] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:41 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1709 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:11:41.854829 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-ff78db9e-6649-4090-8509-fb9a3f869fb8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:41.855470 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-ff78db9e-6649-4090-8509-fb9a3f869fb8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:41.862608 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ff78db9e-6649-4090-8509-fb9a3f869fb8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:41.863064 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ff78db9e-6649-4090-8509-fb9a3f869fb8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:41.863945 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ff78db9e-6649-4090-8509-fb9a3f869fb8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:41.864385 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ff78db9e-6649-4090-8509-fb9a3f869fb8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:42.024295 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-ff78db9e-6649-4090-8509-fb9a3f869fb8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:42.032796 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-ff78db9e-6649-4090-8509-fb9a3f869fb8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:42.034396 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-ff78db9e-6649-4090-8509-fb9a3f869fb8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:42.035563 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-ff78db9e-6649-4090-8509-fb9a3f869fb8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1723 microversion: 2.20 time: 0.184689 May 10 21:11:42.036127 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 211/394] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:41 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:42.412523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e4c22c41-6a98-4415-8b20-95fd3af91944 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:42.413201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e4c22c41-6a98-4415-8b20-95fd3af91944 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:42.432040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4c22c41-6a98-4415-8b20-95fd3af91944 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:42.432817 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4c22c41-6a98-4415-8b20-95fd3af91944 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:42.433706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4c22c41-6a98-4415-8b20-95fd3af91944 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:42.434202 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4c22c41-6a98-4415-8b20-95fd3af91944 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:42.550345 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-ce411020-f5b7-4e4d-8890-d97816e47390 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:42.551862 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-ce411020-f5b7-4e4d-8890-d97816e47390 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:42.558371 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ce411020-f5b7-4e4d-8890-d97816e47390 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:42.558822 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ce411020-f5b7-4e4d-8890-d97816e47390 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:42.559694 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ce411020-f5b7-4e4d-8890-d97816e47390 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:42.560287 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ce411020-f5b7-4e4d-8890-d97816e47390 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:42.769728 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e4c22c41-6a98-4415-8b20-95fd3af91944 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:42.783649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e4c22c41-6a98-4415-8b20-95fd3af91944 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1370 microversion: 2.1 time: 0.374832 May 10 21:11:42.785040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 184/395] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:42 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1370 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:42.794612 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-ce411020-f5b7-4e4d-8890-d97816e47390 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:42.806358 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-ce411020-f5b7-4e4d-8890-d97816e47390 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1709 microversion: 2.1 time: 0.263026 May 10 21:11:42.809853 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 212/396] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:42 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1709 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:11:43.054749 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-51e5e156-f929-4190-9187-202f6be69bd4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:43.055405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-51e5e156-f929-4190-9187-202f6be69bd4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:43.065808 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51e5e156-f929-4190-9187-202f6be69bd4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:43.066690 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51e5e156-f929-4190-9187-202f6be69bd4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:43.068670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51e5e156-f929-4190-9187-202f6be69bd4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:43.068670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51e5e156-f929-4190-9187-202f6be69bd4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:43.287342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-51e5e156-f929-4190-9187-202f6be69bd4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:43.295249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-51e5e156-f929-4190-9187-202f6be69bd4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:43.296789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-51e5e156-f929-4190-9187-202f6be69bd4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:43.298330 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-51e5e156-f929-4190-9187-202f6be69bd4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1723 microversion: 2.20 time: 0.247959 May 10 21:11:43.299058 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 185/397] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:43 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:43.630431 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f1ca1504-5722-4cd6-9a2d-80e8c0e68422 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-677085302", "imageRef": "cb321ccf-1ce7-4dda-90d0-f05332eb6fe1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a67b65bc-d215-4b97-b229-e2132409a79d"}], "security_groups": [{"name": "tempest-securitygroup--774646493"}], "key_name": "tempest-keypair-1354916562", "user_data": "}} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:11:43.809883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3d9f3944-6376-4ea4-b6dc-51ebd0582058 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:43.811683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3d9f3944-6376-4ea4-b6dc-51ebd0582058 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:43.820546 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d9f3944-6376-4ea4-b6dc-51ebd0582058 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:43.821481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d9f3944-6376-4ea4-b6dc-51ebd0582058 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:43.823735 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d9f3944-6376-4ea4-b6dc-51ebd0582058 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:43.825379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d9f3944-6376-4ea4-b6dc-51ebd0582058 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:43.847668 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.network.neutron [None req-f1ca1504-5722-4cd6-9a2d-80e8c0e68422 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] validate_networks() for [('a67b65bc-d215-4b97-b229-e2132409a79d', None, None, None, None, None)] {{(pid=117713) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:11:44.103429 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3d9f3944-6376-4ea4-b6dc-51ebd0582058 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:44.115683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3d9f3944-6376-4ea4-b6dc-51ebd0582058 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1370 microversion: 2.1 time: 0.318748 May 10 21:11:44.127100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 186/398] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:43 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1370 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:11:44.134694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bf771679-e11d-4d35-811c-47c1bc216dda tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:44.137478 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bf771679-e11d-4d35-811c-47c1bc216dda tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:44.145239 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf771679-e11d-4d35-811c-47c1bc216dda tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:44.146210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf771679-e11d-4d35-811c-47c1bc216dda tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:44.147655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf771679-e11d-4d35-811c-47c1bc216dda tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:44.148334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf771679-e11d-4d35-811c-47c1bc216dda tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:44.332466 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.virt.hardware [None req-f1ca1504-5722-4cd6-9a2d-80e8c0e68422 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Flavor limits 0:0:0 {{(pid=117713) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:11:44.333317 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.virt.hardware [None req-f1ca1504-5722-4cd6-9a2d-80e8c0e68422 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Image limits 0:0:0 {{(pid=117713) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:11:44.333979 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.virt.hardware [None req-f1ca1504-5722-4cd6-9a2d-80e8c0e68422 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Flavor pref 0:0:0 {{(pid=117713) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:11:44.334586 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.virt.hardware [None req-f1ca1504-5722-4cd6-9a2d-80e8c0e68422 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Image pref 0:0:0 {{(pid=117713) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:11:44.335341 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.virt.hardware [None req-f1ca1504-5722-4cd6-9a2d-80e8c0e68422 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117713) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:11:44.345065 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f1ca1504-5722-4cd6-9a2d-80e8c0e68422 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:44.345834 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f1ca1504-5722-4cd6-9a2d-80e8c0e68422 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:44.346841 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f1ca1504-5722-4cd6-9a2d-80e8c0e68422 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:44.347534 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f1ca1504-5722-4cd6-9a2d-80e8c0e68422 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:44.371295 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.quota [None req-f1ca1504-5722-4cd6-9a2d-80e8c0e68422 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Getting quotas for project 9582743483fa4fb88f4e91d3f787c945. Resources: {'instances', 'cores', 'ram'} {{(pid=117713) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:11:44.377247 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.quota [None req-f1ca1504-5722-4cd6-9a2d-80e8c0e68422 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Getting quotas for user 62bc5605a22d408f9b4bac69a0f5f486 and project 9582743483fa4fb88f4e91d3f787c945. Resources: {'instances', 'cores', 'ram'} {{(pid=117713) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:11:44.414906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bf771679-e11d-4d35-811c-47c1bc216dda tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:44.425151 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f1ca1504-5722-4cd6-9a2d-80e8c0e68422 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Going to run 1 instances... {{(pid=117713) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:11:44.429309 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f1ca1504-5722-4cd6-9a2d-80e8c0e68422 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb321ccf-1ce7-4dda-90d0-f05332eb6fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117713) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:11:44.430963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bf771679-e11d-4d35-811c-47c1bc216dda tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1709 microversion: 2.1 time: 0.297034 May 10 21:11:44.431616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 187/399] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:44 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1709 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:44.456464 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-786c7d2d-a385-46e1-9c52-b77b14c50f29 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:44.457091 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-786c7d2d-a385-46e1-9c52-b77b14c50f29 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:44.471722 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-786c7d2d-a385-46e1-9c52-b77b14c50f29 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:44.472180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-786c7d2d-a385-46e1-9c52-b77b14c50f29 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:44.472981 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-786c7d2d-a385-46e1-9c52-b77b14c50f29 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:44.473427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-786c7d2d-a385-46e1-9c52-b77b14c50f29 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:44.552742 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f1ca1504-5722-4cd6-9a2d-80e8c0e68422 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.926606 May 10 21:11:44.555367 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 213/400] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 21:11:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 21:11:44.569630 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-fe9e7670-d25f-4fd2-8605-0c6025900cf4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:44.570658 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-fe9e7670-d25f-4fd2-8605-0c6025900cf4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:44.657111 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-fe9e7670-d25f-4fd2-8605-0c6025900cf4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:44.668061 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-fe9e7670-d25f-4fd2-8605-0c6025900cf4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1241 microversion: 2.1 time: 0.107974 May 10 21:11:44.669139 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 214/401] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:44 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1241 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:44.817075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-786c7d2d-a385-46e1-9c52-b77b14c50f29 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:44.826238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-786c7d2d-a385-46e1-9c52-b77b14c50f29 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:44.828025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-786c7d2d-a385-46e1-9c52-b77b14c50f29 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:44.829973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-786c7d2d-a385-46e1-9c52-b77b14c50f29 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1723 microversion: 2.20 time: 0.396548 May 10 21:11:44.830542 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 188/402] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:44 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1723 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:45.137020 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d9065450-df15-4601-84fc-cf3af3335e75 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:45.137020 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d9065450-df15-4601-84fc-cf3af3335e75 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:45.143936 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d9065450-df15-4601-84fc-cf3af3335e75 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:45.144691 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d9065450-df15-4601-84fc-cf3af3335e75 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:45.145314 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d9065450-df15-4601-84fc-cf3af3335e75 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:45.145792 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d9065450-df15-4601-84fc-cf3af3335e75 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:45.312701 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-d9065450-df15-4601-84fc-cf3af3335e75 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:45.329043 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d9065450-df15-4601-84fc-cf3af3335e75 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1564 microversion: 2.1 time: 0.198304 May 10 21:11:45.330014 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 215/403] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:45 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1564 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:45.346847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-90c61e81-6232-425d-ab4f-58615e16a43a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:45.347447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-90c61e81-6232-425d-ab4f-58615e16a43a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:45.353932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-90c61e81-6232-425d-ab4f-58615e16a43a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:45.354383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-90c61e81-6232-425d-ab4f-58615e16a43a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:45.355355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-90c61e81-6232-425d-ab4f-58615e16a43a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:45.355802 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-90c61e81-6232-425d-ab4f-58615e16a43a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:45.450792 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e9ce933d-71ba-4bdc-a71f-a056dc4d4f9f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:45.451818 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e9ce933d-71ba-4bdc-a71f-a056dc4d4f9f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:45.468378 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e9ce933d-71ba-4bdc-a71f-a056dc4d4f9f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:45.470218 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e9ce933d-71ba-4bdc-a71f-a056dc4d4f9f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:45.471422 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e9ce933d-71ba-4bdc-a71f-a056dc4d4f9f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:45.472417 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e9ce933d-71ba-4bdc-a71f-a056dc4d4f9f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:45.518335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-90c61e81-6232-425d-ab4f-58615e16a43a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.176382 May 10 21:11:45.518934 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 189/404] 10.222.0.49 () {58 vars in 1274 bytes} [Tue May 10 21:11:45 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-interface => generated 284 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:11:45.686960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3a230ec5-fa8b-4a64-bd3c-a1808a51e721 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:45.688750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3a230ec5-fa8b-4a64-bd3c-a1808a51e721 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:45.700928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3a230ec5-fa8b-4a64-bd3c-a1808a51e721 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:45.701383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3a230ec5-fa8b-4a64-bd3c-a1808a51e721 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:45.702231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3a230ec5-fa8b-4a64-bd3c-a1808a51e721 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:45.702671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3a230ec5-fa8b-4a64-bd3c-a1808a51e721 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:45.799280 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3a230ec5-fa8b-4a64-bd3c-a1808a51e721 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:45.807319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3a230ec5-fa8b-4a64-bd3c-a1808a51e721 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1245 microversion: 2.1 time: 0.124355 May 10 21:11:45.814274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 190/405] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:45 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1245 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:45.850724 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b3e6789e-4d14-4ab0-b180-dbd9ee546813 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:45.856479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b3e6789e-4d14-4ab0-b180-dbd9ee546813 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:45.878345 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3e6789e-4d14-4ab0-b180-dbd9ee546813 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:45.878803 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3e6789e-4d14-4ab0-b180-dbd9ee546813 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:45.879613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3e6789e-4d14-4ab0-b180-dbd9ee546813 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:45.883005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3e6789e-4d14-4ab0-b180-dbd9ee546813 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:45.910674 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-e9ce933d-71ba-4bdc-a71f-a056dc4d4f9f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:45.924606 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e9ce933d-71ba-4bdc-a71f-a056dc4d4f9f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1709 microversion: 2.1 time: 0.478483 May 10 21:11:45.925446 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 216/406] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:45 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1709 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:11:46.194284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b3e6789e-4d14-4ab0-b180-dbd9ee546813 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:46.198281 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b3e6789e-4d14-4ab0-b180-dbd9ee546813 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:46.200992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b3e6789e-4d14-4ab0-b180-dbd9ee546813 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:46.202999 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b3e6789e-4d14-4ab0-b180-dbd9ee546813 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1723 microversion: 2.20 time: 0.357894 May 10 21:11:46.204855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 191/407] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:45 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1723 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:11:46.830324 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-4f10cecd-3138-4229-af5b-bc7b6c307cfc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:46.832366 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-4f10cecd-3138-4229-af5b-bc7b6c307cfc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:46.841199 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4f10cecd-3138-4229-af5b-bc7b6c307cfc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:46.842481 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4f10cecd-3138-4229-af5b-bc7b6c307cfc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:46.844029 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4f10cecd-3138-4229-af5b-bc7b6c307cfc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:46.849981 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4f10cecd-3138-4229-af5b-bc7b6c307cfc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:46.944676 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f1a05293-a67f-48b3-b6ed-ba9a72bec116 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:46.946118 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f1a05293-a67f-48b3-b6ed-ba9a72bec116 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:46.955381 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-4f10cecd-3138-4229-af5b-bc7b6c307cfc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:46.958825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f1a05293-a67f-48b3-b6ed-ba9a72bec116 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:46.958825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f1a05293-a67f-48b3-b6ed-ba9a72bec116 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:46.958825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f1a05293-a67f-48b3-b6ed-ba9a72bec116 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:46.958825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f1a05293-a67f-48b3-b6ed-ba9a72bec116 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:46.965673 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-4f10cecd-3138-4229-af5b-bc7b6c307cfc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1237 microversion: 2.1 time: 0.141355 May 10 21:11:46.976770 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 217/408] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:46 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1237 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:46.982254 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-863dcf21-d77f-44ef-a91d-69ffc000ed34 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:46.983020 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-863dcf21-d77f-44ef-a91d-69ffc000ed34 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:46.991607 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-863dcf21-d77f-44ef-a91d-69ffc000ed34 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:46.996740 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-863dcf21-d77f-44ef-a91d-69ffc000ed34 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:46.998143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-863dcf21-d77f-44ef-a91d-69ffc000ed34 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:46.998755 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-863dcf21-d77f-44ef-a91d-69ffc000ed34 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:47.151691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f1a05293-a67f-48b3-b6ed-ba9a72bec116 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:47.162504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f1a05293-a67f-48b3-b6ed-ba9a72bec116 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1713 microversion: 2.1 time: 0.223984 May 10 21:11:47.163495 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 192/409] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:46 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1713 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:47.169011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-91889f5d-c907-41bb-ad0c-843ea19645e2 req-a1799ca5-1481-4914-9fd9-70bee18b4758 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf6fc652-5ef0-417d-af13-69c7c058d50e", "tag": "ced08b04-cda9-4a73-82de-1764e13bc529"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:11:47.179015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-91889f5d-c907-41bb-ad0c-843ea19645e2 req-a1799ca5-1481-4914-9fd9-70bee18b4758 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:47.179735 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-91889f5d-c907-41bb-ad0c-843ea19645e2 req-a1799ca5-1481-4914-9fd9-70bee18b4758 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:47.195387 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-91889f5d-c907-41bb-ad0c-843ea19645e2 req-a1799ca5-1481-4914-9fd9-70bee18b4758 service nova] Creating event network-changed:ced08b04-cda9-4a73-82de-1764e13bc529 for instance cf6fc652-5ef0-417d-af13-69c7c058d50e on hv-cinder-82880 May 10 21:11:47.209639 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-91889f5d-c907-41bb-ad0c-843ea19645e2 req-a1799ca5-1481-4914-9fd9-70bee18b4758 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044708 May 10 21:11:47.210657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 193/410] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:11:47.224494 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.objects.instance [None req-863dcf21-d77f-44ef-a91d-69ffc000ed34 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lazy-loading 'services' on Instance uuid dbfaa131-2006-47ea-823a-ec96bb872109 {{(pid=117713) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:11:47.228195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3739c6d3-77d1-4312-b0a0-e13e1dd5e387 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:47.228902 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3739c6d3-77d1-4312-b0a0-e13e1dd5e387 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:47.247960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3739c6d3-77d1-4312-b0a0-e13e1dd5e387 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:47.247960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3739c6d3-77d1-4312-b0a0-e13e1dd5e387 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:47.247960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3739c6d3-77d1-4312-b0a0-e13e1dd5e387 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:47.247960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3739c6d3-77d1-4312-b0a0-e13e1dd5e387 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:47.521797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3739c6d3-77d1-4312-b0a0-e13e1dd5e387 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:47.531114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3739c6d3-77d1-4312-b0a0-e13e1dd5e387 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:47.533569 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3739c6d3-77d1-4312-b0a0-e13e1dd5e387 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:47.534877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3739c6d3-77d1-4312-b0a0-e13e1dd5e387 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1726 microversion: 2.20 time: 0.311485 May 10 21:11:47.541476 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 194/411] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:47 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1726 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:47.555743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7b1f4626-daf2-45b3-be6e-174bef0c56fd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19a60de6-9ee1-4e3a-90e8-e2cdb9747695"}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:11:47.557579 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7b1f4626-daf2-45b3-be6e-174bef0c56fd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:47.566129 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b1f4626-daf2-45b3-be6e-174bef0c56fd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:47.566588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b1f4626-daf2-45b3-be6e-174bef0c56fd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:47.567421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b1f4626-daf2-45b3-be6e-174bef0c56fd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:47.569133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b1f4626-daf2-45b3-be6e-174bef0c56fd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:47.664428 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-863dcf21-d77f-44ef-a91d-69ffc000ed34 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "DELETE /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109/os-volume_attachments/8a05716f-c46f-429d-9bc6-0953ce8b9bc8" status: 202 len: 0 microversion: 2.1 time: 0.686118 May 10 21:11:47.666649 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 218/412] 10.222.0.49 () {58 vars in 1415 bytes} [Tue May 10 21:11:46 2022] DELETE /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109/os-volume_attachments/8a05716f-c46f-429d-9bc6-0953ce8b9bc8 => generated 0 bytes in 688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:11:47.986618 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-1175a84f-4f71-4cd4-9ea8-f43c51e7010f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:47.987577 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-1175a84f-4f71-4cd4-9ea8-f43c51e7010f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:48.017160 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1175a84f-4f71-4cd4-9ea8-f43c51e7010f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:48.019640 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1175a84f-4f71-4cd4-9ea8-f43c51e7010f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:48.024433 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1175a84f-4f71-4cd4-9ea8-f43c51e7010f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:48.026622 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1175a84f-4f71-4cd4-9ea8-f43c51e7010f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:48.257896 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-1175a84f-4f71-4cd4-9ea8-f43c51e7010f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:48.271043 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-1175a84f-4f71-4cd4-9ea8-f43c51e7010f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1301 microversion: 2.1 time: 0.290946 May 10 21:11:48.279254 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 219/413] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:47 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1301 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:48.870659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7b1f4626-daf2-45b3-be6e-174bef0c56fd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "POST /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.320712 May 10 21:11:48.871722 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 195/414] 10.222.0.49 () {62 vars in 1363 bytes} [Tue May 10 21:11:47 2022] POST /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 188 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:11:49.108282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-2e7214be-30e6-4d65-9718-f4ccf02903cc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:11:49.108987 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-2e7214be-30e6-4d65-9718-f4ccf02903cc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:49.137486 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2e7214be-30e6-4d65-9718-f4ccf02903cc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:49.139210 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2e7214be-30e6-4d65-9718-f4ccf02903cc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:49.141660 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2e7214be-30e6-4d65-9718-f4ccf02903cc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:49.142686 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2e7214be-30e6-4d65-9718-f4ccf02903cc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:49.295457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-db9df18c-ac8a-4c32-9260-62c0ec14317c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:49.296380 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-db9df18c-ac8a-4c32-9260-62c0ec14317c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:49.304769 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-db9df18c-ac8a-4c32-9260-62c0ec14317c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:49.305534 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-db9df18c-ac8a-4c32-9260-62c0ec14317c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:49.306601 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-db9df18c-ac8a-4c32-9260-62c0ec14317c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:49.307276 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-db9df18c-ac8a-4c32-9260-62c0ec14317c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:49.384356 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-db9df18c-ac8a-4c32-9260-62c0ec14317c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:49.399987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-db9df18c-ac8a-4c32-9260-62c0ec14317c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1299 microversion: 2.1 time: 0.108881 May 10 21:11:49.400602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 196/415] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:49 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:49.445295 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-2e7214be-30e6-4d65-9718-f4ccf02903cc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "POST /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/action" status: 202 len: 0 microversion: 2.20 time: 0.341502 May 10 21:11:49.446610 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 220/416] 10.222.0.49 () {62 vars in 1318 bytes} [Tue May 10 21:11:49 2022] POST /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 21:11:49.465011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-70e390ec-4b37-43a0-81d2-cf94a7a24953 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:49.466105 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-70e390ec-4b37-43a0-81d2-cf94a7a24953 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:49.487171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-70e390ec-4b37-43a0-81d2-cf94a7a24953 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:49.487858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-70e390ec-4b37-43a0-81d2-cf94a7a24953 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:49.490646 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-70e390ec-4b37-43a0-81d2-cf94a7a24953 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:49.491759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-70e390ec-4b37-43a0-81d2-cf94a7a24953 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:49.752421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-70e390ec-4b37-43a0-81d2-cf94a7a24953 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:49.764309 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-70e390ec-4b37-43a0-81d2-cf94a7a24953 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:49.766763 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-70e390ec-4b37-43a0-81d2-cf94a7a24953 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:49.768212 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-70e390ec-4b37-43a0-81d2-cf94a7a24953 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1752 microversion: 2.20 time: 0.315530 May 10 21:11:49.782257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 197/417] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:49 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1752 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:49.943061 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-3e98f40d-5bcd-48de-81d8-deb57c74118e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:49.943653 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-3e98f40d-5bcd-48de-81d8-deb57c74118e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:49.952672 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3e98f40d-5bcd-48de-81d8-deb57c74118e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:49.953199 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3e98f40d-5bcd-48de-81d8-deb57c74118e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:49.954291 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3e98f40d-5bcd-48de-81d8-deb57c74118e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:49.954744 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3e98f40d-5bcd-48de-81d8-deb57c74118e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:49.989371 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-3e98f40d-5bcd-48de-81d8-deb57c74118e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] Going to try to terminate instance {{(pid=117713) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:11:50.422450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-068c733f-bc87-499e-bab1-623a07e7e6c7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:50.423840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-068c733f-bc87-499e-bab1-623a07e7e6c7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:50.425691 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-3e98f40d-5bcd-48de-81d8-deb57c74118e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "DELETE /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109" status: 204 len: 0 microversion: 2.1 time: 0.490170 May 10 21:11:50.429418 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 221/418] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 21:11:49 2022] DELETE /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 21:11:50.438611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-068c733f-bc87-499e-bab1-623a07e7e6c7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:50.439117 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-068c733f-bc87-499e-bab1-623a07e7e6c7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:50.440470 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-068c733f-bc87-499e-bab1-623a07e7e6c7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:50.441079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-068c733f-bc87-499e-bab1-623a07e7e6c7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:50.442138 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-02b1f348-f64a-45bf-8ce0-3b9891c4484c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:50.447331 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-02b1f348-f64a-45bf-8ce0-3b9891c4484c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:50.466018 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-02b1f348-f64a-45bf-8ce0-3b9891c4484c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:50.467724 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-02b1f348-f64a-45bf-8ce0-3b9891c4484c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:50.470095 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-02b1f348-f64a-45bf-8ce0-3b9891c4484c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:50.471375 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-02b1f348-f64a-45bf-8ce0-3b9891c4484c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:50.728151 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-068c733f-bc87-499e-bab1-623a07e7e6c7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:50.741428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-068c733f-bc87-499e-bab1-623a07e7e6c7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1366 microversion: 2.1 time: 0.327611 May 10 21:11:50.754279 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 198/419] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:50 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1366 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:11:50.789467 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-be5fcfe2-ffc3-41cf-8630-9bc54e189921 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:50.790560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-be5fcfe2-ffc3-41cf-8630-9bc54e189921 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:50.799081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be5fcfe2-ffc3-41cf-8630-9bc54e189921 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:50.799892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be5fcfe2-ffc3-41cf-8630-9bc54e189921 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:50.801137 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be5fcfe2-ffc3-41cf-8630-9bc54e189921 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:50.801687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be5fcfe2-ffc3-41cf-8630-9bc54e189921 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:50.811093 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-02b1f348-f64a-45bf-8ce0-3b9891c4484c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:50.827781 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-02b1f348-f64a-45bf-8ce0-3b9891c4484c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109" status: 200 len: 1515 microversion: 2.1 time: 0.393347 May 10 21:11:50.828814 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 222/420] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:50 2022] GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109 => generated 1515 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:51.164113 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-be5fcfe2-ffc3-41cf-8630-9bc54e189921 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:51.176635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-be5fcfe2-ffc3-41cf-8630-9bc54e189921 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:51.181963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-be5fcfe2-ffc3-41cf-8630-9bc54e189921 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:51.185510 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-be5fcfe2-ffc3-41cf-8630-9bc54e189921 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1752 microversion: 2.20 time: 0.398731 May 10 21:11:51.187062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 199/421] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:50 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1752 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:11:51.760808 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-ffae6a1c-6073-41bf-942a-9cf197255412 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:51.764164 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-ffae6a1c-6073-41bf-942a-9cf197255412 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:51.769282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ffae6a1c-6073-41bf-942a-9cf197255412 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:51.770084 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ffae6a1c-6073-41bf-942a-9cf197255412 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:51.770968 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ffae6a1c-6073-41bf-942a-9cf197255412 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:51.771541 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ffae6a1c-6073-41bf-942a-9cf197255412 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:51.845324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ddbbc804-ee08-43c8-9164-d3db527133c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:51.847437 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ddbbc804-ee08-43c8-9164-d3db527133c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:51.855645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ddbbc804-ee08-43c8-9164-d3db527133c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:51.856450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ddbbc804-ee08-43c8-9164-d3db527133c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:51.857426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ddbbc804-ee08-43c8-9164-d3db527133c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:51.858026 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ddbbc804-ee08-43c8-9164-d3db527133c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:52.068248 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ddbbc804-ee08-43c8-9164-d3db527133c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:52.079757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ddbbc804-ee08-43c8-9164-d3db527133c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109" status: 200 len: 1515 microversion: 2.1 time: 0.238270 May 10 21:11:52.081746 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 200/422] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:51 2022] GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109 => generated 1515 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:52.181040 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-ffae6a1c-6073-41bf-942a-9cf197255412 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:52.190195 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-ffae6a1c-6073-41bf-942a-9cf197255412 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1366 microversion: 2.1 time: 0.433593 May 10 21:11:52.205563 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-b36aad64-87ae-491c-9903-bd4b136a0e3b req-4edf2ab2-6ae5-40ea-aeec-43ece6d93dfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2a9d425-c6f1-4f23-8fb7-7311ca431fdf", "tag": "d05ef2a7-f2fb-4df8-8e70-5029d667aaa7"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:11:52.206044 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 223/423] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:51 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1366 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:52.213281 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-01176e84-4a68-4ef6-9252-9a52ec8f521b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:52.214201 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-01176e84-4a68-4ef6-9252-9a52ec8f521b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:52.223580 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-01176e84-4a68-4ef6-9252-9a52ec8f521b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:52.224215 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-01176e84-4a68-4ef6-9252-9a52ec8f521b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:52.225236 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-b36aad64-87ae-491c-9903-bd4b136a0e3b req-4edf2ab2-6ae5-40ea-aeec-43ece6d93dfd service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:52.225383 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-01176e84-4a68-4ef6-9252-9a52ec8f521b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:52.225698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-b36aad64-87ae-491c-9903-bd4b136a0e3b req-4edf2ab2-6ae5-40ea-aeec-43ece6d93dfd service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:52.226016 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-01176e84-4a68-4ef6-9252-9a52ec8f521b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:52.247650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-b36aad64-87ae-491c-9903-bd4b136a0e3b req-4edf2ab2-6ae5-40ea-aeec-43ece6d93dfd service nova] Creating event network-changed:d05ef2a7-f2fb-4df8-8e70-5029d667aaa7 for instance f2a9d425-c6f1-4f23-8fb7-7311ca431fdf on hv-cinder-82880 May 10 21:11:52.258538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-b36aad64-87ae-491c-9903-bd4b136a0e3b req-4edf2ab2-6ae5-40ea-aeec-43ece6d93dfd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058275 May 10 21:11:52.262140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 201/424] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:11:52.728025 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-01176e84-4a68-4ef6-9252-9a52ec8f521b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:52.740457 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-01176e84-4a68-4ef6-9252-9a52ec8f521b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:52.742698 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-01176e84-4a68-4ef6-9252-9a52ec8f521b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:52.745210 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-01176e84-4a68-4ef6-9252-9a52ec8f521b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1752 microversion: 2.20 time: 0.538078 May 10 21:11:52.758014 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 224/425] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:52 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1752 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:53.098760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-88f701b8-afa2-4728-8610-0ce898864092 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:53.099479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-88f701b8-afa2-4728-8610-0ce898864092 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:53.105700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-88f701b8-afa2-4728-8610-0ce898864092 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:53.106498 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-88f701b8-afa2-4728-8610-0ce898864092 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:53.107607 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-88f701b8-afa2-4728-8610-0ce898864092 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:53.108274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-88f701b8-afa2-4728-8610-0ce898864092 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:53.212293 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c3499c9d-ba65-45c7-af0c-9fd2f49fcfc9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:53.213583 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c3499c9d-ba65-45c7-af0c-9fd2f49fcfc9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:53.225524 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c3499c9d-ba65-45c7-af0c-9fd2f49fcfc9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:53.228222 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c3499c9d-ba65-45c7-af0c-9fd2f49fcfc9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:53.228222 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c3499c9d-ba65-45c7-af0c-9fd2f49fcfc9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:53.229162 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c3499c9d-ba65-45c7-af0c-9fd2f49fcfc9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:53.360242 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-88f701b8-afa2-4728-8610-0ce898864092 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:53.372212 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-88f701b8-afa2-4728-8610-0ce898864092 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109" status: 200 len: 1515 microversion: 2.1 time: 0.278230 May 10 21:11:53.372813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 202/426] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:53 2022] GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109 => generated 1515 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:53.608498 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-c3499c9d-ba65-45c7-af0c-9fd2f49fcfc9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:53.617039 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c3499c9d-ba65-45c7-af0c-9fd2f49fcfc9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1366 microversion: 2.1 time: 0.413617 May 10 21:11:53.626745 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 225/427] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:53 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1366 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:53.764884 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-47a9273d-32c0-41aa-86cd-49fc1b20cb25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:53.766660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-47a9273d-32c0-41aa-86cd-49fc1b20cb25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:53.775842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47a9273d-32c0-41aa-86cd-49fc1b20cb25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:53.776486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47a9273d-32c0-41aa-86cd-49fc1b20cb25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:53.777872 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47a9273d-32c0-41aa-86cd-49fc1b20cb25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:53.778466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47a9273d-32c0-41aa-86cd-49fc1b20cb25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:53.946529 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-47a9273d-32c0-41aa-86cd-49fc1b20cb25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:53.957933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-47a9273d-32c0-41aa-86cd-49fc1b20cb25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:53.960435 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-47a9273d-32c0-41aa-86cd-49fc1b20cb25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:53.968001 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-47a9273d-32c0-41aa-86cd-49fc1b20cb25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1754 microversion: 2.20 time: 0.201785 May 10 21:11:53.968001 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 203/428] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:53 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1754 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:54.287156 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [req-18027430-4efc-479e-acb4-96a296e78311 req-d1ad51fd-8618-4431-9e75-a46ccbaf46af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbfaa131-2006-47ea-823a-ec96bb872109", "name": "network-vif-deleted", "tag": "16470672-b800-4ec1-a6ce-4e13346ab757"}]} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:11:54.298183 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-18027430-4efc-479e-acb4-96a296e78311 req-d1ad51fd-8618-4431-9e75-a46ccbaf46af service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:54.299221 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-18027430-4efc-479e-acb4-96a296e78311 req-d1ad51fd-8618-4431-9e75-a46ccbaf46af service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:54.314118 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.compute.server_external_events [req-18027430-4efc-479e-acb4-96a296e78311 req-d1ad51fd-8618-4431-9e75-a46ccbaf46af service nova] Creating event network-vif-deleted:16470672-b800-4ec1-a6ce-4e13346ab757 for instance dbfaa131-2006-47ea-823a-ec96bb872109 on hv-cinder-82880 May 10 21:11:54.319272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [req-18027430-4efc-479e-acb4-96a296e78311 req-d1ad51fd-8618-4431-9e75-a46ccbaf46af service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035902 May 10 21:11:54.320411 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 226/429] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:11:54.389774 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a7dee4e8-2136-491c-a2d4-bc130948ab26 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:54.390303 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a7dee4e8-2136-491c-a2d4-bc130948ab26 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:54.397260 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a7dee4e8-2136-491c-a2d4-bc130948ab26 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:54.397715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a7dee4e8-2136-491c-a2d4-bc130948ab26 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:54.398494 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a7dee4e8-2136-491c-a2d4-bc130948ab26 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:54.398941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a7dee4e8-2136-491c-a2d4-bc130948ab26 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:54.460418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a7dee4e8-2136-491c-a2d4-bc130948ab26 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:54.468394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a7dee4e8-2136-491c-a2d4-bc130948ab26 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109" status: 200 len: 1473 microversion: 2.1 time: 0.082450 May 10 21:11:54.469653 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 204/430] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:54 2022] GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109 => generated 1473 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:54.634933 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-98ed27ed-c0e5-4a8a-bc57-8e3e528a0e69 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:54.635671 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-98ed27ed-c0e5-4a8a-bc57-8e3e528a0e69 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:54.642804 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-98ed27ed-c0e5-4a8a-bc57-8e3e528a0e69 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:54.643246 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-98ed27ed-c0e5-4a8a-bc57-8e3e528a0e69 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:54.644033 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-98ed27ed-c0e5-4a8a-bc57-8e3e528a0e69 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:54.644709 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-98ed27ed-c0e5-4a8a-bc57-8e3e528a0e69 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:54.872732 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-98ed27ed-c0e5-4a8a-bc57-8e3e528a0e69 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:54.881653 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-98ed27ed-c0e5-4a8a-bc57-8e3e528a0e69 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1366 microversion: 2.1 time: 0.250848 May 10 21:11:54.882469 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 227/431] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:54 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:54.981878 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c15ce028-a7a7-4dc2-aec4-784d56b6e1c6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:54.982313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c15ce028-a7a7-4dc2-aec4-784d56b6e1c6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:54.990274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c15ce028-a7a7-4dc2-aec4-784d56b6e1c6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:54.994731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c15ce028-a7a7-4dc2-aec4-784d56b6e1c6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:54.994731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c15ce028-a7a7-4dc2-aec4-784d56b6e1c6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:54.994731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c15ce028-a7a7-4dc2-aec4-784d56b6e1c6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:55.134539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c15ce028-a7a7-4dc2-aec4-784d56b6e1c6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:55.145476 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c15ce028-a7a7-4dc2-aec4-784d56b6e1c6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:55.147497 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c15ce028-a7a7-4dc2-aec4-784d56b6e1c6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:55.148842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c15ce028-a7a7-4dc2-aec4-784d56b6e1c6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1754 microversion: 2.20 time: 0.171186 May 10 21:11:55.156164 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 205/432] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:54 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:55.487219 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6b44b9bb-a6cc-45aa-8ea7-01f4fb3779a8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:55.489121 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6b44b9bb-a6cc-45aa-8ea7-01f4fb3779a8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:55.495964 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6b44b9bb-a6cc-45aa-8ea7-01f4fb3779a8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:55.496773 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6b44b9bb-a6cc-45aa-8ea7-01f4fb3779a8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:55.497963 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6b44b9bb-a6cc-45aa-8ea7-01f4fb3779a8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:55.498488 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6b44b9bb-a6cc-45aa-8ea7-01f4fb3779a8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:55.566945 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-6b44b9bb-a6cc-45aa-8ea7-01f4fb3779a8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:55.574431 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6b44b9bb-a6cc-45aa-8ea7-01f4fb3779a8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109" status: 200 len: 1473 microversion: 2.1 time: 0.092477 May 10 21:11:55.575053 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 228/433] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:55 2022] GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109 => generated 1473 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:11:55.903346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-27a368ca-776c-4dc4-a34c-701585fc374a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:55.904552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-27a368ca-776c-4dc4-a34c-701585fc374a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:55.917238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27a368ca-776c-4dc4-a34c-701585fc374a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:55.917640 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27a368ca-776c-4dc4-a34c-701585fc374a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:55.919056 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27a368ca-776c-4dc4-a34c-701585fc374a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:55.919218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27a368ca-776c-4dc4-a34c-701585fc374a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:56.066134 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-27a368ca-776c-4dc4-a34c-701585fc374a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:56.073790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-27a368ca-776c-4dc4-a34c-701585fc374a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1366 microversion: 2.1 time: 0.178698 May 10 21:11:56.074381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 206/434] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:55 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:56.168340 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-49737c85-967e-4159-b5e7-f4a4952f6b74 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:56.169831 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-49737c85-967e-4159-b5e7-f4a4952f6b74 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:56.178615 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-49737c85-967e-4159-b5e7-f4a4952f6b74 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:56.179057 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-49737c85-967e-4159-b5e7-f4a4952f6b74 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:56.179861 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-49737c85-967e-4159-b5e7-f4a4952f6b74 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:56.180352 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-49737c85-967e-4159-b5e7-f4a4952f6b74 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:56.416180 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-49737c85-967e-4159-b5e7-f4a4952f6b74 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:56.430001 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-49737c85-967e-4159-b5e7-f4a4952f6b74 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:56.431508 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-49737c85-967e-4159-b5e7-f4a4952f6b74 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:56.432889 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-49737c85-967e-4159-b5e7-f4a4952f6b74 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1754 microversion: 2.20 time: 0.268583 May 10 21:11:56.433787 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 229/435] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:56 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1754 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:56.592659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a13c487b-6ff4-4f14-b85a-5da15ce928f9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:56.593580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a13c487b-6ff4-4f14-b85a-5da15ce928f9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:56.601578 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a13c487b-6ff4-4f14-b85a-5da15ce928f9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:56.602945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a13c487b-6ff4-4f14-b85a-5da15ce928f9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:56.606997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a13c487b-6ff4-4f14-b85a-5da15ce928f9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:56.607672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a13c487b-6ff4-4f14-b85a-5da15ce928f9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:56.686607 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a13c487b-6ff4-4f14-b85a-5da15ce928f9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:56.695468 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a13c487b-6ff4-4f14-b85a-5da15ce928f9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109" status: 200 len: 1473 microversion: 2.1 time: 0.106721 May 10 21:11:56.696316 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 207/436] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:56 2022] GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109 => generated 1473 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:56.883331 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9c413d6d-fa60-4886-b3d0-1047e06ec74a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Action: 'create', calling method: .version_select at 0x7f85d555e310>, body: {"keypair": {"name": "tempest-TestShelveInstance-576792337", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOQLNV3zhsKzYuYBROzuYj9TI8LbyJZujj/6gDWWG3qd/uK2j58y/WVvr+j8o1AGTOcP7pqz7Ww9CqqqjoBUDsD9eorOMyh2VTpFKgZjokVA9cPGGgg/QM7ZIdgLLfiuA=="}} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:11:56.897909 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.quota [None req-9c413d6d-fa60-4886-b3d0-1047e06ec74a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Getting quotas for project fa59d3d177fb4b578fecee910e079117. Resources: {'key_pairs'} {{(pid=117713) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:11:56.902551 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.quota [None req-9c413d6d-fa60-4886-b3d0-1047e06ec74a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Getting quotas for user 4c4ab23d3e7b4b018d144bea8b98dc24 and project fa59d3d177fb4b578fecee910e079117. Resources: {'key_pairs'} {{(pid=117713) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:11:57.014606 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9c413d6d-fa60-4886-b3d0-1047e06ec74a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.247813 May 10 21:11:57.015319 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 230/437] 10.222.0.49 () {60 vars in 1158 bytes} [Tue May 10 21:11:56 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:11:57.091114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-03defb1f-96e8-47ce-80a6-76cae7bc8086 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:57.091823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-03defb1f-96e8-47ce-80a6-76cae7bc8086 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:57.098249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03defb1f-96e8-47ce-80a6-76cae7bc8086 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:57.098890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03defb1f-96e8-47ce-80a6-76cae7bc8086 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:57.099890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03defb1f-96e8-47ce-80a6-76cae7bc8086 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:57.100513 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03defb1f-96e8-47ce-80a6-76cae7bc8086 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:57.247820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-03defb1f-96e8-47ce-80a6-76cae7bc8086 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:57.257642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-03defb1f-96e8-47ce-80a6-76cae7bc8086 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1366 microversion: 2.1 time: 0.169186 May 10 21:11:57.257642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 208/438] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:57 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:57.451798 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-422a27dc-3f6b-4f98-acc9-556dc5c6430e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:57.452391 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-422a27dc-3f6b-4f98-acc9-556dc5c6430e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:57.459886 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-422a27dc-3f6b-4f98-acc9-556dc5c6430e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:57.460342 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-422a27dc-3f6b-4f98-acc9-556dc5c6430e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:57.461125 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-422a27dc-3f6b-4f98-acc9-556dc5c6430e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:57.461565 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-422a27dc-3f6b-4f98-acc9-556dc5c6430e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:57.664281 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-422a27dc-3f6b-4f98-acc9-556dc5c6430e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:57.678415 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-422a27dc-3f6b-4f98-acc9-556dc5c6430e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:57.680121 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-422a27dc-3f6b-4f98-acc9-556dc5c6430e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:57.681287 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-422a27dc-3f6b-4f98-acc9-556dc5c6430e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1754 microversion: 2.20 time: 0.233685 May 10 21:11:57.682028 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 231/439] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:57 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1754 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:57.714283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4b513172-d1ac-4283-b00a-b57517ac5863 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:57.715016 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4b513172-d1ac-4283-b00a-b57517ac5863 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:57.723026 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4b513172-d1ac-4283-b00a-b57517ac5863 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:57.723755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4b513172-d1ac-4283-b00a-b57517ac5863 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:57.728409 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4b513172-d1ac-4283-b00a-b57517ac5863 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:57.728409 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4b513172-d1ac-4283-b00a-b57517ac5863 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:57.761649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4b513172-d1ac-4283-b00a-b57517ac5863 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:57.762193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4b513172-d1ac-4283-b00a-b57517ac5863 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:57.762865 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.objects.instance [None req-4b513172-d1ac-4283-b00a-b57517ac5863 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lazy-loading 'fault' on Instance uuid dbfaa131-2006-47ea-823a-ec96bb872109 {{(pid=117714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:11:57.840465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4b513172-d1ac-4283-b00a-b57517ac5863 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:57.850791 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4b513172-d1ac-4283-b00a-b57517ac5863 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109" status: 200 len: 1309 microversion: 2.1 time: 0.140795 May 10 21:11:57.862641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 209/440] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:57 2022] GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109 => generated 1309 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:58.275548 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-bdf235ab-3ccc-4bf2-ae5f-85a1d34aa55e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:58.276763 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-bdf235ab-3ccc-4bf2-ae5f-85a1d34aa55e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:58.286957 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bdf235ab-3ccc-4bf2-ae5f-85a1d34aa55e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:58.291002 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bdf235ab-3ccc-4bf2-ae5f-85a1d34aa55e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:58.291002 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bdf235ab-3ccc-4bf2-ae5f-85a1d34aa55e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:58.291002 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bdf235ab-3ccc-4bf2-ae5f-85a1d34aa55e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:58.540910 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-bdf235ab-3ccc-4bf2-ae5f-85a1d34aa55e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:58.553543 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-bdf235ab-3ccc-4bf2-ae5f-85a1d34aa55e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1366 microversion: 2.1 time: 0.283442 May 10 21:11:58.565746 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 232/441] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:58 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:11:58.700248 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a6da0dc2-6bf3-4d36-8fe0-756d6f7f8a02 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:58.700876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a6da0dc2-6bf3-4d36-8fe0-756d6f7f8a02 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:58.708645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a6da0dc2-6bf3-4d36-8fe0-756d6f7f8a02 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:58.709546 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a6da0dc2-6bf3-4d36-8fe0-756d6f7f8a02 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:58.710391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a6da0dc2-6bf3-4d36-8fe0-756d6f7f8a02 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:58.710915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a6da0dc2-6bf3-4d36-8fe0-756d6f7f8a02 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:58.869950 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-afd415de-0b5d-4791-887a-615e2f8327fd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:58.870744 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-afd415de-0b5d-4791-887a-615e2f8327fd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: dbfaa131-2006-47ea-823a-ec96bb872109] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:58.877484 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-afd415de-0b5d-4791-887a-615e2f8327fd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:58.877944 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-afd415de-0b5d-4791-887a-615e2f8327fd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:58.878735 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-afd415de-0b5d-4791-887a-615e2f8327fd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:58.879382 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-afd415de-0b5d-4791-887a-615e2f8327fd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:58.895483 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.wsgi [None req-afd415de-0b5d-4791-887a-615e2f8327fd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] HTTP exception thrown: Instance dbfaa131-2006-47ea-823a-ec96bb872109 could not be found. May 10 21:11:58.897200 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-afd415de-0b5d-4791-887a-615e2f8327fd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Request method failure captured: May 10 21:11:58.897200 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: request: GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109 HTTP/1.1 May 10 21:11:58.897200 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Accept: application/json May 10 21:11:58.897200 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Accept-Encoding: identity May 10 21:11:58.897200 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Connection: close May 10 21:11:58.897200 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Content-Length: 0 May 10 21:11:58.897200 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Content-Type: application/json May 10 21:11:58.897200 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Host: 10.222.0.49 May 10 21:11:58.897200 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Openstack-System-Scope: None May 10 21:11:58.897200 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: User-Agent: python-urllib3/1.26.9 May 10 21:11:58.897200 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Auth-Token: gAAAAABietS0ma52EIDMZVLUzsXG3bxQ4j06sc8cl4m7I6EHHffQA2nSL3KWRqj0-fKv8IrV3CL27h_uQRrHq7qkkdFLpXLlZPDGJXL0_5bdbEBBbpSMvr0oLRWthCXHTXr_0lioI7Lre83aaRzSEK1kcRLiE-QUGzI7diJH24EZs2iyRNwSdeY May 10 21:11:58.897200 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Domain-Id: None May 10 21:11:58.897200 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Domain-Name: None May 10 21:11:58.897200 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Identity-Status: Confirmed May 10 21:11:58.897200 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Is-Admin-Project: True May 10 21:11:58.897200 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Domain-Id: default May 10 21:11:58.897200 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Domain-Name: Default May 10 21:11:58.897200 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Id: b51f628be6144a698276671df56eac18 May 10 21:11:58.897200 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Name: tempest-VolumesSnapshotTestJSON-447231634 May 10 21:11:58.897200 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Role: reader,member May 10 21:11:58.897200 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Roles: reader,member May 10 21:11:58.898575 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b51f628be6144a698276671df56eac18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b51f628be6144a698276671df56eac18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b51f628be6144a698276671df56eac18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b51f628be6144a698276671df56eac18", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:11:58.898575 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Tenant: tempest-VolumesSnapshotTestJSON-447231634 May 10 21:11:58.898575 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Tenant-Id: b51f628be6144a698276671df56eac18 May 10 21:11:58.898575 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-447231634 May 10 21:11:58.898575 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User: tempest-VolumesSnapshotTestJSON-447231634-project May 10 21:11:58.898575 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Domain-Id: default May 10 21:11:58.898575 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Domain-Name: Default May 10 21:11:58.898575 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Id: 842fa4b1c86e4c208ab1f1f119d3bdd8 May 10 21:11:58.898575 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Name: tempest-VolumesSnapshotTestJSON-447231634-project May 10 21:11:58.898575 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: method: > May 10 21:11:58.898575 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: exception: Instance dbfaa131-2006-47ea-823a-ec96bb872109 could not be found. May 10 21:11:58.898575 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: action_args: {'id': 'dbfaa131-2006-47ea-823a-ec96bb872109'} May 10 21:11:58.899401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:11:58.899401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:11:58.899401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:11:58.899401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:11:58.899401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:11:58.899401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:11:58.899401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:11:58.899401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:11:58.899401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:11:58.899401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:11:58.899401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbfaa131-2006-47ea-823a-ec96bb872109 could not be found. May 10 21:11:58.899401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:11:58.899401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:11:58.899401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:11:58.899401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:11:58.899401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:11:58.899401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:11:58.899401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:11:58.899401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:11:58.899401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:11:58.900630 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:11:58.900630 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:11:58.900630 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:11:58.900630 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:11:58.900630 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:11:58.900630 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:11:58.900630 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:11:58.900630 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbfaa131-2006-47ea-823a-ec96bb872109 could not be found. May 10 21:11:58.900630 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:11:58.900630 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:11:58.900630 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:11:58.900630 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:11:58.900630 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:11:58.900630 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:11:58.900630 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:11:58.900630 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:11:58.900630 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbfaa131-2006-47ea-823a-ec96bb872109 could not be found. May 10 21:11:58.900630 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:11:58.903242 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-afd415de-0b5d-4791-887a-615e2f8327fd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Returning 404 to user: Instance dbfaa131-2006-47ea-823a-ec96bb872109 could not be found. {{(pid=117713) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:11:58.903242 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-afd415de-0b5d-4791-887a-615e2f8327fd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109" status: 404 len: 111 microversion: 2.1 time: 0.032763 May 10 21:11:58.903242 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 233/442] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:58 2022] GET /compute/v2.1/servers/dbfaa131-2006-47ea-823a-ec96bb872109 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 21:11:59.186106 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a6da0dc2-6bf3-4d36-8fe0-756d6f7f8a02 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:59.213061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a6da0dc2-6bf3-4d36-8fe0-756d6f7f8a02 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:59.223337 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a6da0dc2-6bf3-4d36-8fe0-756d6f7f8a02 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:59.226498 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a6da0dc2-6bf3-4d36-8fe0-756d6f7f8a02 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1810 microversion: 2.20 time: 0.530361 May 10 21:11:59.238102 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 210/443] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:11:58 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1810 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:11:59.571797 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a9e372f4-c99a-4e3f-994f-4ab450645f9e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:11:59.574390 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a9e372f4-c99a-4e3f-994f-4ab450645f9e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:11:59.583458 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a9e372f4-c99a-4e3f-994f-4ab450645f9e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:59.584301 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a9e372f4-c99a-4e3f-994f-4ab450645f9e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:59.585239 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a9e372f4-c99a-4e3f-994f-4ab450645f9e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:11:59.586132 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a9e372f4-c99a-4e3f-994f-4ab450645f9e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:11:59.809089 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-a9e372f4-c99a-4e3f-994f-4ab450645f9e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:11:59.817627 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a9e372f4-c99a-4e3f-994f-4ab450645f9e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1366 microversion: 2.1 time: 0.249710 May 10 21:11:59.818633 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 234/444] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:11:59 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:00.246502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ea18125d-66b1-4337-9c97-2da39be2a3f3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:00.247319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ea18125d-66b1-4337-9c97-2da39be2a3f3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:00.264505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ea18125d-66b1-4337-9c97-2da39be2a3f3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:00.266944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ea18125d-66b1-4337-9c97-2da39be2a3f3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:00.276722 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ea18125d-66b1-4337-9c97-2da39be2a3f3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:00.278741 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ea18125d-66b1-4337-9c97-2da39be2a3f3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:00.528896 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ea18125d-66b1-4337-9c97-2da39be2a3f3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:00.538185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ea18125d-66b1-4337-9c97-2da39be2a3f3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:00.543481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ea18125d-66b1-4337-9c97-2da39be2a3f3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:00.544924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ea18125d-66b1-4337-9c97-2da39be2a3f3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1810 microversion: 2.20 time: 0.303444 May 10 21:12:00.545405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 211/445] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:12:00 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1810 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:12:00.836468 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-0e520e5f-0369-4667-a9be-6b22f0f35b89 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:00.837090 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-0e520e5f-0369-4667-a9be-6b22f0f35b89 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:00.844459 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0e520e5f-0369-4667-a9be-6b22f0f35b89 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:00.844914 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0e520e5f-0369-4667-a9be-6b22f0f35b89 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:00.845710 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0e520e5f-0369-4667-a9be-6b22f0f35b89 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:00.846157 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0e520e5f-0369-4667-a9be-6b22f0f35b89 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:00.998476 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-0e520e5f-0369-4667-a9be-6b22f0f35b89 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:01.007006 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-0e520e5f-0369-4667-a9be-6b22f0f35b89 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1366 microversion: 2.1 time: 0.174845 May 10 21:12:01.007939 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 235/446] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:00 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:01.564187 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4ae29370-d0fa-4c52-b208-63db69ba3091 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:01.564828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4ae29370-d0fa-4c52-b208-63db69ba3091 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:01.571574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4ae29370-d0fa-4c52-b208-63db69ba3091 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:01.572023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4ae29370-d0fa-4c52-b208-63db69ba3091 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:01.572785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4ae29370-d0fa-4c52-b208-63db69ba3091 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:01.573218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4ae29370-d0fa-4c52-b208-63db69ba3091 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:01.710743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4ae29370-d0fa-4c52-b208-63db69ba3091 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:01.719068 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4ae29370-d0fa-4c52-b208-63db69ba3091 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:01.720677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4ae29370-d0fa-4c52-b208-63db69ba3091 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:01.721835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4ae29370-d0fa-4c52-b208-63db69ba3091 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1810 microversion: 2.20 time: 0.162606 May 10 21:12:01.722402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 212/447] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:12:01 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:12:02.024845 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-4422c3a4-fe02-4bb2-9841-05b29b74662f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:02.025409 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-4422c3a4-fe02-4bb2-9841-05b29b74662f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:02.031902 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4422c3a4-fe02-4bb2-9841-05b29b74662f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:02.032867 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4422c3a4-fe02-4bb2-9841-05b29b74662f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:02.033710 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4422c3a4-fe02-4bb2-9841-05b29b74662f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:02.034147 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4422c3a4-fe02-4bb2-9841-05b29b74662f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:02.172363 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-4422c3a4-fe02-4bb2-9841-05b29b74662f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:02.182383 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-4422c3a4-fe02-4bb2-9841-05b29b74662f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1366 microversion: 2.1 time: 0.161453 May 10 21:12:02.182964 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 236/448] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:02 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:02.740224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-640b1a32-1798-49e5-8505-4d04cc0f1da8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:02.741568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-640b1a32-1798-49e5-8505-4d04cc0f1da8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:02.748370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-640b1a32-1798-49e5-8505-4d04cc0f1da8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:02.749251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-640b1a32-1798-49e5-8505-4d04cc0f1da8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:02.750279 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-640b1a32-1798-49e5-8505-4d04cc0f1da8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:02.750920 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-640b1a32-1798-49e5-8505-4d04cc0f1da8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:02.914403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-640b1a32-1798-49e5-8505-4d04cc0f1da8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:02.927557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-640b1a32-1798-49e5-8505-4d04cc0f1da8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:02.929409 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-640b1a32-1798-49e5-8505-4d04cc0f1da8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:02.931019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-640b1a32-1798-49e5-8505-4d04cc0f1da8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1810 microversion: 2.20 time: 0.195230 May 10 21:12:02.935361 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 213/449] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:12:02 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1810 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:12:03.200322 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-5aa4cd4a-f908-4dfa-882a-1ee680d359f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:03.202048 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5aa4cd4a-f908-4dfa-882a-1ee680d359f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:03.210709 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5aa4cd4a-f908-4dfa-882a-1ee680d359f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:03.211540 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5aa4cd4a-f908-4dfa-882a-1ee680d359f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:03.212546 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5aa4cd4a-f908-4dfa-882a-1ee680d359f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:03.213203 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5aa4cd4a-f908-4dfa-882a-1ee680d359f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:03.353635 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-5aa4cd4a-f908-4dfa-882a-1ee680d359f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:03.362422 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-5aa4cd4a-f908-4dfa-882a-1ee680d359f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1366 microversion: 2.1 time: 0.166152 May 10 21:12:03.363871 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 237/450] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:03 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:03.950566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dbc88bc4-e3cb-4e8d-934f-572bfbab3403 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:03.951278 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dbc88bc4-e3cb-4e8d-934f-572bfbab3403 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:03.963375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dbc88bc4-e3cb-4e8d-934f-572bfbab3403 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:03.964121 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dbc88bc4-e3cb-4e8d-934f-572bfbab3403 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:03.965284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dbc88bc4-e3cb-4e8d-934f-572bfbab3403 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:03.965720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dbc88bc4-e3cb-4e8d-934f-572bfbab3403 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:04.165589 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dbc88bc4-e3cb-4e8d-934f-572bfbab3403 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:04.177173 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dbc88bc4-e3cb-4e8d-934f-572bfbab3403 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:04.179213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dbc88bc4-e3cb-4e8d-934f-572bfbab3403 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:04.180527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dbc88bc4-e3cb-4e8d-934f-572bfbab3403 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1810 microversion: 2.20 time: 0.233953 May 10 21:12:04.181183 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 214/451] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:12:03 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1810 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:12:04.382582 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-b4668e28-80c3-4df3-b939-78dccb912ae5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:04.384160 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-b4668e28-80c3-4df3-b939-78dccb912ae5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:04.391779 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b4668e28-80c3-4df3-b939-78dccb912ae5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:04.392859 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b4668e28-80c3-4df3-b939-78dccb912ae5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:04.394784 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b4668e28-80c3-4df3-b939-78dccb912ae5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:04.396800 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b4668e28-80c3-4df3-b939-78dccb912ae5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:04.574506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-e468569a-0a9d-4ee4-9092-6d966034d421 req-e7f12427-0d68-40d2-8deb-403096f8bcd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2a9d425-c6f1-4f23-8fb7-7311ca431fdf", "name": "network-vif-plugged", "status": "completed", "tag": "d05ef2a7-f2fb-4df8-8e70-5029d667aaa7"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:04.593924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-e468569a-0a9d-4ee4-9092-6d966034d421 req-e7f12427-0d68-40d2-8deb-403096f8bcd6 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:04.594709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-e468569a-0a9d-4ee4-9092-6d966034d421 req-e7f12427-0d68-40d2-8deb-403096f8bcd6 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:04.662640 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-e468569a-0a9d-4ee4-9092-6d966034d421 req-e7f12427-0d68-40d2-8deb-403096f8bcd6 service nova] Creating event network-vif-plugged:d05ef2a7-f2fb-4df8-8e70-5029d667aaa7 for instance f2a9d425-c6f1-4f23-8fb7-7311ca431fdf on hv-cinder-82880 May 10 21:12:04.662640 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-e468569a-0a9d-4ee4-9092-6d966034d421 req-e7f12427-0d68-40d2-8deb-403096f8bcd6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089477 May 10 21:12:04.662640 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 215/452] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:12:04.670005 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-b4668e28-80c3-4df3-b939-78dccb912ae5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:04.688687 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-b4668e28-80c3-4df3-b939-78dccb912ae5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1366 microversion: 2.1 time: 0.312169 May 10 21:12:04.690677 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 238/453] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:04 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1366 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:05.201791 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3b17262d-fbee-437b-b89e-43962a2bbda4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:05.202701 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3b17262d-fbee-437b-b89e-43962a2bbda4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:05.213607 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3b17262d-fbee-437b-b89e-43962a2bbda4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:05.215368 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3b17262d-fbee-437b-b89e-43962a2bbda4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:05.215891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3b17262d-fbee-437b-b89e-43962a2bbda4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:05.216689 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3b17262d-fbee-437b-b89e-43962a2bbda4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:05.442134 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3b17262d-fbee-437b-b89e-43962a2bbda4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:05.444173 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3b17262d-fbee-437b-b89e-43962a2bbda4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:05.445786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3b17262d-fbee-437b-b89e-43962a2bbda4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:05.447519 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3b17262d-fbee-437b-b89e-43962a2bbda4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1810 microversion: 2.20 time: 0.251142 May 10 21:12:05.448079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 216/454] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:12:05 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1810 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:12:05.712143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-ef02147f-b9d7-4007-8075-5fc15bc70062 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:05.712760 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-ef02147f-b9d7-4007-8075-5fc15bc70062 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:05.720280 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ef02147f-b9d7-4007-8075-5fc15bc70062 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:05.721654 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ef02147f-b9d7-4007-8075-5fc15bc70062 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:05.722439 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ef02147f-b9d7-4007-8075-5fc15bc70062 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:05.722874 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ef02147f-b9d7-4007-8075-5fc15bc70062 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:05.876819 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-ef02147f-b9d7-4007-8075-5fc15bc70062 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:05.887847 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-ef02147f-b9d7-4007-8075-5fc15bc70062 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1366 microversion: 2.1 time: 0.179349 May 10 21:12:05.895375 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 239/455] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:05 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:06.465935 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-747d7e1e-6589-491a-9292-76d5a7c042e3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:06.466707 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-747d7e1e-6589-491a-9292-76d5a7c042e3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:06.473911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-747d7e1e-6589-491a-9292-76d5a7c042e3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:06.474430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-747d7e1e-6589-491a-9292-76d5a7c042e3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:06.475396 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-747d7e1e-6589-491a-9292-76d5a7c042e3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:06.475903 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-747d7e1e-6589-491a-9292-76d5a7c042e3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:06.646204 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-747d7e1e-6589-491a-9292-76d5a7c042e3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:06.654658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-747d7e1e-6589-491a-9292-76d5a7c042e3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:06.656189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-747d7e1e-6589-491a-9292-76d5a7c042e3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:06.657394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-747d7e1e-6589-491a-9292-76d5a7c042e3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1810 microversion: 2.20 time: 0.195446 May 10 21:12:06.657961 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 217/456] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:12:06 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1810 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:12:06.905498 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a2ae796e-ca8c-4980-a059-7000ac9df000 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:06.906889 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a2ae796e-ca8c-4980-a059-7000ac9df000 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:06.916087 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a2ae796e-ca8c-4980-a059-7000ac9df000 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:06.919376 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a2ae796e-ca8c-4980-a059-7000ac9df000 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:06.925074 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a2ae796e-ca8c-4980-a059-7000ac9df000 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:06.925074 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a2ae796e-ca8c-4980-a059-7000ac9df000 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:07.085506 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-a2ae796e-ca8c-4980-a059-7000ac9df000 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:07.094588 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a2ae796e-ca8c-4980-a059-7000ac9df000 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1366 microversion: 2.1 time: 0.192674 May 10 21:12:07.095003 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 240/457] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:06 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:07.675758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-28235c6c-6d2d-47c7-8a89-57a9794e6a06 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:07.676352 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-28235c6c-6d2d-47c7-8a89-57a9794e6a06 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:07.682631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28235c6c-6d2d-47c7-8a89-57a9794e6a06 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:07.683093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28235c6c-6d2d-47c7-8a89-57a9794e6a06 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:07.683898 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28235c6c-6d2d-47c7-8a89-57a9794e6a06 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:07.684348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28235c6c-6d2d-47c7-8a89-57a9794e6a06 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:07.868580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-28235c6c-6d2d-47c7-8a89-57a9794e6a06 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:07.891981 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-28235c6c-6d2d-47c7-8a89-57a9794e6a06 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:07.894298 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-28235c6c-6d2d-47c7-8a89-57a9794e6a06 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:07.896670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-28235c6c-6d2d-47c7-8a89-57a9794e6a06 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1810 microversion: 2.20 time: 0.224907 May 10 21:12:07.897813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 218/458] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:12:07 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1810 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:12:08.112867 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-bb2a30e1-092a-42f3-a7d2-9654fe7742e1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:08.114363 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-bb2a30e1-092a-42f3-a7d2-9654fe7742e1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:08.126851 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bb2a30e1-092a-42f3-a7d2-9654fe7742e1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:08.127343 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bb2a30e1-092a-42f3-a7d2-9654fe7742e1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:08.128364 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bb2a30e1-092a-42f3-a7d2-9654fe7742e1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:08.128835 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bb2a30e1-092a-42f3-a7d2-9654fe7742e1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:08.463930 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-bb2a30e1-092a-42f3-a7d2-9654fe7742e1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:08.481764 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-bb2a30e1-092a-42f3-a7d2-9654fe7742e1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1366 microversion: 2.1 time: 0.364203 May 10 21:12:08.497759 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 241/459] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:08 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1366 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:08.919834 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1372c932-80be-4ec7-83d7-841b7828b8fb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:08.921167 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1372c932-80be-4ec7-83d7-841b7828b8fb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:08.939067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1372c932-80be-4ec7-83d7-841b7828b8fb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:08.942738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1372c932-80be-4ec7-83d7-841b7828b8fb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:08.944441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1372c932-80be-4ec7-83d7-841b7828b8fb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:08.945631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1372c932-80be-4ec7-83d7-841b7828b8fb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:09.149878 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1372c932-80be-4ec7-83d7-841b7828b8fb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:09.176485 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1372c932-80be-4ec7-83d7-841b7828b8fb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:09.178236 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1372c932-80be-4ec7-83d7-841b7828b8fb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:09.179481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1372c932-80be-4ec7-83d7-841b7828b8fb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1810 microversion: 2.20 time: 0.264191 May 10 21:12:09.180375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 219/460] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:12:08 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1810 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:12:09.500870 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-3236fff2-20f5-4351-a1f9-8923fdcfd29b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:09.501487 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-3236fff2-20f5-4351-a1f9-8923fdcfd29b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:09.509531 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3236fff2-20f5-4351-a1f9-8923fdcfd29b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:09.509981 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3236fff2-20f5-4351-a1f9-8923fdcfd29b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:09.510804 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3236fff2-20f5-4351-a1f9-8923fdcfd29b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:09.511369 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3236fff2-20f5-4351-a1f9-8923fdcfd29b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:09.676778 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-27dc64bc-fe6f-46c2-a61f-597eba6afd51 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1164763869", "imageRef": "cb321ccf-1ce7-4dda-90d0-f05332eb6fe1", "flavorRef": "452", "networks": [{"uuid": "2f3240e6-359e-4de0-ab8c-6c2518aa9713"}]}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:09.798367 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-3236fff2-20f5-4351-a1f9-8923fdcfd29b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:09.807004 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-3236fff2-20f5-4351-a1f9-8923fdcfd29b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1366 microversion: 2.1 time: 0.310005 May 10 21:12:09.808354 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 242/461] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:09 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:10.200556 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-0ae45d23-595a-4042-abe6-6a2a044d72af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:10.201287 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-0ae45d23-595a-4042-abe6-6a2a044d72af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:10.215530 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0ae45d23-595a-4042-abe6-6a2a044d72af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:10.216593 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0ae45d23-595a-4042-abe6-6a2a044d72af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:10.217593 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0ae45d23-595a-4042-abe6-6a2a044d72af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:10.218655 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0ae45d23-595a-4042-abe6-6a2a044d72af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:10.496118 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-0ae45d23-595a-4042-abe6-6a2a044d72af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:10.505309 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-0ae45d23-595a-4042-abe6-6a2a044d72af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:10.509178 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-0ae45d23-595a-4042-abe6-6a2a044d72af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:10.510637 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-0ae45d23-595a-4042-abe6-6a2a044d72af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1810 microversion: 2.20 time: 0.314616 May 10 21:12:10.511806 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 243/462] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:12:10 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1810 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:12:10.826589 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-3420489b-2a26-463e-8ec4-98ef3cfdee75 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:10.827236 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-3420489b-2a26-463e-8ec4-98ef3cfdee75 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:10.845566 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3420489b-2a26-463e-8ec4-98ef3cfdee75 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:10.846406 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3420489b-2a26-463e-8ec4-98ef3cfdee75 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:10.847487 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3420489b-2a26-463e-8ec4-98ef3cfdee75 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:10.848093 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3420489b-2a26-463e-8ec4-98ef3cfdee75 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:11.151359 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-3420489b-2a26-463e-8ec4-98ef3cfdee75 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:11.159633 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-3420489b-2a26-463e-8ec4-98ef3cfdee75 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1366 microversion: 2.1 time: 0.337280 May 10 21:12:11.169332 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 244/463] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:10 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1366 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:11.529801 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-27424f24-76ea-45aa-a2fb-a64b84362d70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:11.530534 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-27424f24-76ea-45aa-a2fb-a64b84362d70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:11.536342 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-27424f24-76ea-45aa-a2fb-a64b84362d70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:11.537099 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-27424f24-76ea-45aa-a2fb-a64b84362d70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:11.538120 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-27424f24-76ea-45aa-a2fb-a64b84362d70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:11.538774 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-27424f24-76ea-45aa-a2fb-a64b84362d70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:11.801197 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-27424f24-76ea-45aa-a2fb-a64b84362d70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:11.815468 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-27424f24-76ea-45aa-a2fb-a64b84362d70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:11.816974 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-27424f24-76ea-45aa-a2fb-a64b84362d70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:11.818192 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-27424f24-76ea-45aa-a2fb-a64b84362d70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1810 microversion: 2.20 time: 0.292281 May 10 21:12:11.825598 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 245/464] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:12:11 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1810 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:12:12.180466 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f7d73208-3c32-463c-a464-f192f4a3cd45 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:12.180466 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f7d73208-3c32-463c-a464-f192f4a3cd45 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:12.185168 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f7d73208-3c32-463c-a464-f192f4a3cd45 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:12.185690 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f7d73208-3c32-463c-a464-f192f4a3cd45 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:12.186677 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f7d73208-3c32-463c-a464-f192f4a3cd45 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:12.187235 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f7d73208-3c32-463c-a464-f192f4a3cd45 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:12.385313 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-f7d73208-3c32-463c-a464-f192f4a3cd45 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:12.403812 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f7d73208-3c32-463c-a464-f192f4a3cd45 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1366 microversion: 2.1 time: 0.222362 May 10 21:12:12.409532 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 246/465] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:12 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:12.837287 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-df084474-90a8-4350-9bb9-04c169c57029 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:12.838053 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-df084474-90a8-4350-9bb9-04c169c57029 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:12.860160 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-df084474-90a8-4350-9bb9-04c169c57029 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:12.869160 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-df084474-90a8-4350-9bb9-04c169c57029 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:12.871561 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-df084474-90a8-4350-9bb9-04c169c57029 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:12.872601 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-df084474-90a8-4350-9bb9-04c169c57029 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:13.193372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-df084474-90a8-4350-9bb9-04c169c57029 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:13.204708 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-df084474-90a8-4350-9bb9-04c169c57029 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:13.207975 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-df084474-90a8-4350-9bb9-04c169c57029 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:13.209265 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-df084474-90a8-4350-9bb9-04c169c57029 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1810 microversion: 2.20 time: 0.376657 May 10 21:12:13.219155 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 247/466] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:12:12 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1810 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:12:13.221694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.network.neutron [None req-27dc64bc-fe6f-46c2-a61f-597eba6afd51 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] validate_networks() for [('2f3240e6-359e-4de0-ab8c-6c2518aa9713', None, None, None, None, None)] {{(pid=117714) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:12:13.426604 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-45dbecef-26cd-4a49-bde6-335cbb1e11a8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:13.427567 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-45dbecef-26cd-4a49-bde6-335cbb1e11a8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:13.445023 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-45dbecef-26cd-4a49-bde6-335cbb1e11a8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:13.445787 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-45dbecef-26cd-4a49-bde6-335cbb1e11a8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:13.446897 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-45dbecef-26cd-4a49-bde6-335cbb1e11a8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:13.457056 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-45dbecef-26cd-4a49-bde6-335cbb1e11a8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:13.683421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-27dc64bc-fe6f-46c2-a61f-597eba6afd51 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Flavor limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:12:13.683989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-27dc64bc-fe6f-46c2-a61f-597eba6afd51 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Image limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:12:13.684615 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-27dc64bc-fe6f-46c2-a61f-597eba6afd51 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Flavor pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:12:13.685340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-27dc64bc-fe6f-46c2-a61f-597eba6afd51 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Image pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:12:13.686077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-27dc64bc-fe6f-46c2-a61f-597eba6afd51 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:12:13.697511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27dc64bc-fe6f-46c2-a61f-597eba6afd51 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:13.706240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27dc64bc-fe6f-46c2-a61f-597eba6afd51 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:13.706240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27dc64bc-fe6f-46c2-a61f-597eba6afd51 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:13.706240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27dc64bc-fe6f-46c2-a61f-597eba6afd51 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:13.718511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-27dc64bc-fe6f-46c2-a61f-597eba6afd51 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Getting quotas for project b51f628be6144a698276671df56eac18. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:12:13.719704 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-45dbecef-26cd-4a49-bde6-335cbb1e11a8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:13.724136 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-27dc64bc-fe6f-46c2-a61f-597eba6afd51 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Getting quotas for user 842fa4b1c86e4c208ab1f1f119d3bdd8 and project b51f628be6144a698276671df56eac18. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:12:13.728649 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-45dbecef-26cd-4a49-bde6-335cbb1e11a8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1366 microversion: 2.1 time: 0.306345 May 10 21:12:13.729542 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 248/467] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:13 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1366 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:13.752144 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-27dc64bc-fe6f-46c2-a61f-597eba6afd51 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Going to run 1 instances... {{(pid=117714) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:12:13.756568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-27dc64bc-fe6f-46c2-a61f-597eba6afd51 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb321ccf-1ce7-4dda-90d0-f05332eb6fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117714) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:12:13.964599 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-27dc64bc-fe6f-46c2-a61f-597eba6afd51 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.292961 May 10 21:12:13.969645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 220/468] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 21:12:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 4295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 21:12:13.978627 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-90eaf31b-4f71-425d-b3db-d29ee28100f1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:13.979267 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-90eaf31b-4f71-425d-b3db-d29ee28100f1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:14.035243 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-90eaf31b-4f71-425d-b3db-d29ee28100f1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:14.042017 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-90eaf31b-4f71-425d-b3db-d29ee28100f1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1219 microversion: 2.1 time: 0.067311 May 10 21:12:14.042594 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 249/469] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:13 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:14.229192 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b8bff647-547b-4a6b-87c1-a43499ab89e5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:14.229805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b8bff647-547b-4a6b-87c1-a43499ab89e5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:14.239819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b8bff647-547b-4a6b-87c1-a43499ab89e5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:14.240279 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b8bff647-547b-4a6b-87c1-a43499ab89e5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:14.241064 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b8bff647-547b-4a6b-87c1-a43499ab89e5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:14.241510 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b8bff647-547b-4a6b-87c1-a43499ab89e5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:14.406746 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b8bff647-547b-4a6b-87c1-a43499ab89e5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:14.416326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b8bff647-547b-4a6b-87c1-a43499ab89e5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:14.417956 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b8bff647-547b-4a6b-87c1-a43499ab89e5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:14.419302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b8bff647-547b-4a6b-87c1-a43499ab89e5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1810 microversion: 2.20 time: 0.194163 May 10 21:12:14.420388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 221/470] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:12:14 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1810 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:12:14.745870 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a4982716-b381-4416-86d7-4609ce5bc1f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:14.746513 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a4982716-b381-4416-86d7-4609ce5bc1f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:14.753505 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a4982716-b381-4416-86d7-4609ce5bc1f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:14.754180 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a4982716-b381-4416-86d7-4609ce5bc1f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:14.754955 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a4982716-b381-4416-86d7-4609ce5bc1f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:14.755567 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a4982716-b381-4416-86d7-4609ce5bc1f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:14.919185 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-a4982716-b381-4416-86d7-4609ce5bc1f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:14.934463 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a4982716-b381-4416-86d7-4609ce5bc1f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1366 microversion: 2.1 time: 0.192512 May 10 21:12:14.935040 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 250/471] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:14 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:15.059953 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3a59ddc8-aa0f-4d85-80a1-73bd20787d13 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:15.060566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3a59ddc8-aa0f-4d85-80a1-73bd20787d13 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:15.070872 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3a59ddc8-aa0f-4d85-80a1-73bd20787d13 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:15.071455 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3a59ddc8-aa0f-4d85-80a1-73bd20787d13 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:15.072310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3a59ddc8-aa0f-4d85-80a1-73bd20787d13 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:15.073013 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3a59ddc8-aa0f-4d85-80a1-73bd20787d13 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:15.136045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3a59ddc8-aa0f-4d85-80a1-73bd20787d13 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:15.146119 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3a59ddc8-aa0f-4d85-80a1-73bd20787d13 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1223 microversion: 2.1 time: 0.090337 May 10 21:12:15.147047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 222/472] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:15 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:15.446162 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-7a19b492-dca3-41b9-9297-53febc28381f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:15.451966 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-7a19b492-dca3-41b9-9297-53febc28381f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:15.454535 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7a19b492-dca3-41b9-9297-53febc28381f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:15.455322 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7a19b492-dca3-41b9-9297-53febc28381f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:15.456684 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7a19b492-dca3-41b9-9297-53febc28381f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:15.457303 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7a19b492-dca3-41b9-9297-53febc28381f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:15.629820 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-7a19b492-dca3-41b9-9297-53febc28381f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:15.638816 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-7a19b492-dca3-41b9-9297-53febc28381f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:15.640351 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-7a19b492-dca3-41b9-9297-53febc28381f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:15.641541 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-7a19b492-dca3-41b9-9297-53febc28381f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1810 microversion: 2.20 time: 0.208167 May 10 21:12:15.642420 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 251/473] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:12:15 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1810 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:12:15.952427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2b074770-7263-46ea-8f96-b38227ccbc7c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:15.953636 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2b074770-7263-46ea-8f96-b38227ccbc7c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:15.960443 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2b074770-7263-46ea-8f96-b38227ccbc7c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:15.960892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2b074770-7263-46ea-8f96-b38227ccbc7c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:15.963316 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2b074770-7263-46ea-8f96-b38227ccbc7c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:15.963316 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2b074770-7263-46ea-8f96-b38227ccbc7c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:16.119515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2b074770-7263-46ea-8f96-b38227ccbc7c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:16.125738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2b074770-7263-46ea-8f96-b38227ccbc7c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1366 microversion: 2.1 time: 0.177966 May 10 21:12:16.126314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 223/474] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:15 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:16.165933 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-61313ae5-0ee5-45cd-8728-31fde5633305 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:16.166624 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-61313ae5-0ee5-45cd-8728-31fde5633305 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:16.178093 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-61313ae5-0ee5-45cd-8728-31fde5633305 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:16.180620 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-61313ae5-0ee5-45cd-8728-31fde5633305 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:16.181570 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-61313ae5-0ee5-45cd-8728-31fde5633305 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:16.182088 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-61313ae5-0ee5-45cd-8728-31fde5633305 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:16.261638 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-61313ae5-0ee5-45cd-8728-31fde5633305 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:16.269309 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-61313ae5-0ee5-45cd-8728-31fde5633305 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1271 microversion: 2.1 time: 0.108802 May 10 21:12:16.269887 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 252/475] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:16 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1271 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:16.661920 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-86dfdcfc-5e06-42c2-95f6-b52c48687fab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:16.662918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-86dfdcfc-5e06-42c2-95f6-b52c48687fab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:16.669219 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-86dfdcfc-5e06-42c2-95f6-b52c48687fab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:16.669753 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-86dfdcfc-5e06-42c2-95f6-b52c48687fab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:16.670775 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-86dfdcfc-5e06-42c2-95f6-b52c48687fab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:16.671430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-86dfdcfc-5e06-42c2-95f6-b52c48687fab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:16.818558 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-86dfdcfc-5e06-42c2-95f6-b52c48687fab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:16.827653 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-86dfdcfc-5e06-42c2-95f6-b52c48687fab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:16.829173 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-86dfdcfc-5e06-42c2-95f6-b52c48687fab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:16.830385 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-86dfdcfc-5e06-42c2-95f6-b52c48687fab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1810 microversion: 2.20 time: 0.173299 May 10 21:12:16.831538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 224/476] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:12:16 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:12:17.141797 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-974ef120-d69f-4efe-9c88-e383c831b906 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:17.143998 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-974ef120-d69f-4efe-9c88-e383c831b906 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:17.150774 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-974ef120-d69f-4efe-9c88-e383c831b906 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:17.151285 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-974ef120-d69f-4efe-9c88-e383c831b906 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:17.152068 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-974ef120-d69f-4efe-9c88-e383c831b906 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:17.152776 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-974ef120-d69f-4efe-9c88-e383c831b906 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:17.292507 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1557da26-e885-4b41-9a60-5ea272e26bcc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:17.293953 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1557da26-e885-4b41-9a60-5ea272e26bcc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:17.304315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1557da26-e885-4b41-9a60-5ea272e26bcc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:17.304773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1557da26-e885-4b41-9a60-5ea272e26bcc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:17.305811 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1557da26-e885-4b41-9a60-5ea272e26bcc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:17.306437 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1557da26-e885-4b41-9a60-5ea272e26bcc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:17.439400 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1557da26-e885-4b41-9a60-5ea272e26bcc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:17.451390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1557da26-e885-4b41-9a60-5ea272e26bcc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1279 microversion: 2.1 time: 0.168227 May 10 21:12:17.462660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 225/477] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:17 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1279 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:17.501599 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-974ef120-d69f-4efe-9c88-e383c831b906 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:17.512280 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-974ef120-d69f-4efe-9c88-e383c831b906 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1557 microversion: 2.1 time: 0.374290 May 10 21:12:17.515192 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 253/478] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:17 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1557 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:17.530761 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3e35072a-5452-4cc1-ac74-3f1ea348e25a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:17.531687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3e35072a-5452-4cc1-ac74-3f1ea348e25a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:17.538252 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3e35072a-5452-4cc1-ac74-3f1ea348e25a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:17.538703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3e35072a-5452-4cc1-ac74-3f1ea348e25a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:17.546073 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3e35072a-5452-4cc1-ac74-3f1ea348e25a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:17.546299 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3e35072a-5452-4cc1-ac74-3f1ea348e25a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:17.742755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3e35072a-5452-4cc1-ac74-3f1ea348e25a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.215943 May 10 21:12:17.743660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 226/479] 10.222.0.49 () {58 vars in 1274 bytes} [Tue May 10 21:12:17 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf/os-interface => generated 285 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:12:17.850327 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-7ddca673-bd01-4170-9771-d45b1beb92a2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:17.850956 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-7ddca673-bd01-4170-9771-d45b1beb92a2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:17.861572 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7ddca673-bd01-4170-9771-d45b1beb92a2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:17.866485 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7ddca673-bd01-4170-9771-d45b1beb92a2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:17.867690 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7ddca673-bd01-4170-9771-d45b1beb92a2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:17.868363 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7ddca673-bd01-4170-9771-d45b1beb92a2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:18.316764 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-7ddca673-bd01-4170-9771-d45b1beb92a2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:18.329810 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-7ddca673-bd01-4170-9771-d45b1beb92a2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:18.333380 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-7ddca673-bd01-4170-9771-d45b1beb92a2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:18.335022 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-7ddca673-bd01-4170-9771-d45b1beb92a2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1810 microversion: 2.20 time: 0.489048 May 10 21:12:18.345849 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 254/480] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:12:17 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1810 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:12:18.470790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0efc476e-40da-4d0b-95dc-6b225d35eb3e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:18.473171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0efc476e-40da-4d0b-95dc-6b225d35eb3e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:18.496397 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0efc476e-40da-4d0b-95dc-6b225d35eb3e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:18.509187 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0efc476e-40da-4d0b-95dc-6b225d35eb3e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:18.511394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0efc476e-40da-4d0b-95dc-6b225d35eb3e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:18.512139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0efc476e-40da-4d0b-95dc-6b225d35eb3e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:18.679248 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-0cca313f-cedd-4a89-8e96-f44ed1cf0a2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-633335659", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-576792337", "security_groups": [{"name": "tempest-secgroup-smoke-1098118658"}], "networks": [{"uuid": "340750db-d003-4510-bbf1-ec4cbb25ce19"}], "block_device_mapping_v2": [{"uuid": "ab52ad37-10e1-4283-b743-6f5a4f96b44a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:18.703001 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0efc476e-40da-4d0b-95dc-6b225d35eb3e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:18.716506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0efc476e-40da-4d0b-95dc-6b225d35eb3e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1277 microversion: 2.1 time: 0.249986 May 10 21:12:18.717083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 227/481] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:18 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1277 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:19.140177 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.network.neutron [None req-0cca313f-cedd-4a89-8e96-f44ed1cf0a2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] validate_networks() for [('340750db-d003-4510-bbf1-ec4cbb25ce19', None, None, None, None, None)] {{(pid=117713) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:12:19.355715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-df925ec5-dc27-41d7-93aa-7ba14482d3d3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:19.356764 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-df925ec5-dc27-41d7-93aa-7ba14482d3d3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:19.371721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df925ec5-dc27-41d7-93aa-7ba14482d3d3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:19.372189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df925ec5-dc27-41d7-93aa-7ba14482d3d3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:19.374630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df925ec5-dc27-41d7-93aa-7ba14482d3d3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:19.377719 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df925ec5-dc27-41d7-93aa-7ba14482d3d3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:19.983036 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.virt.hardware [None req-0cca313f-cedd-4a89-8e96-f44ed1cf0a2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Flavor limits 0:0:0 {{(pid=117713) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:12:19.985478 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.virt.hardware [None req-0cca313f-cedd-4a89-8e96-f44ed1cf0a2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Image limits 0:0:0 {{(pid=117713) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:12:19.986326 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.virt.hardware [None req-0cca313f-cedd-4a89-8e96-f44ed1cf0a2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Flavor pref 0:0:0 {{(pid=117713) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:12:19.988633 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.virt.hardware [None req-0cca313f-cedd-4a89-8e96-f44ed1cf0a2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Image pref 0:0:0 {{(pid=117713) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:12:19.992907 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.virt.hardware [None req-0cca313f-cedd-4a89-8e96-f44ed1cf0a2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117713) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:12:19.999585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-df925ec5-dc27-41d7-93aa-7ba14482d3d3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:20.014569 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-df925ec5-dc27-41d7-93aa-7ba14482d3d3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:20.016764 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0cca313f-cedd-4a89-8e96-f44ed1cf0a2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:20.017376 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0cca313f-cedd-4a89-8e96-f44ed1cf0a2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:20.020807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-df925ec5-dc27-41d7-93aa-7ba14482d3d3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:20.021507 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0cca313f-cedd-4a89-8e96-f44ed1cf0a2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:20.022258 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0cca313f-cedd-4a89-8e96-f44ed1cf0a2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:20.022381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-df925ec5-dc27-41d7-93aa-7ba14482d3d3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1810 microversion: 2.20 time: 0.671913 May 10 21:12:20.025781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 228/482] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:12:19 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1810 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:12:20.041757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d36b1313-bb61-4f1b-85d0-3f7e99b78ae7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:20.045495 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d36b1313-bb61-4f1b-85d0-3f7e99b78ae7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:20.045620 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.quota [None req-0cca313f-cedd-4a89-8e96-f44ed1cf0a2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Getting quotas for project fa59d3d177fb4b578fecee910e079117. Resources: {'instances', 'cores', 'ram'} {{(pid=117713) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:12:20.050429 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.quota [None req-0cca313f-cedd-4a89-8e96-f44ed1cf0a2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Getting quotas for user 4c4ab23d3e7b4b018d144bea8b98dc24 and project fa59d3d177fb4b578fecee910e079117. Resources: {'instances', 'cores', 'ram'} {{(pid=117713) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:12:20.050671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d36b1313-bb61-4f1b-85d0-3f7e99b78ae7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:20.050920 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d36b1313-bb61-4f1b-85d0-3f7e99b78ae7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:20.052187 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d36b1313-bb61-4f1b-85d0-3f7e99b78ae7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:20.052819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d36b1313-bb61-4f1b-85d0-3f7e99b78ae7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:20.135950 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-0cca313f-cedd-4a89-8e96-f44ed1cf0a2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Going to run 1 instances... {{(pid=117713) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:12:20.138572 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-0cca313f-cedd-4a89-8e96-f44ed1cf0a2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ab52ad37-10e1-4283-b743-6f5a4f96b44a',volume_size=None,volume_type=None)] {{(pid=117713) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:12:20.426745 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d36b1313-bb61-4f1b-85d0-3f7e99b78ae7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:20.441022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d36b1313-bb61-4f1b-85d0-3f7e99b78ae7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1319 microversion: 2.1 time: 0.413820 May 10 21:12:20.442511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 229/483] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:20 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1319 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:20.636104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-47b1d0ea-c3e2-42ed-9be5-e3e24b77ba16 req-39eae91c-68a3-468b-839e-3f4598db93b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2a9d425-c6f1-4f23-8fb7-7311ca431fdf", "tag": "d05ef2a7-f2fb-4df8-8e70-5029d667aaa7"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:20.666071 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-47b1d0ea-c3e2-42ed-9be5-e3e24b77ba16 req-39eae91c-68a3-468b-839e-3f4598db93b7 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:20.666790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-47b1d0ea-c3e2-42ed-9be5-e3e24b77ba16 req-39eae91c-68a3-468b-839e-3f4598db93b7 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:20.673412 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-0cca313f-cedd-4a89-8e96-f44ed1cf0a2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.999402 May 10 21:12:20.680183 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 255/484] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 21:12:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 2006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 21:12:20.693429 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-147791fe-9367-4d70-ab4b-29fb2887a951 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:20.695933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-47b1d0ea-c3e2-42ed-9be5-e3e24b77ba16 req-39eae91c-68a3-468b-839e-3f4598db93b7 service nova] Creating event network-changed:d05ef2a7-f2fb-4df8-8e70-5029d667aaa7 for instance f2a9d425-c6f1-4f23-8fb7-7311ca431fdf on hv-cinder-82880 May 10 21:12:20.697101 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-147791fe-9367-4d70-ab4b-29fb2887a951 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:20.714234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-47b1d0ea-c3e2-42ed-9be5-e3e24b77ba16 req-39eae91c-68a3-468b-839e-3f4598db93b7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081918 May 10 21:12:20.721780 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 230/485] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:12:20.818099 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-147791fe-9367-4d70-ab4b-29fb2887a951 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:20.833599 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-147791fe-9367-4d70-ab4b-29fb2887a951 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1087 microversion: 2.1 time: 0.147543 May 10 21:12:20.834191 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 256/486] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:20 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1087 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:21.042022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bb5e09e2-cb93-49a1-aeeb-90b8aee450f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:21.042836 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bb5e09e2-cb93-49a1-aeeb-90b8aee450f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:21.055021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bb5e09e2-cb93-49a1-aeeb-90b8aee450f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:21.055021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bb5e09e2-cb93-49a1-aeeb-90b8aee450f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:21.055021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bb5e09e2-cb93-49a1-aeeb-90b8aee450f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:21.055021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bb5e09e2-cb93-49a1-aeeb-90b8aee450f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:21.277033 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bb5e09e2-cb93-49a1-aeeb-90b8aee450f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:21.292307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bb5e09e2-cb93-49a1-aeeb-90b8aee450f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:21.293912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bb5e09e2-cb93-49a1-aeeb-90b8aee450f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:21.301789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bb5e09e2-cb93-49a1-aeeb-90b8aee450f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1810 microversion: 2.20 time: 0.264399 May 10 21:12:21.313042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 231/487] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:12:21 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1810 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:12:21.462634 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6744b554-6375-439f-a400-b11a9e15f4e6 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:21.466647 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6744b554-6375-439f-a400-b11a9e15f4e6 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:21.477453 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6744b554-6375-439f-a400-b11a9e15f4e6 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:21.478042 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6744b554-6375-439f-a400-b11a9e15f4e6 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:21.480656 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6744b554-6375-439f-a400-b11a9e15f4e6 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:21.481091 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6744b554-6375-439f-a400-b11a9e15f4e6 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:21.859537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2435fc1a-2cb0-46e2-87af-92aa4c7e7e4d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:21.860263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2435fc1a-2cb0-46e2-87af-92aa4c7e7e4d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:21.940233 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-6744b554-6375-439f-a400-b11a9e15f4e6 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:21.952993 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6744b554-6375-439f-a400-b11a9e15f4e6 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1319 microversion: 2.1 time: 0.493881 May 10 21:12:21.954659 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 257/488] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:21 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1319 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:21.967196 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2435fc1a-2cb0-46e2-87af-92aa4c7e7e4d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:21.975206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2435fc1a-2cb0-46e2-87af-92aa4c7e7e4d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1087 microversion: 2.1 time: 0.128901 May 10 21:12:21.989721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 232/489] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:21 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1087 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:22.322098 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-fc065236-8cdd-4730-bb39-96a4080ebdd1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:22.322903 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-fc065236-8cdd-4730-bb39-96a4080ebdd1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:22.344279 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fc065236-8cdd-4730-bb39-96a4080ebdd1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:22.345029 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fc065236-8cdd-4730-bb39-96a4080ebdd1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:22.346683 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fc065236-8cdd-4730-bb39-96a4080ebdd1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:22.347342 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fc065236-8cdd-4730-bb39-96a4080ebdd1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:22.581087 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-fc065236-8cdd-4730-bb39-96a4080ebdd1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:22.595032 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-fc065236-8cdd-4730-bb39-96a4080ebdd1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:22.597328 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-fc065236-8cdd-4730-bb39-96a4080ebdd1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:22.599344 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-fc065236-8cdd-4730-bb39-96a4080ebdd1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1810 microversion: 2.20 time: 0.282621 May 10 21:12:22.600161 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 258/490] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:12:22 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1810 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:12:22.736011 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [req-b39b9e1a-d346-4f31-9145-2a00fca3cee7 req-c7bbb6d4-390b-4d73-99f7-8b4f9f6c9701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f2d5e2c-92d8-49db-a14b-34dab8c145e4", "tag": "e59377c8-2364-4bda-918e-6ec687c8b495"}]} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:22.745217 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-b39b9e1a-d346-4f31-9145-2a00fca3cee7 req-c7bbb6d4-390b-4d73-99f7-8b4f9f6c9701 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:22.745817 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-b39b9e1a-d346-4f31-9145-2a00fca3cee7 req-c7bbb6d4-390b-4d73-99f7-8b4f9f6c9701 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:22.758020 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.compute.server_external_events [req-b39b9e1a-d346-4f31-9145-2a00fca3cee7 req-c7bbb6d4-390b-4d73-99f7-8b4f9f6c9701 service nova] Creating event network-changed:e59377c8-2364-4bda-918e-6ec687c8b495 for instance 9f2d5e2c-92d8-49db-a14b-34dab8c145e4 on hv-cinder-82880 May 10 21:12:22.763693 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [req-b39b9e1a-d346-4f31-9145-2a00fca3cee7 req-c7bbb6d4-390b-4d73-99f7-8b4f9f6c9701 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031931 May 10 21:12:22.764293 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 259/491] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:12:22.883007 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dfafdb3a-e5f6-4e90-abee-f46c63a6be03 tempest-TestVolumeBootPattern-1764075483 tempest-TestVolumeBootPattern-1764075483-project] Action: 'create', calling method: .version_select at 0x7f85d5476c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1775997954", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmqzZQ0xeFeQyUfM2DUW2sHonqI3Wr9tNrBbY9cv9zKujS/5r/JC+l4stcdBXW+6SrqEtfMODpssL2ShHRkQn3i8rjzTD9N6EMWOn0tpOAWPaJCVWWcrYI4t6VFTxN9zw=="}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:22.897370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-dfafdb3a-e5f6-4e90-abee-f46c63a6be03 tempest-TestVolumeBootPattern-1764075483 tempest-TestVolumeBootPattern-1764075483-project] Getting quotas for project 07437b61b6dc4f70af85bb413e294295. Resources: {'key_pairs'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:12:22.901100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-dfafdb3a-e5f6-4e90-abee-f46c63a6be03 tempest-TestVolumeBootPattern-1764075483 tempest-TestVolumeBootPattern-1764075483-project] Getting quotas for user 1d97010c72384a4e9714e9630397e0e8 and project 07437b61b6dc4f70af85bb413e294295. Resources: {'key_pairs'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:12:22.972139 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-3b5c4313-0ad5-4454-8807-5ef9069461d4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:22.972951 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-3b5c4313-0ad5-4454-8807-5ef9069461d4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:22.974460 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dfafdb3a-e5f6-4e90-abee-f46c63a6be03 tempest-TestVolumeBootPattern-1764075483 tempest-TestVolumeBootPattern-1764075483-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.271595 May 10 21:12:22.975571 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 233/492] 10.222.0.49 () {60 vars in 1158 bytes} [Tue May 10 21:12:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:12:22.979431 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3b5c4313-0ad5-4454-8807-5ef9069461d4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:22.979879 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3b5c4313-0ad5-4454-8807-5ef9069461d4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:22.980649 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3b5c4313-0ad5-4454-8807-5ef9069461d4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:22.981210 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3b5c4313-0ad5-4454-8807-5ef9069461d4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:23.000749 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d9e7762d-a3f7-45e7-bb5f-aac3c215abbc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:23.000962 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d9e7762d-a3f7-45e7-bb5f-aac3c215abbc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:23.009293 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d9e7762d-a3f7-45e7-bb5f-aac3c215abbc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:23.010021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d9e7762d-a3f7-45e7-bb5f-aac3c215abbc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:23.010971 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d9e7762d-a3f7-45e7-bb5f-aac3c215abbc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:23.011586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d9e7762d-a3f7-45e7-bb5f-aac3c215abbc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:23.078031 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d9e7762d-a3f7-45e7-bb5f-aac3c215abbc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:23.086079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d9e7762d-a3f7-45e7-bb5f-aac3c215abbc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1137 microversion: 2.1 time: 0.091963 May 10 21:12:23.086654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 234/493] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:22 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1137 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:23.162567 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-3b5c4313-0ad5-4454-8807-5ef9069461d4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:23.172953 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-3b5c4313-0ad5-4454-8807-5ef9069461d4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1319 microversion: 2.1 time: 0.205525 May 10 21:12:23.184111 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 260/494] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:22 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:23.617051 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0014e418-faf4-4b81-8f23-b54374b990fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:23.617866 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0014e418-faf4-4b81-8f23-b54374b990fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:23.624199 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0014e418-faf4-4b81-8f23-b54374b990fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:23.624746 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0014e418-faf4-4b81-8f23-b54374b990fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:23.625626 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0014e418-faf4-4b81-8f23-b54374b990fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:23.626141 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0014e418-faf4-4b81-8f23-b54374b990fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:23.760928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0014e418-faf4-4b81-8f23-b54374b990fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:23.770894 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0014e418-faf4-4b81-8f23-b54374b990fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:23.772463 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0014e418-faf4-4b81-8f23-b54374b990fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:23.773628 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0014e418-faf4-4b81-8f23-b54374b990fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1810 microversion: 2.20 time: 0.160547 May 10 21:12:23.774590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 235/495] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:12:23 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:12:24.103310 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-77d52ee3-297c-42b5-ab08-e374a8220620 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:24.103981 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-77d52ee3-297c-42b5-ab08-e374a8220620 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:24.110597 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-77d52ee3-297c-42b5-ab08-e374a8220620 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:24.111051 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-77d52ee3-297c-42b5-ab08-e374a8220620 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:24.113209 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-77d52ee3-297c-42b5-ab08-e374a8220620 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:24.113880 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-77d52ee3-297c-42b5-ab08-e374a8220620 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:24.193083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b5abb353-667e-4048-9c3b-0c3cf2c6b8c7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:24.193733 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b5abb353-667e-4048-9c3b-0c3cf2c6b8c7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:24.201367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5abb353-667e-4048-9c3b-0c3cf2c6b8c7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:24.201976 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5abb353-667e-4048-9c3b-0c3cf2c6b8c7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:24.202807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5abb353-667e-4048-9c3b-0c3cf2c6b8c7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:24.203408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5abb353-667e-4048-9c3b-0c3cf2c6b8c7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:24.230867 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-77d52ee3-297c-42b5-ab08-e374a8220620 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:24.238791 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-77d52ee3-297c-42b5-ab08-e374a8220620 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1193 microversion: 2.1 time: 0.139510 May 10 21:12:24.240015 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 261/496] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:24 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1193 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:24.403174 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b5abb353-667e-4048-9c3b-0c3cf2c6b8c7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:24.417489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b5abb353-667e-4048-9c3b-0c3cf2c6b8c7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1319 microversion: 2.1 time: 0.229029 May 10 21:12:24.418796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 236/497] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:24 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:24.793449 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-8fddc1e8-f6c4-4b58-9d4e-4b0490bed82a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:24.796236 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-8fddc1e8-f6c4-4b58-9d4e-4b0490bed82a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:24.803568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8fddc1e8-f6c4-4b58-9d4e-4b0490bed82a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:24.805376 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8fddc1e8-f6c4-4b58-9d4e-4b0490bed82a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:24.805376 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8fddc1e8-f6c4-4b58-9d4e-4b0490bed82a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:24.805761 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8fddc1e8-f6c4-4b58-9d4e-4b0490bed82a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:24.828478 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-e1842ff3-04d3-4336-9d84-756fec0b01e0 req-1cbb3516-83a6-4702-b1d6-60c8fa3d6791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688d836a-358b-4815-80e9-f43bd14f5f93", "name": "network-vif-plugged", "status": "completed", "tag": "8d78546f-3c5c-4f44-9d56-4eb5e6c1e96f"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:24.833642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-e1842ff3-04d3-4336-9d84-756fec0b01e0 req-1cbb3516-83a6-4702-b1d6-60c8fa3d6791 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:24.834353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-e1842ff3-04d3-4336-9d84-756fec0b01e0 req-1cbb3516-83a6-4702-b1d6-60c8fa3d6791 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:24.847357 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-e1842ff3-04d3-4336-9d84-756fec0b01e0 req-1cbb3516-83a6-4702-b1d6-60c8fa3d6791 service nova] Creating event network-vif-plugged:8d78546f-3c5c-4f44-9d56-4eb5e6c1e96f for instance 688d836a-358b-4815-80e9-f43bd14f5f93 on hv-cinder-82880 May 10 21:12:24.855188 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-e1842ff3-04d3-4336-9d84-756fec0b01e0 req-1cbb3516-83a6-4702-b1d6-60c8fa3d6791 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033511 May 10 21:12:24.875577 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 237/498] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:12:25.071486 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-8fddc1e8-f6c4-4b58-9d4e-4b0490bed82a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:25.082866 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-8fddc1e8-f6c4-4b58-9d4e-4b0490bed82a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:25.084747 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-8fddc1e8-f6c4-4b58-9d4e-4b0490bed82a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:25.085930 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-8fddc1e8-f6c4-4b58-9d4e-4b0490bed82a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1810 microversion: 2.20 time: 0.296461 May 10 21:12:25.087867 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 262/499] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:12:24 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1810 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:12:25.258238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e56a8407-f830-4451-9b77-7565dccc20b2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:25.259570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e56a8407-f830-4451-9b77-7565dccc20b2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:25.273348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e56a8407-f830-4451-9b77-7565dccc20b2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:25.273876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e56a8407-f830-4451-9b77-7565dccc20b2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:25.275302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e56a8407-f830-4451-9b77-7565dccc20b2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:25.275752 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e56a8407-f830-4451-9b77-7565dccc20b2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:25.441795 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6646f540-d636-4443-a649-e2144516f9f5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:25.445692 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6646f540-d636-4443-a649-e2144516f9f5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:25.467501 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6646f540-d636-4443-a649-e2144516f9f5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:25.467949 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6646f540-d636-4443-a649-e2144516f9f5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:25.468796 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6646f540-d636-4443-a649-e2144516f9f5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:25.469235 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6646f540-d636-4443-a649-e2144516f9f5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:25.571030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e56a8407-f830-4451-9b77-7565dccc20b2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:25.583022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e56a8407-f830-4451-9b77-7565dccc20b2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1271 microversion: 2.1 time: 0.330843 May 10 21:12:25.583659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 238/500] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:25 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1271 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:25.747618 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-6646f540-d636-4443-a649-e2144516f9f5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:25.756123 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6646f540-d636-4443-a649-e2144516f9f5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1319 microversion: 2.1 time: 0.324687 May 10 21:12:25.757009 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 263/501] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:25 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:26.109333 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-552707d7-2bc4-4ad7-a028-87ed5316164f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:26.109965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-552707d7-2bc4-4ad7-a028-87ed5316164f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:26.132664 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-552707d7-2bc4-4ad7-a028-87ed5316164f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:26.134486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-552707d7-2bc4-4ad7-a028-87ed5316164f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:26.135559 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-552707d7-2bc4-4ad7-a028-87ed5316164f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:26.138967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-552707d7-2bc4-4ad7-a028-87ed5316164f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:26.364497 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-552707d7-2bc4-4ad7-a028-87ed5316164f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:26.376014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-552707d7-2bc4-4ad7-a028-87ed5316164f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:26.380905 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-552707d7-2bc4-4ad7-a028-87ed5316164f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:26.382424 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-552707d7-2bc4-4ad7-a028-87ed5316164f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1810 microversion: 2.20 time: 0.281113 May 10 21:12:26.383751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 239/502] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:12:26 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1810 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:12:26.432344 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [req-faa29253-cfce-4f7f-ac0b-f991fcc7d252 req-6e475162-0021-42b0-9619-189a689a27a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c7c73d-54f3-4695-87bc-4c9d22d5652f", "tag": "b751e302-b05a-4d37-b886-85ba68540b75"}]} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:26.445262 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-faa29253-cfce-4f7f-ac0b-f991fcc7d252 req-6e475162-0021-42b0-9619-189a689a27a7 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:26.445874 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-faa29253-cfce-4f7f-ac0b-f991fcc7d252 req-6e475162-0021-42b0-9619-189a689a27a7 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:26.486017 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.compute.server_external_events [req-faa29253-cfce-4f7f-ac0b-f991fcc7d252 req-6e475162-0021-42b0-9619-189a689a27a7 service nova] Creating event network-changed:b751e302-b05a-4d37-b886-85ba68540b75 for instance d4c7c73d-54f3-4695-87bc-4c9d22d5652f on hv-cinder-82880 May 10 21:12:26.492908 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [req-faa29253-cfce-4f7f-ac0b-f991fcc7d252 req-6e475162-0021-42b0-9619-189a689a27a7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064196 May 10 21:12:26.493898 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 264/503] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:12:26.610744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c21932f6-a0f3-489a-8fc3-0f0132e2e738 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:26.611312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c21932f6-a0f3-489a-8fc3-0f0132e2e738 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:26.635649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c21932f6-a0f3-489a-8fc3-0f0132e2e738 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:26.636383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c21932f6-a0f3-489a-8fc3-0f0132e2e738 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:26.637379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c21932f6-a0f3-489a-8fc3-0f0132e2e738 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:26.638008 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c21932f6-a0f3-489a-8fc3-0f0132e2e738 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:26.775324 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-ef72c039-c892-4c42-8130-e99c91b94675 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:26.776324 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-ef72c039-c892-4c42-8130-e99c91b94675 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:26.783350 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ef72c039-c892-4c42-8130-e99c91b94675 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:26.784492 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ef72c039-c892-4c42-8130-e99c91b94675 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:26.785661 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ef72c039-c892-4c42-8130-e99c91b94675 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:26.786308 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ef72c039-c892-4c42-8130-e99c91b94675 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:26.820000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c21932f6-a0f3-489a-8fc3-0f0132e2e738 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:26.830610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c21932f6-a0f3-489a-8fc3-0f0132e2e738 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.224179 May 10 21:12:26.831957 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 240/504] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:26 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:27.013307 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-ef72c039-c892-4c42-8130-e99c91b94675 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:27.022779 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-ef72c039-c892-4c42-8130-e99c91b94675 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1319 microversion: 2.1 time: 0.251419 May 10 21:12:27.032645 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 265/505] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:26 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:27.210604 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-4f32e882-0c8a-4a8c-a8ea-08b0b1d27c8f req-da17a347-350d-4882-ba8b-53f16ad03a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f2d5e2c-92d8-49db-a14b-34dab8c145e4", "name": "network-vif-plugged", "status": "completed", "tag": "e59377c8-2364-4bda-918e-6ec687c8b495"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:27.220075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-4f32e882-0c8a-4a8c-a8ea-08b0b1d27c8f req-da17a347-350d-4882-ba8b-53f16ad03a5d service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:27.220475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-4f32e882-0c8a-4a8c-a8ea-08b0b1d27c8f req-da17a347-350d-4882-ba8b-53f16ad03a5d service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:27.231704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-4f32e882-0c8a-4a8c-a8ea-08b0b1d27c8f req-da17a347-350d-4882-ba8b-53f16ad03a5d service nova] Creating event network-vif-plugged:e59377c8-2364-4bda-918e-6ec687c8b495 for instance 9f2d5e2c-92d8-49db-a14b-34dab8c145e4 on hv-cinder-82880 May 10 21:12:27.236483 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-4f32e882-0c8a-4a8c-a8ea-08b0b1d27c8f req-da17a347-350d-4882-ba8b-53f16ad03a5d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029643 May 10 21:12:27.237930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 241/506] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:12:27.401687 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-045482b6-fbfa-49ff-af2b-2fb4b35dce30 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:27.402305 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-045482b6-fbfa-49ff-af2b-2fb4b35dce30 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:27.410115 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-045482b6-fbfa-49ff-af2b-2fb4b35dce30 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:27.410764 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-045482b6-fbfa-49ff-af2b-2fb4b35dce30 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:27.412003 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-045482b6-fbfa-49ff-af2b-2fb4b35dce30 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:27.412749 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-045482b6-fbfa-49ff-af2b-2fb4b35dce30 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:27.689255 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-045482b6-fbfa-49ff-af2b-2fb4b35dce30 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:27.702864 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-045482b6-fbfa-49ff-af2b-2fb4b35dce30 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:27.704492 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-045482b6-fbfa-49ff-af2b-2fb4b35dce30 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:27.706685 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-045482b6-fbfa-49ff-af2b-2fb4b35dce30 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1810 microversion: 2.20 time: 0.309232 May 10 21:12:27.707735 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 266/507] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:12:27 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1810 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:12:27.853763 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-424a18b4-3fa2-469f-8cb5-4ede99c5f086 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:27.855421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-424a18b4-3fa2-469f-8cb5-4ede99c5f086 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:27.868694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-424a18b4-3fa2-469f-8cb5-4ede99c5f086 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:27.869232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-424a18b4-3fa2-469f-8cb5-4ede99c5f086 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:27.870085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-424a18b4-3fa2-469f-8cb5-4ede99c5f086 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:27.870517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-424a18b4-3fa2-469f-8cb5-4ede99c5f086 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:28.041029 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-1b16f537-f57d-441d-ae16-a581ecedfc2d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:28.041923 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-1b16f537-f57d-441d-ae16-a581ecedfc2d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:28.048979 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1b16f537-f57d-441d-ae16-a581ecedfc2d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:28.050326 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1b16f537-f57d-441d-ae16-a581ecedfc2d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:28.051329 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1b16f537-f57d-441d-ae16-a581ecedfc2d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:28.051903 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1b16f537-f57d-441d-ae16-a581ecedfc2d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:28.079966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-424a18b4-3fa2-469f-8cb5-4ede99c5f086 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:28.090225 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-424a18b4-3fa2-469f-8cb5-4ede99c5f086 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.240608 May 10 21:12:28.092751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 242/508] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:27 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:28.519526 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-1b16f537-f57d-441d-ae16-a581ecedfc2d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:28.527515 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-1b16f537-f57d-441d-ae16-a581ecedfc2d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1319 microversion: 2.1 time: 0.491815 May 10 21:12:28.528567 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 267/509] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:28 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1319 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:28.725683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7c3aae7a-917e-45d1-b483-a40b49be8f89 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:28.726382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7c3aae7a-917e-45d1-b483-a40b49be8f89 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:28.732563 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c3aae7a-917e-45d1-b483-a40b49be8f89 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:28.733075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c3aae7a-917e-45d1-b483-a40b49be8f89 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:28.733859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c3aae7a-917e-45d1-b483-a40b49be8f89 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:28.734298 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c3aae7a-917e-45d1-b483-a40b49be8f89 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:28.892425 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7c3aae7a-917e-45d1-b483-a40b49be8f89 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:28.902238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7c3aae7a-917e-45d1-b483-a40b49be8f89 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:28.904006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7c3aae7a-917e-45d1-b483-a40b49be8f89 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:28.905270 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7c3aae7a-917e-45d1-b483-a40b49be8f89 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1810 microversion: 2.20 time: 0.184322 May 10 21:12:28.906414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 243/510] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:12:28 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1810 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:12:29.111242 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-ba003969-d6b6-4850-894e-eb442ec16533 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:29.112943 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-ba003969-d6b6-4850-894e-eb442ec16533 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:29.119169 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ba003969-d6b6-4850-894e-eb442ec16533 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:29.119628 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ba003969-d6b6-4850-894e-eb442ec16533 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:29.120411 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ba003969-d6b6-4850-894e-eb442ec16533 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:29.120848 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ba003969-d6b6-4850-894e-eb442ec16533 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:29.279996 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-ba003969-d6b6-4850-894e-eb442ec16533 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:29.289392 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-ba003969-d6b6-4850-894e-eb442ec16533 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.181976 May 10 21:12:29.290096 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 268/511] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:29 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:29.544868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5ba68188-0bbd-46a1-88af-cee2e70baa16 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:29.545543 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5ba68188-0bbd-46a1-88af-cee2e70baa16 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:29.552302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ba68188-0bbd-46a1-88af-cee2e70baa16 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:29.552885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ba68188-0bbd-46a1-88af-cee2e70baa16 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:29.553736 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ba68188-0bbd-46a1-88af-cee2e70baa16 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:29.554179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ba68188-0bbd-46a1-88af-cee2e70baa16 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:29.688946 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5ba68188-0bbd-46a1-88af-cee2e70baa16 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:29.697525 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5ba68188-0bbd-46a1-88af-cee2e70baa16 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1319 microversion: 2.1 time: 0.156859 May 10 21:12:29.698325 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 244/512] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:29 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:29.870835 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-71c8732b-21d1-44ca-bbc0-e64b508c73bd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:29.871367 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-71c8732b-21d1-44ca-bbc0-e64b508c73bd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:29.879233 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-71c8732b-21d1-44ca-bbc0-e64b508c73bd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:29.879693 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-71c8732b-21d1-44ca-bbc0-e64b508c73bd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:29.880466 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-71c8732b-21d1-44ca-bbc0-e64b508c73bd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:29.880946 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-71c8732b-21d1-44ca-bbc0-e64b508c73bd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:29.924499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c4a25eb4-94d2-487d-a3f5-088b74070893 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:29.925033 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c4a25eb4-94d2-487d-a3f5-088b74070893 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:29.931391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4a25eb4-94d2-487d-a3f5-088b74070893 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:29.931838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4a25eb4-94d2-487d-a3f5-088b74070893 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:29.932748 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4a25eb4-94d2-487d-a3f5-088b74070893 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:29.933177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4a25eb4-94d2-487d-a3f5-088b74070893 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:29.970543 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.objects.instance [None req-71c8732b-21d1-44ca-bbc0-e64b508c73bd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lazy-loading 'services' on Instance uuid 504464a5-03e5-42af-a2f3-ca210277d932 {{(pid=117713) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:12:30.072837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c4a25eb4-94d2-487d-a3f5-088b74070893 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:30.081422 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c4a25eb4-94d2-487d-a3f5-088b74070893 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:30.083514 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c4a25eb4-94d2-487d-a3f5-088b74070893 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:30.090641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c4a25eb4-94d2-487d-a3f5-088b74070893 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1797 microversion: 2.20 time: 0.164392 May 10 21:12:30.090641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 245/513] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:12:29 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1797 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:12:30.212354 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-71c8732b-21d1-44ca-bbc0-e64b508c73bd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "DELETE /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932/os-volume_attachments/e14853cf-d569-45eb-86dd-4ed81c516b00" status: 202 len: 0 microversion: 2.1 time: 0.345322 May 10 21:12:30.212949 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 269/514] 10.222.0.49 () {58 vars in 1415 bytes} [Tue May 10 21:12:29 2022] DELETE /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932/os-volume_attachments/e14853cf-d569-45eb-86dd-4ed81c516b00 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:12:30.307759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-caa43eb8-8c2f-42c2-b473-523cec622a00 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:30.308384 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-caa43eb8-8c2f-42c2-b473-523cec622a00 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:30.325548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-caa43eb8-8c2f-42c2-b473-523cec622a00 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:30.326617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-caa43eb8-8c2f-42c2-b473-523cec622a00 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:30.327510 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-caa43eb8-8c2f-42c2-b473-523cec622a00 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:30.328006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-caa43eb8-8c2f-42c2-b473-523cec622a00 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:30.488557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-caa43eb8-8c2f-42c2-b473-523cec622a00 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:30.496909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-caa43eb8-8c2f-42c2-b473-523cec622a00 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.193044 May 10 21:12:30.497490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 246/515] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:30 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:30.717969 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-4212be48-4a54-4e9f-80d8-661280304a61 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:30.717969 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-4212be48-4a54-4e9f-80d8-661280304a61 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:30.725235 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4212be48-4a54-4e9f-80d8-661280304a61 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:30.725863 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4212be48-4a54-4e9f-80d8-661280304a61 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:30.727004 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4212be48-4a54-4e9f-80d8-661280304a61 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:30.727569 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4212be48-4a54-4e9f-80d8-661280304a61 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:30.861594 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-4212be48-4a54-4e9f-80d8-661280304a61 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:30.868829 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-4212be48-4a54-4e9f-80d8-661280304a61 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1509 microversion: 2.1 time: 0.157114 May 10 21:12:30.869389 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 270/516] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:30 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:30.888638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-27762760-cb10-4e4a-89ab-7f78451c9b69 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "306cf20f-4c05-45ed-92dc-61af3b32943e", "device": "/dev/sdb"}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:30.890319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-27762760-cb10-4e4a-89ab-7f78451c9b69 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:30.896902 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27762760-cb10-4e4a-89ab-7f78451c9b69 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:30.897347 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27762760-cb10-4e4a-89ab-7f78451c9b69 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:30.898106 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27762760-cb10-4e4a-89ab-7f78451c9b69 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:30.898534 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27762760-cb10-4e4a-89ab-7f78451c9b69 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:31.515679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-46c40502-2e15-405a-8803-eff88cf96f96 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:31.516420 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-46c40502-2e15-405a-8803-eff88cf96f96 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:31.523824 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-46c40502-2e15-405a-8803-eff88cf96f96 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:31.524276 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-46c40502-2e15-405a-8803-eff88cf96f96 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:31.525047 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-46c40502-2e15-405a-8803-eff88cf96f96 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:31.525486 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-46c40502-2e15-405a-8803-eff88cf96f96 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:31.615851 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-27762760-cb10-4e4a-89ab-7f78451c9b69 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "POST /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.730885 May 10 21:12:31.617681 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 247/517] 10.222.0.49 () {60 vars in 1322 bytes} [Tue May 10 21:12:30 2022] POST /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4/os-volume_attachments => generated 194 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:12:31.660773 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-46c40502-2e15-405a-8803-eff88cf96f96 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:31.668996 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-46c40502-2e15-405a-8803-eff88cf96f96 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.157853 May 10 21:12:31.669618 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 271/518] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:31 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:32.387706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ea826a75-f65b-4023-8b1a-971024bceae9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:32.394415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ea826a75-f65b-4023-8b1a-971024bceae9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:32.394869 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ea826a75-f65b-4023-8b1a-971024bceae9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:32.418979 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ea826a75-f65b-4023-8b1a-971024bceae9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Going to try to stop instance {{(pid=117714) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 21:12:32.587013 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ea826a75-f65b-4023-8b1a-971024bceae9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "POST /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932/action" status: 202 len: 0 microversion: 2.1 time: 0.203898 May 10 21:12:32.587708 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 248/519] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 21:12:32 2022] POST /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:12:32.595883 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a27e07fa-6538-4b40-96cb-23240ccc01c4 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:32.597648 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a27e07fa-6538-4b40-96cb-23240ccc01c4 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:32.604137 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a27e07fa-6538-4b40-96cb-23240ccc01c4 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:32.604654 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a27e07fa-6538-4b40-96cb-23240ccc01c4 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:32.605537 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a27e07fa-6538-4b40-96cb-23240ccc01c4 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:32.606039 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a27e07fa-6538-4b40-96cb-23240ccc01c4 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:32.689421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-458771b4-a6db-4d26-9462-4d1bf17fccb5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:32.690990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-458771b4-a6db-4d26-9462-4d1bf17fccb5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:32.697679 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-458771b4-a6db-4d26-9462-4d1bf17fccb5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:32.698282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-458771b4-a6db-4d26-9462-4d1bf17fccb5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:32.698912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-458771b4-a6db-4d26-9462-4d1bf17fccb5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:32.699729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-458771b4-a6db-4d26-9462-4d1bf17fccb5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:32.753782 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-a27e07fa-6538-4b40-96cb-23240ccc01c4 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:32.765348 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a27e07fa-6538-4b40-96cb-23240ccc01c4 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.173429 May 10 21:12:32.768711 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 272/520] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:32 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:32.850313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-458771b4-a6db-4d26-9462-4d1bf17fccb5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:32.857778 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-458771b4-a6db-4d26-9462-4d1bf17fccb5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.175054 May 10 21:12:32.858383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 249/521] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:32 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:33.790983 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-475b25e6-6a1c-4453-8d28-5823c81b61f8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:33.791751 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-475b25e6-6a1c-4453-8d28-5823c81b61f8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:33.798097 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-475b25e6-6a1c-4453-8d28-5823c81b61f8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:33.798551 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-475b25e6-6a1c-4453-8d28-5823c81b61f8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:33.799360 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-475b25e6-6a1c-4453-8d28-5823c81b61f8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:33.799802 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-475b25e6-6a1c-4453-8d28-5823c81b61f8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:33.875013 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3d5de579-55c6-498a-b192-dd465897a66c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:33.875568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3d5de579-55c6-498a-b192-dd465897a66c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:33.882631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d5de579-55c6-498a-b192-dd465897a66c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:33.883081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d5de579-55c6-498a-b192-dd465897a66c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:33.883903 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d5de579-55c6-498a-b192-dd465897a66c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:33.891809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d5de579-55c6-498a-b192-dd465897a66c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:33.931796 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-475b25e6-6a1c-4453-8d28-5823c81b61f8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:33.939734 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-475b25e6-6a1c-4453-8d28-5823c81b61f8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.158874 May 10 21:12:33.940295 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 273/522] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:33 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:34.022003 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3d5de579-55c6-498a-b192-dd465897a66c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:34.029461 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3d5de579-55c6-498a-b192-dd465897a66c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.158466 May 10 21:12:34.030065 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 250/523] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:33 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:34.958208 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-43d685a0-44fa-474a-88bd-62c55c03ea7a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:34.958923 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-43d685a0-44fa-474a-88bd-62c55c03ea7a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:34.965458 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-43d685a0-44fa-474a-88bd-62c55c03ea7a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:34.965901 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-43d685a0-44fa-474a-88bd-62c55c03ea7a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:34.966768 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-43d685a0-44fa-474a-88bd-62c55c03ea7a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:34.967231 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-43d685a0-44fa-474a-88bd-62c55c03ea7a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:35.046416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-245ae418-b6f7-4367-9995-3b5a02119adc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:35.046984 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-245ae418-b6f7-4367-9995-3b5a02119adc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:35.054170 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-245ae418-b6f7-4367-9995-3b5a02119adc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:35.054624 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-245ae418-b6f7-4367-9995-3b5a02119adc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:35.055429 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-245ae418-b6f7-4367-9995-3b5a02119adc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:35.055871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-245ae418-b6f7-4367-9995-3b5a02119adc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:35.102975 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-43d685a0-44fa-474a-88bd-62c55c03ea7a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:35.110456 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-43d685a0-44fa-474a-88bd-62c55c03ea7a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.156443 May 10 21:12:35.111027 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 274/524] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:34 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:35.192380 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-245ae418-b6f7-4367-9995-3b5a02119adc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:35.199722 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-245ae418-b6f7-4367-9995-3b5a02119adc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.157341 May 10 21:12:35.200294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 251/525] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:35 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:35.254524 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-47413fc4-b9d1-4c5c-87f6-9465128dff21 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b1f159c-b02f-49b7-bcdc-8267b5586104"}} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:35.255692 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-47413fc4-b9d1-4c5c-87f6-9465128dff21 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:35.261686 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-47413fc4-b9d1-4c5c-87f6-9465128dff21 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:35.262141 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-47413fc4-b9d1-4c5c-87f6-9465128dff21 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:35.262914 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-47413fc4-b9d1-4c5c-87f6-9465128dff21 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:35.263387 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-47413fc4-b9d1-4c5c-87f6-9465128dff21 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:36.126425 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-47413fc4-b9d1-4c5c-87f6-9465128dff21 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "POST /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.875220 May 10 21:12:36.127292 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 275/526] 10.222.0.49 () {60 vars in 1322 bytes} [Tue May 10 21:12:35 2022] POST /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 194 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:12:36.131621 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-67218973-0510-4bd8-ac59-f092fbea6952 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:36.132084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-67218973-0510-4bd8-ac59-f092fbea6952 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:36.138460 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-67218973-0510-4bd8-ac59-f092fbea6952 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:36.138899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-67218973-0510-4bd8-ac59-f092fbea6952 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:36.139673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-67218973-0510-4bd8-ac59-f092fbea6952 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:36.140196 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-67218973-0510-4bd8-ac59-f092fbea6952 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:36.217890 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-dd36b768-1817-4f64-9689-80a290773e58 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:36.217890 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-dd36b768-1817-4f64-9689-80a290773e58 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:36.224749 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-dd36b768-1817-4f64-9689-80a290773e58 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:36.225194 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-dd36b768-1817-4f64-9689-80a290773e58 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:36.226144 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-dd36b768-1817-4f64-9689-80a290773e58 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:36.226578 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-dd36b768-1817-4f64-9689-80a290773e58 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:36.271484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-67218973-0510-4bd8-ac59-f092fbea6952 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:36.278906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-67218973-0510-4bd8-ac59-f092fbea6952 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.153497 May 10 21:12:36.279572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 252/527] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:36 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:36.368886 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-dd36b768-1817-4f64-9689-80a290773e58 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:36.376250 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-dd36b768-1817-4f64-9689-80a290773e58 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.163371 May 10 21:12:36.376869 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 276/528] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:36 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:37.297014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5bb45fb4-eb53-49d4-bb79-a0a9b93519c9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:37.297627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5bb45fb4-eb53-49d4-bb79-a0a9b93519c9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:37.304942 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5bb45fb4-eb53-49d4-bb79-a0a9b93519c9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:37.305385 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5bb45fb4-eb53-49d4-bb79-a0a9b93519c9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:37.306147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5bb45fb4-eb53-49d4-bb79-a0a9b93519c9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:37.306579 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5bb45fb4-eb53-49d4-bb79-a0a9b93519c9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:37.394172 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-736db1ca-0ec8-44b8-b482-285c5db60768 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:37.395241 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-736db1ca-0ec8-44b8-b482-285c5db60768 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:37.402376 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-736db1ca-0ec8-44b8-b482-285c5db60768 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:37.402991 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-736db1ca-0ec8-44b8-b482-285c5db60768 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:37.403940 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-736db1ca-0ec8-44b8-b482-285c5db60768 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:37.404397 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-736db1ca-0ec8-44b8-b482-285c5db60768 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:37.437651 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5bb45fb4-eb53-49d4-bb79-a0a9b93519c9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:37.445604 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5bb45fb4-eb53-49d4-bb79-a0a9b93519c9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.152344 May 10 21:12:37.446110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 253/529] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:37 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:37.535951 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-736db1ca-0ec8-44b8-b482-285c5db60768 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:37.543145 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-736db1ca-0ec8-44b8-b482-285c5db60768 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.152773 May 10 21:12:37.543700 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 277/530] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:37 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:38.464143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d150fd2f-8556-405d-88ea-cf071a60dc18 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:38.464744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d150fd2f-8556-405d-88ea-cf071a60dc18 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:38.471162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d150fd2f-8556-405d-88ea-cf071a60dc18 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:38.471618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d150fd2f-8556-405d-88ea-cf071a60dc18 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:38.472386 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d150fd2f-8556-405d-88ea-cf071a60dc18 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:38.473927 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d150fd2f-8556-405d-88ea-cf071a60dc18 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:38.561491 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-bd9b3945-81d1-46e0-a013-d34d57a8170d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:38.562562 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-bd9b3945-81d1-46e0-a013-d34d57a8170d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:38.569856 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bd9b3945-81d1-46e0-a013-d34d57a8170d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:38.570557 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bd9b3945-81d1-46e0-a013-d34d57a8170d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:38.571387 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bd9b3945-81d1-46e0-a013-d34d57a8170d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:38.571836 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bd9b3945-81d1-46e0-a013-d34d57a8170d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:38.616738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d150fd2f-8556-405d-88ea-cf071a60dc18 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:38.634064 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d150fd2f-8556-405d-88ea-cf071a60dc18 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.171957 May 10 21:12:38.634995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 254/531] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:38 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:38.730830 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-bd9b3945-81d1-46e0-a013-d34d57a8170d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:38.738649 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-bd9b3945-81d1-46e0-a013-d34d57a8170d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.181668 May 10 21:12:38.739350 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 278/532] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:38 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:39.651109 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b2750c2a-6c3b-4554-b89b-70a361c06c11 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:39.651741 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b2750c2a-6c3b-4554-b89b-70a361c06c11 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:39.658062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b2750c2a-6c3b-4554-b89b-70a361c06c11 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:39.658506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b2750c2a-6c3b-4554-b89b-70a361c06c11 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:39.659299 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b2750c2a-6c3b-4554-b89b-70a361c06c11 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:39.659730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b2750c2a-6c3b-4554-b89b-70a361c06c11 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:39.756196 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c21f7f76-998a-491d-8844-ed743de5c3c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:39.756810 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c21f7f76-998a-491d-8844-ed743de5c3c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:39.762944 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c21f7f76-998a-491d-8844-ed743de5c3c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:39.763414 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c21f7f76-998a-491d-8844-ed743de5c3c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:39.764176 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c21f7f76-998a-491d-8844-ed743de5c3c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:39.764611 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c21f7f76-998a-491d-8844-ed743de5c3c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:39.801345 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b2750c2a-6c3b-4554-b89b-70a361c06c11 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:39.809065 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b2750c2a-6c3b-4554-b89b-70a361c06c11 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.161837 May 10 21:12:39.809979 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 255/533] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:39 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:39.896783 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-c21f7f76-998a-491d-8844-ed743de5c3c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:39.904158 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c21f7f76-998a-491d-8844-ed743de5c3c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.151875 May 10 21:12:39.904732 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 279/534] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:39 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:40.709038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-323e598d-ce45-44f2-837f-b564dbb5b284 req-1b4a22fc-f60e-4b33-93c9-06adfc00da80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4c7c73d-54f3-4695-87bc-4c9d22d5652f", "name": "network-vif-plugged", "status": "completed", "tag": "b751e302-b05a-4d37-b886-85ba68540b75"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:12:40.715467 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-323e598d-ce45-44f2-837f-b564dbb5b284 req-1b4a22fc-f60e-4b33-93c9-06adfc00da80 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:40.715907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-323e598d-ce45-44f2-837f-b564dbb5b284 req-1b4a22fc-f60e-4b33-93c9-06adfc00da80 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:40.726499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-323e598d-ce45-44f2-837f-b564dbb5b284 req-1b4a22fc-f60e-4b33-93c9-06adfc00da80 service nova] Creating event network-vif-plugged:b751e302-b05a-4d37-b886-85ba68540b75 for instance d4c7c73d-54f3-4695-87bc-4c9d22d5652f on hv-cinder-82880 May 10 21:12:40.732008 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-323e598d-ce45-44f2-837f-b564dbb5b284 req-1b4a22fc-f60e-4b33-93c9-06adfc00da80 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028409 May 10 21:12:40.732008 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 256/535] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:12:40.826308 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f1105e32-7f67-42b2-9af5-67f13f47c84c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:40.827055 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f1105e32-7f67-42b2-9af5-67f13f47c84c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:40.835698 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f1105e32-7f67-42b2-9af5-67f13f47c84c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:40.836207 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f1105e32-7f67-42b2-9af5-67f13f47c84c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:40.837133 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f1105e32-7f67-42b2-9af5-67f13f47c84c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:40.837563 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f1105e32-7f67-42b2-9af5-67f13f47c84c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:40.922141 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-caf3d400-b017-4ea8-8432-d74f4685fa62 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:40.923405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-caf3d400-b017-4ea8-8432-d74f4685fa62 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:40.930209 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-caf3d400-b017-4ea8-8432-d74f4685fa62 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:40.930889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-caf3d400-b017-4ea8-8432-d74f4685fa62 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:40.931867 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-caf3d400-b017-4ea8-8432-d74f4685fa62 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:40.932463 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-caf3d400-b017-4ea8-8432-d74f4685fa62 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:40.971669 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-f1105e32-7f67-42b2-9af5-67f13f47c84c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:40.980054 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f1105e32-7f67-42b2-9af5-67f13f47c84c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.158106 May 10 21:12:40.981417 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 280/536] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:40 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:41.073407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-caf3d400-b017-4ea8-8432-d74f4685fa62 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:41.080788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-caf3d400-b017-4ea8-8432-d74f4685fa62 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.162855 May 10 21:12:41.081373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 257/537] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:40 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:41.997498 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-0417f993-163a-487a-8ce4-f6dc76ae756e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:41.998115 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-0417f993-163a-487a-8ce4-f6dc76ae756e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:42.005137 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0417f993-163a-487a-8ce4-f6dc76ae756e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:42.005590 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0417f993-163a-487a-8ce4-f6dc76ae756e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:42.006359 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0417f993-163a-487a-8ce4-f6dc76ae756e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:42.006803 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0417f993-163a-487a-8ce4-f6dc76ae756e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:42.097511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d4454cb3-a139-4eb8-9d81-2005241f8276 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:42.098235 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d4454cb3-a139-4eb8-9d81-2005241f8276 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:42.104398 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d4454cb3-a139-4eb8-9d81-2005241f8276 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:42.104858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d4454cb3-a139-4eb8-9d81-2005241f8276 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:42.105641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d4454cb3-a139-4eb8-9d81-2005241f8276 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:42.106079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d4454cb3-a139-4eb8-9d81-2005241f8276 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:42.139140 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-0417f993-163a-487a-8ce4-f6dc76ae756e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:42.146990 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-0417f993-163a-487a-8ce4-f6dc76ae756e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.153325 May 10 21:12:42.147690 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 281/538] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:41 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:42.235965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d4454cb3-a139-4eb8-9d81-2005241f8276 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:42.243216 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d4454cb3-a139-4eb8-9d81-2005241f8276 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.149453 May 10 21:12:42.243786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 258/539] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:42 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:43.164574 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c1b3f2ff-ca8b-49b7-9305-8b651657d006 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:43.165124 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c1b3f2ff-ca8b-49b7-9305-8b651657d006 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:43.171529 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c1b3f2ff-ca8b-49b7-9305-8b651657d006 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:43.171981 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c1b3f2ff-ca8b-49b7-9305-8b651657d006 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:43.172743 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c1b3f2ff-ca8b-49b7-9305-8b651657d006 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:43.173182 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c1b3f2ff-ca8b-49b7-9305-8b651657d006 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:43.259286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2bcb6892-0df0-42f8-909d-39d7a7f9d3cd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:43.259905 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2bcb6892-0df0-42f8-909d-39d7a7f9d3cd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:43.266204 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2bcb6892-0df0-42f8-909d-39d7a7f9d3cd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:43.266654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2bcb6892-0df0-42f8-909d-39d7a7f9d3cd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:43.267539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2bcb6892-0df0-42f8-909d-39d7a7f9d3cd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:43.267978 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2bcb6892-0df0-42f8-909d-39d7a7f9d3cd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:43.298631 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-c1b3f2ff-ca8b-49b7-9305-8b651657d006 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:43.306636 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c1b3f2ff-ca8b-49b7-9305-8b651657d006 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.146523 May 10 21:12:43.307222 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 282/540] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:43 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:43.396298 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2bcb6892-0df0-42f8-909d-39d7a7f9d3cd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:43.403514 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2bcb6892-0df0-42f8-909d-39d7a7f9d3cd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.148029 May 10 21:12:43.404107 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 259/541] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:43 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:44.323564 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-110c7400-d870-40bf-96f4-ca860771f1c3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:44.324262 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-110c7400-d870-40bf-96f4-ca860771f1c3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:44.330621 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-110c7400-d870-40bf-96f4-ca860771f1c3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:44.331142 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-110c7400-d870-40bf-96f4-ca860771f1c3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:44.331956 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-110c7400-d870-40bf-96f4-ca860771f1c3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:44.332444 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-110c7400-d870-40bf-96f4-ca860771f1c3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:44.421139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b2bf9c99-03d0-4627-ba0d-73c66448ffe7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:44.421963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b2bf9c99-03d0-4627-ba0d-73c66448ffe7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:44.429033 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b2bf9c99-03d0-4627-ba0d-73c66448ffe7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:44.429519 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b2bf9c99-03d0-4627-ba0d-73c66448ffe7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:44.432678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b2bf9c99-03d0-4627-ba0d-73c66448ffe7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:44.432678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b2bf9c99-03d0-4627-ba0d-73c66448ffe7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:44.464379 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-110c7400-d870-40bf-96f4-ca860771f1c3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:44.471922 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-110c7400-d870-40bf-96f4-ca860771f1c3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.152406 May 10 21:12:44.472485 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 283/542] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:44 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:44.568939 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b2bf9c99-03d0-4627-ba0d-73c66448ffe7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:44.576426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b2bf9c99-03d0-4627-ba0d-73c66448ffe7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.159244 May 10 21:12:44.577124 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 260/543] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:44 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:45.489187 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-7e8aa956-3893-465b-a8d3-ca2b575ffff5 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:45.489838 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-7e8aa956-3893-465b-a8d3-ca2b575ffff5 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:45.496170 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7e8aa956-3893-465b-a8d3-ca2b575ffff5 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:45.496621 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7e8aa956-3893-465b-a8d3-ca2b575ffff5 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:45.497382 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7e8aa956-3893-465b-a8d3-ca2b575ffff5 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:45.497820 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7e8aa956-3893-465b-a8d3-ca2b575ffff5 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:45.593237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7b1f25d3-d15d-47c9-83ff-b02bdc3270a0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:45.594023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7b1f25d3-d15d-47c9-83ff-b02bdc3270a0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:45.601296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b1f25d3-d15d-47c9-83ff-b02bdc3270a0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:45.601833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b1f25d3-d15d-47c9-83ff-b02bdc3270a0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:45.602703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b1f25d3-d15d-47c9-83ff-b02bdc3270a0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:45.603237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b1f25d3-d15d-47c9-83ff-b02bdc3270a0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:45.623977 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-7e8aa956-3893-465b-a8d3-ca2b575ffff5 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:45.632189 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-7e8aa956-3893-465b-a8d3-ca2b575ffff5 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.147389 May 10 21:12:45.632768 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 284/544] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:45 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:45.738575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7b1f25d3-d15d-47c9-83ff-b02bdc3270a0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:45.746389 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7b1f25d3-d15d-47c9-83ff-b02bdc3270a0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.157064 May 10 21:12:45.746911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 261/545] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:45 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:46.649480 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6aff9ba6-4423-4704-b9af-7b0b4bbdd3c4 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:46.650092 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6aff9ba6-4423-4704-b9af-7b0b4bbdd3c4 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:46.656369 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6aff9ba6-4423-4704-b9af-7b0b4bbdd3c4 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:46.656814 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6aff9ba6-4423-4704-b9af-7b0b4bbdd3c4 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:46.657568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6aff9ba6-4423-4704-b9af-7b0b4bbdd3c4 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:46.658000 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6aff9ba6-4423-4704-b9af-7b0b4bbdd3c4 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:46.763712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2b645ba6-eeb3-4f33-8b59-a2950c4ab230 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:46.764323 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2b645ba6-eeb3-4f33-8b59-a2950c4ab230 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:46.770627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2b645ba6-eeb3-4f33-8b59-a2950c4ab230 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:46.771086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2b645ba6-eeb3-4f33-8b59-a2950c4ab230 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:46.772387 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2b645ba6-eeb3-4f33-8b59-a2950c4ab230 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:46.772842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2b645ba6-eeb3-4f33-8b59-a2950c4ab230 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:46.789638 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-6aff9ba6-4423-4704-b9af-7b0b4bbdd3c4 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:46.796932 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6aff9ba6-4423-4704-b9af-7b0b4bbdd3c4 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.151643 May 10 21:12:46.797501 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 285/546] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:46 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:46.905002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2b645ba6-eeb3-4f33-8b59-a2950c4ab230 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:46.912335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2b645ba6-eeb3-4f33-8b59-a2950c4ab230 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.152590 May 10 21:12:46.913212 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 262/547] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:46 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:47.814306 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-0a36fb05-b2e0-4272-aa08-cd7897f4347a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:47.814952 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-0a36fb05-b2e0-4272-aa08-cd7897f4347a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:47.822130 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0a36fb05-b2e0-4272-aa08-cd7897f4347a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:47.822581 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0a36fb05-b2e0-4272-aa08-cd7897f4347a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:47.823392 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0a36fb05-b2e0-4272-aa08-cd7897f4347a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:47.823839 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0a36fb05-b2e0-4272-aa08-cd7897f4347a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:47.930705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-538a9762-e38e-4a93-a3ae-364acd331ca1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:47.931354 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-538a9762-e38e-4a93-a3ae-364acd331ca1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:47.937879 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-538a9762-e38e-4a93-a3ae-364acd331ca1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:47.938328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-538a9762-e38e-4a93-a3ae-364acd331ca1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:47.939377 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-538a9762-e38e-4a93-a3ae-364acd331ca1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:47.939807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-538a9762-e38e-4a93-a3ae-364acd331ca1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:47.952729 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-0a36fb05-b2e0-4272-aa08-cd7897f4347a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:47.959062 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-0a36fb05-b2e0-4272-aa08-cd7897f4347a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.148782 May 10 21:12:47.960398 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 286/548] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:47 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:48.069807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-538a9762-e38e-4a93-a3ae-364acd331ca1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:48.077044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-538a9762-e38e-4a93-a3ae-364acd331ca1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.150998 May 10 21:12:48.077611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 263/549] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:47 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:48.976298 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-007cedc8-cb77-424d-b340-30cdfd72151f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:48.976833 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-007cedc8-cb77-424d-b340-30cdfd72151f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:48.983093 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-007cedc8-cb77-424d-b340-30cdfd72151f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:48.983565 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-007cedc8-cb77-424d-b340-30cdfd72151f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:48.984324 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-007cedc8-cb77-424d-b340-30cdfd72151f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:48.984759 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-007cedc8-cb77-424d-b340-30cdfd72151f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:49.093671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5972720e-a9e6-4a2b-bfc7-1c376286ac42 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:49.094283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5972720e-a9e6-4a2b-bfc7-1c376286ac42 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:49.101311 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5972720e-a9e6-4a2b-bfc7-1c376286ac42 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:49.101783 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5972720e-a9e6-4a2b-bfc7-1c376286ac42 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:49.102566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5972720e-a9e6-4a2b-bfc7-1c376286ac42 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:49.103006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5972720e-a9e6-4a2b-bfc7-1c376286ac42 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:49.116468 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-007cedc8-cb77-424d-b340-30cdfd72151f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:49.124117 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-007cedc8-cb77-424d-b340-30cdfd72151f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.152341 May 10 21:12:49.124680 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 287/550] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:48 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:49.236268 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5972720e-a9e6-4a2b-bfc7-1c376286ac42 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:49.244054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5972720e-a9e6-4a2b-bfc7-1c376286ac42 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.154282 May 10 21:12:49.244621 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 264/551] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:49 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:50.141987 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e759c766-d97a-430d-ac3d-d3007bc3072b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:50.142600 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e759c766-d97a-430d-ac3d-d3007bc3072b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:50.149498 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e759c766-d97a-430d-ac3d-d3007bc3072b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:50.149946 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e759c766-d97a-430d-ac3d-d3007bc3072b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:50.150714 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e759c766-d97a-430d-ac3d-d3007bc3072b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:50.151163 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e759c766-d97a-430d-ac3d-d3007bc3072b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:50.260982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b127b33f-430c-45cf-9c9f-e46d3fc96f01 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:50.261590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b127b33f-430c-45cf-9c9f-e46d3fc96f01 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:50.267960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b127b33f-430c-45cf-9c9f-e46d3fc96f01 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:50.268355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b127b33f-430c-45cf-9c9f-e46d3fc96f01 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:50.269120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b127b33f-430c-45cf-9c9f-e46d3fc96f01 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:50.269552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b127b33f-430c-45cf-9c9f-e46d3fc96f01 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:50.278771 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-e759c766-d97a-430d-ac3d-d3007bc3072b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:50.286122 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e759c766-d97a-430d-ac3d-d3007bc3072b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.148093 May 10 21:12:50.286689 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 288/552] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:50 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:50.400186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b127b33f-430c-45cf-9c9f-e46d3fc96f01 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:50.407852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b127b33f-430c-45cf-9c9f-e46d3fc96f01 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.150997 May 10 21:12:50.408416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 265/553] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:50 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:51.303514 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f07daf8a-b07f-436c-a922-7ced3b174612 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:51.304123 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f07daf8a-b07f-436c-a922-7ced3b174612 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:51.310580 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f07daf8a-b07f-436c-a922-7ced3b174612 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:51.311030 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f07daf8a-b07f-436c-a922-7ced3b174612 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:51.311824 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f07daf8a-b07f-436c-a922-7ced3b174612 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:51.312299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f07daf8a-b07f-436c-a922-7ced3b174612 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:51.424634 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d6dfb4da-e2c1-46bb-a2db-5f0b04d3bc85 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:51.425259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d6dfb4da-e2c1-46bb-a2db-5f0b04d3bc85 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:51.431959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6dfb4da-e2c1-46bb-a2db-5f0b04d3bc85 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:51.432421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6dfb4da-e2c1-46bb-a2db-5f0b04d3bc85 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:51.433216 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6dfb4da-e2c1-46bb-a2db-5f0b04d3bc85 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:51.433673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6dfb4da-e2c1-46bb-a2db-5f0b04d3bc85 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:51.447591 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-f07daf8a-b07f-436c-a922-7ced3b174612 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:51.455272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f07daf8a-b07f-436c-a922-7ced3b174612 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.155506 May 10 21:12:51.455839 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 289/554] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:51 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:51.562839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d6dfb4da-e2c1-46bb-a2db-5f0b04d3bc85 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:51.570883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d6dfb4da-e2c1-46bb-a2db-5f0b04d3bc85 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.150142 May 10 21:12:51.571471 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 266/555] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:51 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:52.473051 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a7847ac7-d7e4-4ca2-8722-0a9eb8f5f302 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:52.473598 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a7847ac7-d7e4-4ca2-8722-0a9eb8f5f302 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:52.480578 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a7847ac7-d7e4-4ca2-8722-0a9eb8f5f302 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:52.481031 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a7847ac7-d7e4-4ca2-8722-0a9eb8f5f302 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:52.481795 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a7847ac7-d7e4-4ca2-8722-0a9eb8f5f302 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:52.482236 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a7847ac7-d7e4-4ca2-8722-0a9eb8f5f302 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:52.588322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5dc3efa1-2dc3-4d01-aaec-caa5241c80b8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:52.589060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5dc3efa1-2dc3-4d01-aaec-caa5241c80b8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:52.595434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5dc3efa1-2dc3-4d01-aaec-caa5241c80b8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:52.595966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5dc3efa1-2dc3-4d01-aaec-caa5241c80b8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:52.596816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5dc3efa1-2dc3-4d01-aaec-caa5241c80b8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:52.597331 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5dc3efa1-2dc3-4d01-aaec-caa5241c80b8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:52.611113 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-a7847ac7-d7e4-4ca2-8722-0a9eb8f5f302 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:52.618460 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a7847ac7-d7e4-4ca2-8722-0a9eb8f5f302 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.149435 May 10 21:12:52.619174 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 290/556] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:52 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:52.730448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5dc3efa1-2dc3-4d01-aaec-caa5241c80b8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:52.737800 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5dc3efa1-2dc3-4d01-aaec-caa5241c80b8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.154029 May 10 21:12:52.738370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 267/557] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:52 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:53.636200 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-36a6d1fb-aabf-4ab8-9bdd-48f668d18a6c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:53.636811 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-36a6d1fb-aabf-4ab8-9bdd-48f668d18a6c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:53.643202 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-36a6d1fb-aabf-4ab8-9bdd-48f668d18a6c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:53.643652 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-36a6d1fb-aabf-4ab8-9bdd-48f668d18a6c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:53.644419 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-36a6d1fb-aabf-4ab8-9bdd-48f668d18a6c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:53.644854 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-36a6d1fb-aabf-4ab8-9bdd-48f668d18a6c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:53.754658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2c90754c-041a-4d97-806b-541da61ddbd0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:53.755427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2c90754c-041a-4d97-806b-541da61ddbd0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:53.762426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c90754c-041a-4d97-806b-541da61ddbd0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:53.762881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c90754c-041a-4d97-806b-541da61ddbd0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:53.763759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c90754c-041a-4d97-806b-541da61ddbd0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:53.764203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c90754c-041a-4d97-806b-541da61ddbd0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:53.770039 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-36a6d1fb-aabf-4ab8-9bdd-48f668d18a6c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:53.777528 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-36a6d1fb-aabf-4ab8-9bdd-48f668d18a6c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.145324 May 10 21:12:53.778096 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 291/558] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:53 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:53.893667 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2c90754c-041a-4d97-806b-541da61ddbd0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:53.901633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2c90754c-041a-4d97-806b-541da61ddbd0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.150858 May 10 21:12:53.902246 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 268/559] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:53 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:54.794163 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c819ccb0-a0be-4f64-b852-1a08f5a5b73a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:54.794778 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c819ccb0-a0be-4f64-b852-1a08f5a5b73a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:54.801178 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c819ccb0-a0be-4f64-b852-1a08f5a5b73a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:54.801632 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c819ccb0-a0be-4f64-b852-1a08f5a5b73a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:54.802408 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c819ccb0-a0be-4f64-b852-1a08f5a5b73a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:54.802849 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c819ccb0-a0be-4f64-b852-1a08f5a5b73a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:54.918273 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e53e2876-1aed-438a-8cc5-39d4ca4aa5ab tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:54.918811 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e53e2876-1aed-438a-8cc5-39d4ca4aa5ab tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:54.925011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e53e2876-1aed-438a-8cc5-39d4ca4aa5ab tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:54.925457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e53e2876-1aed-438a-8cc5-39d4ca4aa5ab tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:54.926224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e53e2876-1aed-438a-8cc5-39d4ca4aa5ab tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:54.926660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e53e2876-1aed-438a-8cc5-39d4ca4aa5ab tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:54.934702 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-c819ccb0-a0be-4f64-b852-1a08f5a5b73a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:54.942169 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c819ccb0-a0be-4f64-b852-1a08f5a5b73a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.151896 May 10 21:12:54.942733 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 292/560] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:54 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:55.062750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e53e2876-1aed-438a-8cc5-39d4ca4aa5ab tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:55.071387 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e53e2876-1aed-438a-8cc5-39d4ca4aa5ab tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.156777 May 10 21:12:55.071964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 269/561] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:54 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:55.960659 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-28233b00-7b66-4ed9-abfd-c251c082dc6f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:55.961337 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-28233b00-7b66-4ed9-abfd-c251c082dc6f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:55.967865 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-28233b00-7b66-4ed9-abfd-c251c082dc6f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:55.968315 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-28233b00-7b66-4ed9-abfd-c251c082dc6f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:55.969109 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-28233b00-7b66-4ed9-abfd-c251c082dc6f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:55.969545 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-28233b00-7b66-4ed9-abfd-c251c082dc6f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:56.088289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-246fdb3a-4f3b-4148-a6ed-45599b4bdd37 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:56.088898 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-246fdb3a-4f3b-4148-a6ed-45599b4bdd37 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:56.097459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-246fdb3a-4f3b-4148-a6ed-45599b4bdd37 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:56.097940 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-246fdb3a-4f3b-4148-a6ed-45599b4bdd37 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:56.098251 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-28233b00-7b66-4ed9-abfd-c251c082dc6f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:56.098728 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-246fdb3a-4f3b-4148-a6ed-45599b4bdd37 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:56.099255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-246fdb3a-4f3b-4148-a6ed-45599b4bdd37 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:56.106700 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-28233b00-7b66-4ed9-abfd-c251c082dc6f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.150537 May 10 21:12:56.107311 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 293/562] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:55 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:56.234036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-246fdb3a-4f3b-4148-a6ed-45599b4bdd37 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:56.241596 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-246fdb3a-4f3b-4148-a6ed-45599b4bdd37 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.157229 May 10 21:12:56.242150 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 270/563] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:56 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:57.124619 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-fa7f5a78-d672-4f72-80e4-c750a8bbd057 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:57.125232 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-fa7f5a78-d672-4f72-80e4-c750a8bbd057 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:57.131576 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fa7f5a78-d672-4f72-80e4-c750a8bbd057 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:57.132022 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fa7f5a78-d672-4f72-80e4-c750a8bbd057 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:57.132789 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fa7f5a78-d672-4f72-80e4-c750a8bbd057 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:57.133230 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fa7f5a78-d672-4f72-80e4-c750a8bbd057 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:57.257998 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ddab2dd3-50ab-4e99-9d08-4b54ab014c87 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:57.258657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ddab2dd3-50ab-4e99-9d08-4b54ab014c87 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:57.265208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ddab2dd3-50ab-4e99-9d08-4b54ab014c87 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:57.265365 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-fa7f5a78-d672-4f72-80e4-c750a8bbd057 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:57.265654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ddab2dd3-50ab-4e99-9d08-4b54ab014c87 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:57.266424 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ddab2dd3-50ab-4e99-9d08-4b54ab014c87 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:57.266859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ddab2dd3-50ab-4e99-9d08-4b54ab014c87 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:57.273860 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-fa7f5a78-d672-4f72-80e4-c750a8bbd057 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.152583 May 10 21:12:57.274433 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 294/564] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:57 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:57.403641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ddab2dd3-50ab-4e99-9d08-4b54ab014c87 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:57.411085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ddab2dd3-50ab-4e99-9d08-4b54ab014c87 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.156992 May 10 21:12:57.411676 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 271/565] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:57 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:58.290461 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-3409ce4a-4434-4a42-89be-fe55a58cd551 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:58.291086 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-3409ce4a-4434-4a42-89be-fe55a58cd551 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:58.297432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3409ce4a-4434-4a42-89be-fe55a58cd551 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:58.297867 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3409ce4a-4434-4a42-89be-fe55a58cd551 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:58.298643 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3409ce4a-4434-4a42-89be-fe55a58cd551 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:58.299083 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3409ce4a-4434-4a42-89be-fe55a58cd551 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:58.424586 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-3409ce4a-4434-4a42-89be-fe55a58cd551 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:58.427945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6e39ff66-2317-420c-8dac-436cf9247eb2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:58.429276 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6e39ff66-2317-420c-8dac-436cf9247eb2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:58.432730 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-3409ce4a-4434-4a42-89be-fe55a58cd551 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.146560 May 10 21:12:58.433299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 295/566] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:58 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:58.435812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6e39ff66-2317-420c-8dac-436cf9247eb2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:58.436259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6e39ff66-2317-420c-8dac-436cf9247eb2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:58.437023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6e39ff66-2317-420c-8dac-436cf9247eb2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:58.437456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6e39ff66-2317-420c-8dac-436cf9247eb2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:58.573040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6e39ff66-2317-420c-8dac-436cf9247eb2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:58.580427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6e39ff66-2317-420c-8dac-436cf9247eb2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.156238 May 10 21:12:58.581006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 272/567] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:58 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:12:59.450499 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a9aeaa67-8831-4acd-b68a-61026df87c5c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:59.451154 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a9aeaa67-8831-4acd-b68a-61026df87c5c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:59.457623 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a9aeaa67-8831-4acd-b68a-61026df87c5c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:59.458072 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a9aeaa67-8831-4acd-b68a-61026df87c5c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:59.458831 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a9aeaa67-8831-4acd-b68a-61026df87c5c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:59.459370 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a9aeaa67-8831-4acd-b68a-61026df87c5c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:59.588929 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-a9aeaa67-8831-4acd-b68a-61026df87c5c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:59.596473 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a9aeaa67-8831-4acd-b68a-61026df87c5c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.149848 May 10 21:12:59.597039 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 296/568] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:59 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:12:59.599042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2c9457f9-536a-4e82-bc00-bcc436bc9668 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:12:59.600900 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2c9457f9-536a-4e82-bc00-bcc436bc9668 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:12:59.607654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c9457f9-536a-4e82-bc00-bcc436bc9668 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:59.608101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c9457f9-536a-4e82-bc00-bcc436bc9668 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:59.608934 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c9457f9-536a-4e82-bc00-bcc436bc9668 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:12:59.609369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c9457f9-536a-4e82-bc00-bcc436bc9668 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:12:59.737964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2c9457f9-536a-4e82-bc00-bcc436bc9668 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:12:59.745354 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2c9457f9-536a-4e82-bc00-bcc436bc9668 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.150099 May 10 21:12:59.745915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 273/569] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:12:59 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:00.614186 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-0d150f2b-f619-4482-ae80-813250576f4a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:00.614855 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-0d150f2b-f619-4482-ae80-813250576f4a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:00.622078 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0d150f2b-f619-4482-ae80-813250576f4a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:00.622548 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0d150f2b-f619-4482-ae80-813250576f4a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:00.623351 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0d150f2b-f619-4482-ae80-813250576f4a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:00.623784 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0d150f2b-f619-4482-ae80-813250576f4a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:00.755715 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-0d150f2b-f619-4482-ae80-813250576f4a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:00.761857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1d616966-aa66-4de5-b105-dbfb6da4963c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:00.762485 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1d616966-aa66-4de5-b105-dbfb6da4963c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:00.763529 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-0d150f2b-f619-4482-ae80-813250576f4a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.153132 May 10 21:13:00.764095 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 297/570] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:00 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:00.768607 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d616966-aa66-4de5-b105-dbfb6da4963c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:00.769063 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d616966-aa66-4de5-b105-dbfb6da4963c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:00.769838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d616966-aa66-4de5-b105-dbfb6da4963c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:00.770283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d616966-aa66-4de5-b105-dbfb6da4963c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:00.902024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1d616966-aa66-4de5-b105-dbfb6da4963c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:00.909504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1d616966-aa66-4de5-b105-dbfb6da4963c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.151416 May 10 21:13:00.910073 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 274/571] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:00 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:01.782010 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-78733ebb-f2fc-4326-860b-f7bb499a409f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:01.782918 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-78733ebb-f2fc-4326-860b-f7bb499a409f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:01.790713 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-78733ebb-f2fc-4326-860b-f7bb499a409f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:01.791370 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-78733ebb-f2fc-4326-860b-f7bb499a409f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:01.792518 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-78733ebb-f2fc-4326-860b-f7bb499a409f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:01.793191 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-78733ebb-f2fc-4326-860b-f7bb499a409f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:01.924623 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-78733ebb-f2fc-4326-860b-f7bb499a409f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:01.926207 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-28a54999-a3d6-46db-a67d-fc98c4fb2826 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:01.926819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-28a54999-a3d6-46db-a67d-fc98c4fb2826 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:01.932965 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-78733ebb-f2fc-4326-860b-f7bb499a409f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.155742 May 10 21:13:01.933542 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 298/572] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:01 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:01.933891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28a54999-a3d6-46db-a67d-fc98c4fb2826 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:01.934344 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28a54999-a3d6-46db-a67d-fc98c4fb2826 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:01.935187 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28a54999-a3d6-46db-a67d-fc98c4fb2826 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:01.935597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28a54999-a3d6-46db-a67d-fc98c4fb2826 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:02.063597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-28a54999-a3d6-46db-a67d-fc98c4fb2826 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:02.071360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-28a54999-a3d6-46db-a67d-fc98c4fb2826 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.149003 May 10 21:13:02.071918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 275/573] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:01 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:02.950548 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-1e2baccc-4f92-4f86-9ad0-45ab85cde74c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:02.951174 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-1e2baccc-4f92-4f86-9ad0-45ab85cde74c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:02.957831 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1e2baccc-4f92-4f86-9ad0-45ab85cde74c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:02.958304 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1e2baccc-4f92-4f86-9ad0-45ab85cde74c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:02.959068 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1e2baccc-4f92-4f86-9ad0-45ab85cde74c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:02.959540 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1e2baccc-4f92-4f86-9ad0-45ab85cde74c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:03.087910 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-1e2baccc-4f92-4f86-9ad0-45ab85cde74c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:03.088479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f960fa70-23b6-4ddd-a3bc-9533255898ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:03.089087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f960fa70-23b6-4ddd-a3bc-9533255898ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:03.095342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f960fa70-23b6-4ddd-a3bc-9533255898ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:03.095521 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-1e2baccc-4f92-4f86-9ad0-45ab85cde74c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.148746 May 10 21:13:03.095789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f960fa70-23b6-4ddd-a3bc-9533255898ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:03.096097 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 299/574] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:02 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:03.096551 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f960fa70-23b6-4ddd-a3bc-9533255898ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:03.097083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f960fa70-23b6-4ddd-a3bc-9533255898ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:03.227922 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f960fa70-23b6-4ddd-a3bc-9533255898ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:03.235055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f960fa70-23b6-4ddd-a3bc-9533255898ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.150684 May 10 21:13:03.235649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 276/575] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:03 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:04.111707 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-bf5ed1bf-d94f-486f-9b65-80a8c839c0e8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:04.112329 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-bf5ed1bf-d94f-486f-9b65-80a8c839c0e8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:04.118644 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bf5ed1bf-d94f-486f-9b65-80a8c839c0e8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:04.119095 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bf5ed1bf-d94f-486f-9b65-80a8c839c0e8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:04.119896 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bf5ed1bf-d94f-486f-9b65-80a8c839c0e8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:04.120332 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bf5ed1bf-d94f-486f-9b65-80a8c839c0e8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:04.246209 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-bf5ed1bf-d94f-486f-9b65-80a8c839c0e8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:04.252508 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2cceccdf-6b9f-4de9-bc94-1c6c511f3f2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:04.253117 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2cceccdf-6b9f-4de9-bc94-1c6c511f3f2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:04.253580 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-bf5ed1bf-d94f-486f-9b65-80a8c839c0e8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.145681 May 10 21:13:04.254145 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 300/576] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:04 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:04.259491 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2cceccdf-6b9f-4de9-bc94-1c6c511f3f2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:04.259936 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2cceccdf-6b9f-4de9-bc94-1c6c511f3f2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:04.260702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2cceccdf-6b9f-4de9-bc94-1c6c511f3f2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:04.261135 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2cceccdf-6b9f-4de9-bc94-1c6c511f3f2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:04.387672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2cceccdf-6b9f-4de9-bc94-1c6c511f3f2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:04.394878 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2cceccdf-6b9f-4de9-bc94-1c6c511f3f2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.146119 May 10 21:13:04.395472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 277/577] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:04 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:05.270726 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-b8909ab2-614a-40a2-b6b2-e984073ea986 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:05.271315 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-b8909ab2-614a-40a2-b6b2-e984073ea986 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:05.277790 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b8909ab2-614a-40a2-b6b2-e984073ea986 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:05.278250 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b8909ab2-614a-40a2-b6b2-e984073ea986 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:05.279023 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b8909ab2-614a-40a2-b6b2-e984073ea986 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:05.279498 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b8909ab2-614a-40a2-b6b2-e984073ea986 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:05.407515 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-b8909ab2-614a-40a2-b6b2-e984073ea986 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:05.413631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-21f37dfb-c039-4af5-9b4c-7393ccbde719 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:05.415454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-21f37dfb-c039-4af5-9b4c-7393ccbde719 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:05.415923 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-b8909ab2-614a-40a2-b6b2-e984073ea986 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.149095 May 10 21:13:05.425619 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 301/578] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:05 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:05.426080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21f37dfb-c039-4af5-9b4c-7393ccbde719 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:05.426080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21f37dfb-c039-4af5-9b4c-7393ccbde719 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:05.426080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21f37dfb-c039-4af5-9b4c-7393ccbde719 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:05.426080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21f37dfb-c039-4af5-9b4c-7393ccbde719 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:05.551544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-21f37dfb-c039-4af5-9b4c-7393ccbde719 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:05.559572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-21f37dfb-c039-4af5-9b4c-7393ccbde719 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.150721 May 10 21:13:05.560140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 278/579] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:05 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:06.434144 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-94272074-7927-4568-9298-c090d5a96099 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:06.434793 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-94272074-7927-4568-9298-c090d5a96099 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:06.441634 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-94272074-7927-4568-9298-c090d5a96099 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:06.442093 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-94272074-7927-4568-9298-c090d5a96099 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:06.442931 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-94272074-7927-4568-9298-c090d5a96099 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:06.443412 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-94272074-7927-4568-9298-c090d5a96099 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:06.576664 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f792a2e3-9888-4c05-b720-e59cc9f5f426 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:06.577277 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f792a2e3-9888-4c05-b720-e59cc9f5f426 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:06.578179 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-94272074-7927-4568-9298-c090d5a96099 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:06.583654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f792a2e3-9888-4c05-b720-e59cc9f5f426 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:06.584107 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f792a2e3-9888-4c05-b720-e59cc9f5f426 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:06.584889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f792a2e3-9888-4c05-b720-e59cc9f5f426 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:06.585327 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f792a2e3-9888-4c05-b720-e59cc9f5f426 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:06.586013 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-94272074-7927-4568-9298-c090d5a96099 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.155962 May 10 21:13:06.586591 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 302/580] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:06 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:06.721700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f792a2e3-9888-4c05-b720-e59cc9f5f426 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:06.729870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f792a2e3-9888-4c05-b720-e59cc9f5f426 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.157142 May 10 21:13:06.730432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 279/581] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:06 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:07.603237 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-af3a0da2-c4e3-4483-ab1a-6315ea597a46 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:07.603895 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-af3a0da2-c4e3-4483-ab1a-6315ea597a46 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:07.610346 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-af3a0da2-c4e3-4483-ab1a-6315ea597a46 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:07.610797 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-af3a0da2-c4e3-4483-ab1a-6315ea597a46 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:07.611601 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-af3a0da2-c4e3-4483-ab1a-6315ea597a46 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:07.612045 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-af3a0da2-c4e3-4483-ab1a-6315ea597a46 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:07.747615 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-af3a0da2-c4e3-4483-ab1a-6315ea597a46 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:07.747754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7d3a1887-07d1-4590-835e-1e9460e79037 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:07.747754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7d3a1887-07d1-4590-835e-1e9460e79037 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:07.748655 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-af3a0da2-c4e3-4483-ab1a-6315ea597a46 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.149529 May 10 21:13:07.749443 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 303/582] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:07 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:07.752866 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7d3a1887-07d1-4590-835e-1e9460e79037 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:07.753320 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7d3a1887-07d1-4590-835e-1e9460e79037 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:07.754095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7d3a1887-07d1-4590-835e-1e9460e79037 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:07.754531 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7d3a1887-07d1-4590-835e-1e9460e79037 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:07.893111 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7d3a1887-07d1-4590-835e-1e9460e79037 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:07.893111 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7d3a1887-07d1-4590-835e-1e9460e79037 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.148219 May 10 21:13:07.893111 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 280/583] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:07 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:08.033552 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-b058413e-dc7e-4df1-b35d-e2df5f0bea9b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:08.034049 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-b058413e-dc7e-4df1-b35d-e2df5f0bea9b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:08.040028 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b058413e-dc7e-4df1-b35d-e2df5f0bea9b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:08.040485 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b058413e-dc7e-4df1-b35d-e2df5f0bea9b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:08.041257 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b058413e-dc7e-4df1-b35d-e2df5f0bea9b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:08.041699 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b058413e-dc7e-4df1-b35d-e2df5f0bea9b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:08.065344 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-b058413e-dc7e-4df1-b35d-e2df5f0bea9b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf/ips" status: 200 len: 150 microversion: 2.1 time: 0.035542 May 10 21:13:08.065908 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 304/584] 10.222.0.49 () {58 vars in 1247 bytes} [Tue May 10 21:13:08 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:13:08.076900 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6a41e670-f659-4bc0-9a21-544fdbb36d45 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "678a2357-0815-4dbd-af6f-4f32d017941d"}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:13:08.078000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6a41e670-f659-4bc0-9a21-544fdbb36d45 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:08.083923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a41e670-f659-4bc0-9a21-544fdbb36d45 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:08.084409 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a41e670-f659-4bc0-9a21-544fdbb36d45 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:08.085190 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a41e670-f659-4bc0-9a21-544fdbb36d45 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:08.085638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a41e670-f659-4bc0-9a21-544fdbb36d45 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:08.163268 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-6a41e670-f659-4bc0-9a21-544fdbb36d45 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] HTTP exception thrown: Invalid volume: volume 678a2357-0815-4dbd-af6f-4f32d017941d is already attached to instances: 4b28c992-788d-4e37-b194-aaf2fb61577b May 10 21:13:08.164992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6a41e670-f659-4bc0-9a21-544fdbb36d45 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Request method failure captured: May 10 21:13:08.164992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: POST /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf/os-volume_attachments HTTP/1.1 May 10 21:13:08.164992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:13:08.164992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:13:08.164992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:13:08.164992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 74 May 10 21:13:08.164992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:13:08.164992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:13:08.164992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:13:08.164992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:13:08.164992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietSE5zX3cUzqYcL4439JiFsqE4YiilwKjmw-zwJrvzsKCKk2V0t2rgnfCfWB9fMDqHcwDYx66Osidv5Nb3ivvjsId3P0K5BlinPK-pYoxdKcKRbo0A46AEZFFXEAkT7Vt_ZFHlOxIkEow-5P_dpFvNFYY0aq5XGlXkN1VnlT95XyJvw May 10 21:13:08.164992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:13:08.164992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:13:08.164992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:13:08.164992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:13:08.164992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:13:08.164992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:13:08.164992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 9582743483fa4fb88f4e91d3f787c945 May 10 21:13:08.164992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-AttachVolumeNegativeTest-297208105 May 10 21:13:08.164992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:13:08.164992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:13:08.166603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9582743483fa4fb88f4e91d3f787c945", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:13:08.166603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-AttachVolumeNegativeTest-297208105 May 10 21:13:08.166603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 9582743483fa4fb88f4e91d3f787c945 May 10 21:13:08.166603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-297208105 May 10 21:13:08.166603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-AttachVolumeNegativeTest-297208105-project May 10 21:13:08.166603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:13:08.166603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:13:08.166603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 62bc5605a22d408f9b4bac69a0f5f486 May 10 21:13:08.166603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-AttachVolumeNegativeTest-297208105-project May 10 21:13:08.166603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: May 10 21:13:08.166603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {"volumeAttachment": {"volumeId": "678a2357-0815-4dbd-af6f-4f32d017941d"}} May 10 21:13:08.166603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:13:08.167680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Invalid volume: volume 678a2357-0815-4dbd-af6f-4f32d017941d is already attached to instances: 4b28c992-788d-4e37-b194-aaf2fb61577b May 10 21:13:08.167680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'server_id': 'f2a9d425-c6f1-4f23-8fb7-7311ca431fdf', 'body': {'volumeAttachment': {'volumeId': '678a2357-0815-4dbd-af6f-4f32d017941d'}}} May 10 21:13:08.167680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:13:08.167680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:13:08.167680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 21:13:08.167680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 21:13:08.167680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 21:13:08.167680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 21:13:08.167680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 21:13:08.167680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 21:13:08.167680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 10 21:13:08.167680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 10 21:13:08.167680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 10 21:13:08.167680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 10 21:13:08.167680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 678a2357-0815-4dbd-af6f-4f32d017941d is already attached to instances: 4b28c992-788d-4e37-b194-aaf2fb61577b May 10 21:13:08.167680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:13:08.167680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:13:08.167680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:13:08.167680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:13:08.169139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:13:08.169139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:13:08.169139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:13:08.169139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:13:08.169139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:13:08.169139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:13:08.169139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 21:13:08.169139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 21:13:08.169139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 21:13:08.169139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 21:13:08.169139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 21:13:08.169139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 21:13:08.169139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 10 21:13:08.169139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 21:13:08.169139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 678a2357-0815-4dbd-af6f-4f32d017941d is already attached to instances: 4b28c992-788d-4e37-b194-aaf2fb61577b May 10 21:13:08.169139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:13:08.169139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:13:08.169139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:13:08.169139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:13:08.169139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:13:08.170602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:13:08.170602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:13:08.170602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:13:08.170602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 678a2357-0815-4dbd-af6f-4f32d017941d is already attached to instances: 4b28c992-788d-4e37-b194-aaf2fb61577b May 10 21:13:08.170602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:13:08.170602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6a41e670-f659-4bc0-9a21-544fdbb36d45 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Returning 400 to user: Invalid volume: volume 678a2357-0815-4dbd-af6f-4f32d017941d is already attached to instances: 4b28c992-788d-4e37-b194-aaf2fb61577b {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:13:08.170602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6a41e670-f659-4bc0-9a21-544fdbb36d45 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "POST /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093507 May 10 21:13:08.170602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 281/585] 10.222.0.49 () {60 vars in 1322 bytes} [Tue May 10 21:13:08 2022] POST /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 21:13:08.175647 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-5a1bd718-8f10-48be-bbe4-02423c45b8a3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:08.176258 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5a1bd718-8f10-48be-bbe4-02423c45b8a3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:08.182738 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5a1bd718-8f10-48be-bbe4-02423c45b8a3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:08.183214 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5a1bd718-8f10-48be-bbe4-02423c45b8a3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:08.183983 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5a1bd718-8f10-48be-bbe4-02423c45b8a3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:08.184416 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5a1bd718-8f10-48be-bbe4-02423c45b8a3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:08.209203 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5a1bd718-8f10-48be-bbe4-02423c45b8a3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Going to try to terminate instance {{(pid=117713) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:13:08.446368 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-5a1bd718-8f10-48be-bbe4-02423c45b8a3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 204 len: 0 microversion: 2.1 time: 0.274415 May 10 21:13:08.446956 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 305/586] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 21:13:08 2022] DELETE /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 21:13:08.455043 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-af02daaa-19cf-4ae9-aced-5df7ba2885f9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:08.455685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-af02daaa-19cf-4ae9-aced-5df7ba2885f9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:08.462222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af02daaa-19cf-4ae9-aced-5df7ba2885f9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:08.464820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af02daaa-19cf-4ae9-aced-5df7ba2885f9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:08.464820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af02daaa-19cf-4ae9-aced-5df7ba2885f9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:08.464820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af02daaa-19cf-4ae9-aced-5df7ba2885f9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:08.595809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-af02daaa-19cf-4ae9-aced-5df7ba2885f9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:08.604818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-af02daaa-19cf-4ae9-aced-5df7ba2885f9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.153631 May 10 21:13:08.605390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 282/587] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:08 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:08.765912 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-3714c235-321e-4803-8d7b-f21a3bddb988 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:08.766613 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-3714c235-321e-4803-8d7b-f21a3bddb988 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:08.774353 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3714c235-321e-4803-8d7b-f21a3bddb988 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:08.774807 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3714c235-321e-4803-8d7b-f21a3bddb988 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:08.775625 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3714c235-321e-4803-8d7b-f21a3bddb988 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:08.776066 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3714c235-321e-4803-8d7b-f21a3bddb988 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:08.907180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-882085cb-4bc8-4e0a-8c90-51370600e4b7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:08.907784 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-3714c235-321e-4803-8d7b-f21a3bddb988 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:08.907924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-882085cb-4bc8-4e0a-8c90-51370600e4b7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:08.915494 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-882085cb-4bc8-4e0a-8c90-51370600e4b7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:08.915952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-882085cb-4bc8-4e0a-8c90-51370600e4b7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:08.916126 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-3714c235-321e-4803-8d7b-f21a3bddb988 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.154407 May 10 21:13:08.916693 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 306/588] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:08 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:08.916849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-882085cb-4bc8-4e0a-8c90-51370600e4b7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:08.917235 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-882085cb-4bc8-4e0a-8c90-51370600e4b7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:09.046597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-882085cb-4bc8-4e0a-8c90-51370600e4b7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:09.054071 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-882085cb-4bc8-4e0a-8c90-51370600e4b7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.150721 May 10 21:13:09.054606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 283/589] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:08 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:09.621963 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-83ea0954-0aee-47ad-97d3-2c825bcf3ca1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:09.622618 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-83ea0954-0aee-47ad-97d3-2c825bcf3ca1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:09.628562 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-83ea0954-0aee-47ad-97d3-2c825bcf3ca1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:09.629006 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-83ea0954-0aee-47ad-97d3-2c825bcf3ca1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:09.629761 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-83ea0954-0aee-47ad-97d3-2c825bcf3ca1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:09.630202 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-83ea0954-0aee-47ad-97d3-2c825bcf3ca1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:09.755084 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-83ea0954-0aee-47ad-97d3-2c825bcf3ca1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:09.763317 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-83ea0954-0aee-47ad-97d3-2c825bcf3ca1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.145138 May 10 21:13:09.763887 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 307/590] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:09 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:09.932994 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-864e8e3e-6ab1-4f65-8dce-53002c47fa2d tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:09.933613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-864e8e3e-6ab1-4f65-8dce-53002c47fa2d tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:09.940398 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-864e8e3e-6ab1-4f65-8dce-53002c47fa2d tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:09.940853 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-864e8e3e-6ab1-4f65-8dce-53002c47fa2d tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:09.941626 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-864e8e3e-6ab1-4f65-8dce-53002c47fa2d tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:09.942067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-864e8e3e-6ab1-4f65-8dce-53002c47fa2d tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:10.070194 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-864e8e3e-6ab1-4f65-8dce-53002c47fa2d tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:10.071753 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-fe14896d-aa0d-4142-bd6e-eeb7375d8e88 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:10.072550 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-fe14896d-aa0d-4142-bd6e-eeb7375d8e88 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:10.077662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-864e8e3e-6ab1-4f65-8dce-53002c47fa2d tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.148501 May 10 21:13:10.078236 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 284/591] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:09 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:10.078901 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fe14896d-aa0d-4142-bd6e-eeb7375d8e88 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:10.079402 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fe14896d-aa0d-4142-bd6e-eeb7375d8e88 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:10.080189 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fe14896d-aa0d-4142-bd6e-eeb7375d8e88 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:10.080634 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fe14896d-aa0d-4142-bd6e-eeb7375d8e88 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:10.226660 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-fe14896d-aa0d-4142-bd6e-eeb7375d8e88 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:10.234001 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-fe14896d-aa0d-4142-bd6e-eeb7375d8e88 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.166900 May 10 21:13:10.234572 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 308/592] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:10 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:10.781247 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-942217e7-7ade-4ecc-a441-a6e60d816a7c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:10.781868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-942217e7-7ade-4ecc-a441-a6e60d816a7c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:10.788562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-942217e7-7ade-4ecc-a441-a6e60d816a7c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:10.789012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-942217e7-7ade-4ecc-a441-a6e60d816a7c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:10.789785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-942217e7-7ade-4ecc-a441-a6e60d816a7c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:10.790218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-942217e7-7ade-4ecc-a441-a6e60d816a7c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:10.928207 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-942217e7-7ade-4ecc-a441-a6e60d816a7c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:10.935658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-942217e7-7ade-4ecc-a441-a6e60d816a7c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.158535 May 10 21:13:10.936287 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 285/593] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:10 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:11.095608 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-4ff9de06-67a5-4b70-9499-1a0fb0af534e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:11.096225 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-4ff9de06-67a5-4b70-9499-1a0fb0af534e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:11.103360 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4ff9de06-67a5-4b70-9499-1a0fb0af534e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:11.103808 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4ff9de06-67a5-4b70-9499-1a0fb0af534e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:11.104567 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4ff9de06-67a5-4b70-9499-1a0fb0af534e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:11.105002 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4ff9de06-67a5-4b70-9499-1a0fb0af534e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:11.233009 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-4ff9de06-67a5-4b70-9499-1a0fb0af534e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:11.240627 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-4ff9de06-67a5-4b70-9499-1a0fb0af534e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.148955 May 10 21:13:11.241506 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 309/594] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:11 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:11.251374 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-790ae8c5-8677-49a0-985f-9d64302e5222 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:11.251987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-790ae8c5-8677-49a0-985f-9d64302e5222 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:11.259014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-790ae8c5-8677-49a0-985f-9d64302e5222 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:11.259494 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-790ae8c5-8677-49a0-985f-9d64302e5222 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:11.260256 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-790ae8c5-8677-49a0-985f-9d64302e5222 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:11.260691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-790ae8c5-8677-49a0-985f-9d64302e5222 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:11.390616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-790ae8c5-8677-49a0-985f-9d64302e5222 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:11.398586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-790ae8c5-8677-49a0-985f-9d64302e5222 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.151059 May 10 21:13:11.399165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 286/595] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:11 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:11.953111 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-3b5070f2-33db-4e0f-bc60-963ae16bd160 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:11.953727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-3b5070f2-33db-4e0f-bc60-963ae16bd160 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:11.959763 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3b5070f2-33db-4e0f-bc60-963ae16bd160 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:11.960216 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3b5070f2-33db-4e0f-bc60-963ae16bd160 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:11.960983 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3b5070f2-33db-4e0f-bc60-963ae16bd160 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:11.961419 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3b5070f2-33db-4e0f-bc60-963ae16bd160 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:12.087149 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-3b5070f2-33db-4e0f-bc60-963ae16bd160 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:12.094364 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-3b5070f2-33db-4e0f-bc60-963ae16bd160 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.145044 May 10 21:13:12.094928 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 310/596] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:11 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:12.258194 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0ef0bc77-6b8e-48a1-a5c8-fbdf3c44f6e8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:12.258811 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0ef0bc77-6b8e-48a1-a5c8-fbdf3c44f6e8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:12.265140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ef0bc77-6b8e-48a1-a5c8-fbdf3c44f6e8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:12.265590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ef0bc77-6b8e-48a1-a5c8-fbdf3c44f6e8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:12.266357 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ef0bc77-6b8e-48a1-a5c8-fbdf3c44f6e8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:12.266798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ef0bc77-6b8e-48a1-a5c8-fbdf3c44f6e8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:12.416629 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e33d473f-149d-4410-b66d-71e11d76b148 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:12.417220 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e33d473f-149d-4410-b66d-71e11d76b148 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:12.423797 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e33d473f-149d-4410-b66d-71e11d76b148 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:12.424244 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e33d473f-149d-4410-b66d-71e11d76b148 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:12.425022 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e33d473f-149d-4410-b66d-71e11d76b148 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:12.425457 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e33d473f-149d-4410-b66d-71e11d76b148 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:12.564911 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-e33d473f-149d-4410-b66d-71e11d76b148 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:12.572615 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e33d473f-149d-4410-b66d-71e11d76b148 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.160523 May 10 21:13:12.573210 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 311/597] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:12 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:12.622292 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0ef0bc77-6b8e-48a1-a5c8-fbdf3c44f6e8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:12.630149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0ef0bc77-6b8e-48a1-a5c8-fbdf3c44f6e8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.376412 May 10 21:13:12.630797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 287/598] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:12 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:13.111462 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-bafcdec0-38ee-4832-96ac-e8c1fac3688b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:13.112089 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-bafcdec0-38ee-4832-96ac-e8c1fac3688b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:13.118725 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bafcdec0-38ee-4832-96ac-e8c1fac3688b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:13.119214 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bafcdec0-38ee-4832-96ac-e8c1fac3688b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:13.119985 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bafcdec0-38ee-4832-96ac-e8c1fac3688b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:13.120428 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bafcdec0-38ee-4832-96ac-e8c1fac3688b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:13.244900 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-bafcdec0-38ee-4832-96ac-e8c1fac3688b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:13.252483 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-bafcdec0-38ee-4832-96ac-e8c1fac3688b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.144795 May 10 21:13:13.253053 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 312/599] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:13 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:13.590122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-50e5df19-d402-4ea1-aa86-93cae032e570 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:13.590740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-50e5df19-d402-4ea1-aa86-93cae032e570 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:13.596815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50e5df19-d402-4ea1-aa86-93cae032e570 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:13.597264 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50e5df19-d402-4ea1-aa86-93cae032e570 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:13.598033 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50e5df19-d402-4ea1-aa86-93cae032e570 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:13.598472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50e5df19-d402-4ea1-aa86-93cae032e570 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:13.646908 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-716e6519-2059-4006-be88-a1c97c3028e1 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:13.648134 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-716e6519-2059-4006-be88-a1c97c3028e1 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:13.655428 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-716e6519-2059-4006-be88-a1c97c3028e1 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:13.655533 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-716e6519-2059-4006-be88-a1c97c3028e1 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:13.656386 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-716e6519-2059-4006-be88-a1c97c3028e1 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:13.656898 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-716e6519-2059-4006-be88-a1c97c3028e1 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:13.730898 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-50e5df19-d402-4ea1-aa86-93cae032e570 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:13.738328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-50e5df19-d402-4ea1-aa86-93cae032e570 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.152158 May 10 21:13:13.738895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 288/600] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:13 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:13.786747 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-716e6519-2059-4006-be88-a1c97c3028e1 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:13.794146 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-716e6519-2059-4006-be88-a1c97c3028e1 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.151210 May 10 21:13:13.794716 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 313/601] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:13 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:14.270293 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a624db60-64f8-403d-acff-1c336cf4d39c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:14.270838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a624db60-64f8-403d-acff-1c336cf4d39c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:14.276788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a624db60-64f8-403d-acff-1c336cf4d39c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:14.277238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a624db60-64f8-403d-acff-1c336cf4d39c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:14.278008 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a624db60-64f8-403d-acff-1c336cf4d39c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:14.278446 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a624db60-64f8-403d-acff-1c336cf4d39c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:14.409572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a624db60-64f8-403d-acff-1c336cf4d39c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:14.418074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a624db60-64f8-403d-acff-1c336cf4d39c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.151676 May 10 21:13:14.423755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 289/602] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:14 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:14.755309 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9bc62a5d-b6ca-46f9-bafe-7506147771a1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:14.755916 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-9bc62a5d-b6ca-46f9-bafe-7506147771a1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:14.762354 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9bc62a5d-b6ca-46f9-bafe-7506147771a1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:14.762799 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9bc62a5d-b6ca-46f9-bafe-7506147771a1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:14.763578 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9bc62a5d-b6ca-46f9-bafe-7506147771a1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:14.764011 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9bc62a5d-b6ca-46f9-bafe-7506147771a1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:14.811541 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-08f7bc92-fa99-49af-8ae6-47e1c8f83c29 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:14.812171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-08f7bc92-fa99-49af-8ae6-47e1c8f83c29 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:14.818816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-08f7bc92-fa99-49af-8ae6-47e1c8f83c29 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:14.819294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-08f7bc92-fa99-49af-8ae6-47e1c8f83c29 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:14.820064 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-08f7bc92-fa99-49af-8ae6-47e1c8f83c29 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:14.820504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-08f7bc92-fa99-49af-8ae6-47e1c8f83c29 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:14.899910 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-9bc62a5d-b6ca-46f9-bafe-7506147771a1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:14.906385 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9bc62a5d-b6ca-46f9-bafe-7506147771a1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.154876 May 10 21:13:14.907157 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 314/603] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:14 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:14.954856 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-08f7bc92-fa99-49af-8ae6-47e1c8f83c29 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:14.963074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-08f7bc92-fa99-49af-8ae6-47e1c8f83c29 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.155348 May 10 21:13:14.963665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 290/604] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:14 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:15.440366 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c380e837-0f45-489e-826c-ff139bf93a73 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:15.440974 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c380e837-0f45-489e-826c-ff139bf93a73 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:15.447653 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c380e837-0f45-489e-826c-ff139bf93a73 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:15.448101 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c380e837-0f45-489e-826c-ff139bf93a73 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:15.448855 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c380e837-0f45-489e-826c-ff139bf93a73 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:15.449288 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c380e837-0f45-489e-826c-ff139bf93a73 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:15.579263 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-c380e837-0f45-489e-826c-ff139bf93a73 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:15.586630 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c380e837-0f45-489e-826c-ff139bf93a73 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.150315 May 10 21:13:15.587211 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 315/605] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:15 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:15.923891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c21c8fe7-136f-487b-83a6-30866a7ee04a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:15.924430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c21c8fe7-136f-487b-83a6-30866a7ee04a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:15.931485 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c21c8fe7-136f-487b-83a6-30866a7ee04a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:15.934061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c21c8fe7-136f-487b-83a6-30866a7ee04a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:15.934061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c21c8fe7-136f-487b-83a6-30866a7ee04a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:15.934061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c21c8fe7-136f-487b-83a6-30866a7ee04a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:15.981322 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-86bd8f53-a120-48b2-ad68-8641eff30b93 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:15.981994 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-86bd8f53-a120-48b2-ad68-8641eff30b93 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:15.988283 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-86bd8f53-a120-48b2-ad68-8641eff30b93 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:15.988737 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-86bd8f53-a120-48b2-ad68-8641eff30b93 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:15.989506 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-86bd8f53-a120-48b2-ad68-8641eff30b93 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:15.989947 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-86bd8f53-a120-48b2-ad68-8641eff30b93 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:16.064833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c21c8fe7-136f-487b-83a6-30866a7ee04a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:16.072144 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c21c8fe7-136f-487b-83a6-30866a7ee04a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.152169 May 10 21:13:16.072724 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 291/606] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:15 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:16.123280 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-86bd8f53-a120-48b2-ad68-8641eff30b93 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:16.130803 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-86bd8f53-a120-48b2-ad68-8641eff30b93 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.153436 May 10 21:13:16.132177 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 316/607] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:15 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:16.604373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3b041667-60fe-4f78-b918-4105b31c6252 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:16.605104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3b041667-60fe-4f78-b918-4105b31c6252 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:16.611260 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3b041667-60fe-4f78-b918-4105b31c6252 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:16.611712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3b041667-60fe-4f78-b918-4105b31c6252 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:16.612479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3b041667-60fe-4f78-b918-4105b31c6252 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:16.612910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3b041667-60fe-4f78-b918-4105b31c6252 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:16.746641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3b041667-60fe-4f78-b918-4105b31c6252 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:16.753924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3b041667-60fe-4f78-b918-4105b31c6252 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.154018 May 10 21:13:16.754474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 292/608] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:16 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:17.091507 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6047ce46-13bd-4316-822a-373466103177 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:17.092125 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6047ce46-13bd-4316-822a-373466103177 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:17.098419 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6047ce46-13bd-4316-822a-373466103177 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:17.098870 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6047ce46-13bd-4316-822a-373466103177 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:17.099671 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6047ce46-13bd-4316-822a-373466103177 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:17.100747 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6047ce46-13bd-4316-822a-373466103177 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:17.149942 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9ddc0fe0-5c63-4535-b68e-fa04c9259651 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:17.150612 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9ddc0fe0-5c63-4535-b68e-fa04c9259651 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:17.157052 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ddc0fe0-5c63-4535-b68e-fa04c9259651 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:17.157505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ddc0fe0-5c63-4535-b68e-fa04c9259651 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:17.158285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ddc0fe0-5c63-4535-b68e-fa04c9259651 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:17.158724 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ddc0fe0-5c63-4535-b68e-fa04c9259651 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:17.237424 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-6047ce46-13bd-4316-822a-373466103177 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:17.244926 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6047ce46-13bd-4316-822a-373466103177 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.157363 May 10 21:13:17.248401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 317/609] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:17 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:17.295990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9ddc0fe0-5c63-4535-b68e-fa04c9259651 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:17.303167 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9ddc0fe0-5c63-4535-b68e-fa04c9259651 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.158389 May 10 21:13:17.303924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 293/610] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:17 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:17.770834 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c8f9572b-230b-4743-83b8-72ad8ca664d0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:17.771490 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c8f9572b-230b-4743-83b8-72ad8ca664d0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:17.777409 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c8f9572b-230b-4743-83b8-72ad8ca664d0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:17.777858 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c8f9572b-230b-4743-83b8-72ad8ca664d0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:17.778639 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c8f9572b-230b-4743-83b8-72ad8ca664d0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:17.779081 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c8f9572b-230b-4743-83b8-72ad8ca664d0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:17.908512 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-c8f9572b-230b-4743-83b8-72ad8ca664d0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:17.916555 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c8f9572b-230b-4743-83b8-72ad8ca664d0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.149515 May 10 21:13:17.917123 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 318/611] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:17 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:18.213491 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dff1e3c5-813b-40d0-9515-ee8efa7e02e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:18.213987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dff1e3c5-813b-40d0-9515-ee8efa7e02e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:18.220322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dff1e3c5-813b-40d0-9515-ee8efa7e02e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:18.220765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dff1e3c5-813b-40d0-9515-ee8efa7e02e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:18.221522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dff1e3c5-813b-40d0-9515-ee8efa7e02e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:18.221953 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dff1e3c5-813b-40d0-9515-ee8efa7e02e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:18.253758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dff1e3c5-813b-40d0-9515-ee8efa7e02e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments/19a60de6-9ee1-4e3a-90e8-e2cdb9747695" status: 200 len: 194 microversion: 2.20 time: 0.044400 May 10 21:13:18.254355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 294/612] 10.222.0.49 () {60 vars in 1453 bytes} [Tue May 10 21:13:18 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments/19a60de6-9ee1-4e3a-90e8-e2cdb9747695 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:18.261768 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-94eba4e8-dd22-4ec6-91a2-3b0d050e667e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:18.262292 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-94eba4e8-dd22-4ec6-91a2-3b0d050e667e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:18.268931 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-94eba4e8-dd22-4ec6-91a2-3b0d050e667e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:18.269390 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-94eba4e8-dd22-4ec6-91a2-3b0d050e667e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:18.270161 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-94eba4e8-dd22-4ec6-91a2-3b0d050e667e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:18.270624 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-94eba4e8-dd22-4ec6-91a2-3b0d050e667e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:18.318652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ff241393-5c37-418e-a12e-0cdeae63d4e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:18.319238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ff241393-5c37-418e-a12e-0cdeae63d4e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:18.325382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ff241393-5c37-418e-a12e-0cdeae63d4e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:18.325829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ff241393-5c37-418e-a12e-0cdeae63d4e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:18.326593 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ff241393-5c37-418e-a12e-0cdeae63d4e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:18.327024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ff241393-5c37-418e-a12e-0cdeae63d4e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:18.406498 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-94eba4e8-dd22-4ec6-91a2-3b0d050e667e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:18.415250 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-94eba4e8-dd22-4ec6-91a2-3b0d050e667e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.157310 May 10 21:13:18.416021 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 319/613] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:18 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:18.420381 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-b0210026-ead5-4378-8d01-3cc840b67874 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:18.421346 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-b0210026-ead5-4378-8d01-3cc840b67874 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:18.427043 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b0210026-ead5-4378-8d01-3cc840b67874 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:18.427536 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b0210026-ead5-4378-8d01-3cc840b67874 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:18.428575 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b0210026-ead5-4378-8d01-3cc840b67874 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:18.429634 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b0210026-ead5-4378-8d01-3cc840b67874 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:18.452468 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.objects.instance [None req-ff241393-5c37-418e-a12e-0cdeae63d4e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lazy-loading 'services' on Instance uuid 688d836a-358b-4815-80e9-f43bd14f5f93 {{(pid=117714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:13:18.576291 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-b0210026-ead5-4378-8d01-3cc840b67874 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:18.583903 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-b0210026-ead5-4378-8d01-3cc840b67874 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.167042 May 10 21:13:18.584513 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 320/614] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:18 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:18.662495 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ff241393-5c37-418e-a12e-0cdeae63d4e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "DELETE /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments/19a60de6-9ee1-4e3a-90e8-e2cdb9747695" status: 202 len: 0 microversion: 2.20 time: 0.347770 May 10 21:13:18.663864 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 295/615] 10.222.0.49 () {60 vars in 1456 bytes} [Tue May 10 21:13:18 2022] DELETE /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments/19a60de6-9ee1-4e3a-90e8-e2cdb9747695 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 10 21:13:18.672085 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6cf2017c-e34d-4d80-90d6-f2e809a0494c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:18.673085 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6cf2017c-e34d-4d80-90d6-f2e809a0494c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:18.679713 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6cf2017c-e34d-4d80-90d6-f2e809a0494c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:18.680098 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6cf2017c-e34d-4d80-90d6-f2e809a0494c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:18.680863 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6cf2017c-e34d-4d80-90d6-f2e809a0494c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:18.681301 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6cf2017c-e34d-4d80-90d6-f2e809a0494c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:18.709828 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6cf2017c-e34d-4d80-90d6-f2e809a0494c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041629 May 10 21:13:18.710369 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 321/616] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:18 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:18.936600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-20975a06-28ec-4b7c-8a7a-a245cd132c3e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:18.937373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-20975a06-28ec-4b7c-8a7a-a245cd132c3e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:18.944139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20975a06-28ec-4b7c-8a7a-a245cd132c3e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:18.944739 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20975a06-28ec-4b7c-8a7a-a245cd132c3e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:18.945502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20975a06-28ec-4b7c-8a7a-a245cd132c3e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:18.945935 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20975a06-28ec-4b7c-8a7a-a245cd132c3e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:19.079269 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-20975a06-28ec-4b7c-8a7a-a245cd132c3e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:19.087020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-20975a06-28ec-4b7c-8a7a-a245cd132c3e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.155056 May 10 21:13:19.087610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 296/617] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:18 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:19.492300 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-554b4ce0-71c2-415d-a75e-f6ec9d1b38ca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:19.492921 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-554b4ce0-71c2-415d-a75e-f6ec9d1b38ca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:19.499338 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-554b4ce0-71c2-415d-a75e-f6ec9d1b38ca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:19.499790 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-554b4ce0-71c2-415d-a75e-f6ec9d1b38ca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:19.500557 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-554b4ce0-71c2-415d-a75e-f6ec9d1b38ca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:19.500997 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-554b4ce0-71c2-415d-a75e-f6ec9d1b38ca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:19.601817 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c4964f5f-e347-4428-8fe2-f3788f2e3243 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:19.602426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c4964f5f-e347-4428-8fe2-f3788f2e3243 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:19.608700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4964f5f-e347-4428-8fe2-f3788f2e3243 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:19.609499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4964f5f-e347-4428-8fe2-f3788f2e3243 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:19.610055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4964f5f-e347-4428-8fe2-f3788f2e3243 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:19.610496 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4964f5f-e347-4428-8fe2-f3788f2e3243 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:19.637325 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-554b4ce0-71c2-415d-a75e-f6ec9d1b38ca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:19.644746 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-554b4ce0-71c2-415d-a75e-f6ec9d1b38ca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.157447 May 10 21:13:19.645312 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 322/618] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:19 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:19.721544 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-cc5ae0ec-6c6d-470f-b87a-23ca8bbcb4bf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:19.722518 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-cc5ae0ec-6c6d-470f-b87a-23ca8bbcb4bf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:19.728966 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cc5ae0ec-6c6d-470f-b87a-23ca8bbcb4bf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:19.729418 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cc5ae0ec-6c6d-470f-b87a-23ca8bbcb4bf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:19.730189 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cc5ae0ec-6c6d-470f-b87a-23ca8bbcb4bf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:19.730630 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cc5ae0ec-6c6d-470f-b87a-23ca8bbcb4bf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:19.736008 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c4964f5f-e347-4428-8fe2-f3788f2e3243 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:19.744401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c4964f5f-e347-4428-8fe2-f3788f2e3243 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.147269 May 10 21:13:19.744910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 297/619] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:19 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:19.761724 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-cc5ae0ec-6c6d-470f-b87a-23ca8bbcb4bf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044175 May 10 21:13:19.762278 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 323/620] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:19 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:13:20.105038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bf9d6e24-4b5a-4666-839b-314396f84154 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:20.105656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bf9d6e24-4b5a-4666-839b-314396f84154 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:20.111804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf9d6e24-4b5a-4666-839b-314396f84154 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:20.112258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf9d6e24-4b5a-4666-839b-314396f84154 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:20.113025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf9d6e24-4b5a-4666-839b-314396f84154 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:20.113462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf9d6e24-4b5a-4666-839b-314396f84154 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:20.247215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bf9d6e24-4b5a-4666-839b-314396f84154 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:20.254635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bf9d6e24-4b5a-4666-839b-314396f84154 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.154486 May 10 21:13:20.255224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 298/621] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:20 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:20.661711 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-ce19c899-83b9-4551-9830-061b73307f40 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:20.662322 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-ce19c899-83b9-4551-9830-061b73307f40 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:20.669350 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ce19c899-83b9-4551-9830-061b73307f40 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:20.669794 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ce19c899-83b9-4551-9830-061b73307f40 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:20.670557 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ce19c899-83b9-4551-9830-061b73307f40 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:20.670986 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ce19c899-83b9-4551-9830-061b73307f40 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:20.761014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1e38028b-eb4e-41ed-b23d-40dff5c00957 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:20.761620 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1e38028b-eb4e-41ed-b23d-40dff5c00957 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:20.768233 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1e38028b-eb4e-41ed-b23d-40dff5c00957 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:20.768691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1e38028b-eb4e-41ed-b23d-40dff5c00957 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:20.769466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1e38028b-eb4e-41ed-b23d-40dff5c00957 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:20.769901 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1e38028b-eb4e-41ed-b23d-40dff5c00957 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:20.799731 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-ce19c899-83b9-4551-9830-061b73307f40 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:20.807968 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-ce19c899-83b9-4551-9830-061b73307f40 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.150101 May 10 21:13:20.808540 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 324/622] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:20 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:20.814027 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-ad7b9ccd-aa93-43f7-a6ba-5c476642e038 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:20.817214 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-ad7b9ccd-aa93-43f7-a6ba-5c476642e038 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:20.824099 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ad7b9ccd-aa93-43f7-a6ba-5c476642e038 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:20.824546 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ad7b9ccd-aa93-43f7-a6ba-5c476642e038 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:20.825318 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ad7b9ccd-aa93-43f7-a6ba-5c476642e038 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:20.825780 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ad7b9ccd-aa93-43f7-a6ba-5c476642e038 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:20.857025 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-ad7b9ccd-aa93-43f7-a6ba-5c476642e038 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047434 May 10 21:13:20.857609 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 325/623] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:20 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:20.902565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1e38028b-eb4e-41ed-b23d-40dff5c00957 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:20.909976 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1e38028b-eb4e-41ed-b23d-40dff5c00957 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.153284 May 10 21:13:20.910839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 299/624] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:20 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:21.272436 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-da583f1b-592a-4836-bcdb-86b4f7f3b276 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:21.273086 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-da583f1b-592a-4836-bcdb-86b4f7f3b276 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:21.279072 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-da583f1b-592a-4836-bcdb-86b4f7f3b276 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:21.279559 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-da583f1b-592a-4836-bcdb-86b4f7f3b276 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:21.280315 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-da583f1b-592a-4836-bcdb-86b4f7f3b276 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:21.280751 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-da583f1b-592a-4836-bcdb-86b4f7f3b276 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:21.411453 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-da583f1b-592a-4836-bcdb-86b4f7f3b276 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:21.419545 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-da583f1b-592a-4836-bcdb-86b4f7f3b276 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.151303 May 10 21:13:21.420102 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 326/625] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:21 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:21.825975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-22a66ea5-d3b4-4575-8638-4cf05eae130a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:21.826584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-22a66ea5-d3b4-4575-8638-4cf05eae130a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:21.833014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-22a66ea5-d3b4-4575-8638-4cf05eae130a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:21.833463 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-22a66ea5-d3b4-4575-8638-4cf05eae130a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:21.834228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-22a66ea5-d3b4-4575-8638-4cf05eae130a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:21.835359 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-22a66ea5-d3b4-4575-8638-4cf05eae130a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:21.871946 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c4ba631b-a1a3-4f3a-a9e3-1ba55c9ce90f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:21.872890 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c4ba631b-a1a3-4f3a-a9e3-1ba55c9ce90f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:21.879316 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c4ba631b-a1a3-4f3a-a9e3-1ba55c9ce90f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:21.879776 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c4ba631b-a1a3-4f3a-a9e3-1ba55c9ce90f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:21.888379 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c4ba631b-a1a3-4f3a-a9e3-1ba55c9ce90f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:21.888379 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c4ba631b-a1a3-4f3a-a9e3-1ba55c9ce90f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:21.912142 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c4ba631b-a1a3-4f3a-a9e3-1ba55c9ce90f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044022 May 10 21:13:21.912824 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 327/626] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:21 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:13:21.927149 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-3e5c6bb2-f816-45f8-9cc0-8f2cdb2f4ff3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:21.927756 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-3e5c6bb2-f816-45f8-9cc0-8f2cdb2f4ff3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:21.934305 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3e5c6bb2-f816-45f8-9cc0-8f2cdb2f4ff3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:21.934752 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3e5c6bb2-f816-45f8-9cc0-8f2cdb2f4ff3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:21.935635 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3e5c6bb2-f816-45f8-9cc0-8f2cdb2f4ff3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:21.936065 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3e5c6bb2-f816-45f8-9cc0-8f2cdb2f4ff3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:21.970631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-22a66ea5-d3b4-4575-8638-4cf05eae130a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:21.978378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-22a66ea5-d3b4-4575-8638-4cf05eae130a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.156254 May 10 21:13:21.978960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 300/627] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:21 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:22.065645 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-3e5c6bb2-f816-45f8-9cc0-8f2cdb2f4ff3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:22.073596 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-3e5c6bb2-f816-45f8-9cc0-8f2cdb2f4ff3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.150189 May 10 21:13:22.074148 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 328/628] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:21 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:22.437644 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-84d694ec-f740-4c3c-a97b-2f615ad85b65 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:22.438783 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-84d694ec-f740-4c3c-a97b-2f615ad85b65 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:22.445205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-84d694ec-f740-4c3c-a97b-2f615ad85b65 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:22.446018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-84d694ec-f740-4c3c-a97b-2f615ad85b65 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:22.446438 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-84d694ec-f740-4c3c-a97b-2f615ad85b65 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:22.446870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-84d694ec-f740-4c3c-a97b-2f615ad85b65 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:22.584178 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-84d694ec-f740-4c3c-a97b-2f615ad85b65 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:22.591980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-84d694ec-f740-4c3c-a97b-2f615ad85b65 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.158447 May 10 21:13:22.592549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 301/629] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:22 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:22.924060 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-60755418-9c12-4e23-a12a-e059863e7b69 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:22.925038 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-60755418-9c12-4e23-a12a-e059863e7b69 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:22.931840 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-60755418-9c12-4e23-a12a-e059863e7b69 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:22.932284 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-60755418-9c12-4e23-a12a-e059863e7b69 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:22.933047 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-60755418-9c12-4e23-a12a-e059863e7b69 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:22.933481 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-60755418-9c12-4e23-a12a-e059863e7b69 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:22.963269 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-60755418-9c12-4e23-a12a-e059863e7b69 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043134 May 10 21:13:22.963745 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 329/630] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:22 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:22.995698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-15a6f93a-9a15-4195-a8cf-c016f2ec9116 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:22.996347 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-15a6f93a-9a15-4195-a8cf-c016f2ec9116 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:23.002624 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-15a6f93a-9a15-4195-a8cf-c016f2ec9116 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:23.003081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-15a6f93a-9a15-4195-a8cf-c016f2ec9116 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:23.003881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-15a6f93a-9a15-4195-a8cf-c016f2ec9116 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:23.004325 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-15a6f93a-9a15-4195-a8cf-c016f2ec9116 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:23.091087 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-02080205-c389-43d0-a5f2-95d45ada5173 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:23.091832 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-02080205-c389-43d0-a5f2-95d45ada5173 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:23.097760 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-02080205-c389-43d0-a5f2-95d45ada5173 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:23.098290 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-02080205-c389-43d0-a5f2-95d45ada5173 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:23.099157 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-02080205-c389-43d0-a5f2-95d45ada5173 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:23.099604 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-02080205-c389-43d0-a5f2-95d45ada5173 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:23.134767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-15a6f93a-9a15-4195-a8cf-c016f2ec9116 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:23.142272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-15a6f93a-9a15-4195-a8cf-c016f2ec9116 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.150432 May 10 21:13:23.142837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 302/631] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:22 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:23.229820 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-02080205-c389-43d0-a5f2-95d45ada5173 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:23.237108 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-02080205-c389-43d0-a5f2-95d45ada5173 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.149866 May 10 21:13:23.237671 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 330/632] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:23 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:23.609661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-95061337-1886-4ce4-b585-d42d5b74f0a0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:23.610392 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-95061337-1886-4ce4-b585-d42d5b74f0a0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:23.617001 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-95061337-1886-4ce4-b585-d42d5b74f0a0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:23.617689 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-95061337-1886-4ce4-b585-d42d5b74f0a0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:23.618461 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-95061337-1886-4ce4-b585-d42d5b74f0a0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:23.618900 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-95061337-1886-4ce4-b585-d42d5b74f0a0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:23.749687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-95061337-1886-4ce4-b585-d42d5b74f0a0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:23.757544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-95061337-1886-4ce4-b585-d42d5b74f0a0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.151853 May 10 21:13:23.758109 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 303/633] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:23 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:23.973931 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-91a32c94-7cab-4df3-9892-86bcac29fbb7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:23.974899 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-91a32c94-7cab-4df3-9892-86bcac29fbb7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:23.982209 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-91a32c94-7cab-4df3-9892-86bcac29fbb7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:23.982659 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-91a32c94-7cab-4df3-9892-86bcac29fbb7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:23.983464 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-91a32c94-7cab-4df3-9892-86bcac29fbb7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:23.983905 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-91a32c94-7cab-4df3-9892-86bcac29fbb7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:24.013563 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-91a32c94-7cab-4df3-9892-86bcac29fbb7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043555 May 10 21:13:24.014045 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 331/634] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:23 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:24.159619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9de73dc5-7f68-4f81-9777-947304db9001 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:24.160265 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9de73dc5-7f68-4f81-9777-947304db9001 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:24.168185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9de73dc5-7f68-4f81-9777-947304db9001 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:24.168646 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9de73dc5-7f68-4f81-9777-947304db9001 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:24.169418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9de73dc5-7f68-4f81-9777-947304db9001 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:24.169857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9de73dc5-7f68-4f81-9777-947304db9001 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:24.254371 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-8a8f7834-f30e-4e07-901a-6af3c641c3cd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:24.254987 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-8a8f7834-f30e-4e07-901a-6af3c641c3cd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:24.261192 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8a8f7834-f30e-4e07-901a-6af3c641c3cd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:24.261648 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8a8f7834-f30e-4e07-901a-6af3c641c3cd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:24.262428 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8a8f7834-f30e-4e07-901a-6af3c641c3cd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:24.262876 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8a8f7834-f30e-4e07-901a-6af3c641c3cd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:24.307007 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9de73dc5-7f68-4f81-9777-947304db9001 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:24.314426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9de73dc5-7f68-4f81-9777-947304db9001 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.158689 May 10 21:13:24.315264 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 304/635] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:24 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:24.390668 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-8a8f7834-f30e-4e07-901a-6af3c641c3cd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:24.398808 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-8a8f7834-f30e-4e07-901a-6af3c641c3cd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.148417 May 10 21:13:24.399413 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 332/636] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:24 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:24.775580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-14fdeff1-6e07-44c5-abb1-22220c02c6ad tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:24.776199 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-14fdeff1-6e07-44c5-abb1-22220c02c6ad tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:24.784246 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-14fdeff1-6e07-44c5-abb1-22220c02c6ad tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:24.784246 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-14fdeff1-6e07-44c5-abb1-22220c02c6ad tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:24.784246 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-14fdeff1-6e07-44c5-abb1-22220c02c6ad tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:24.784246 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-14fdeff1-6e07-44c5-abb1-22220c02c6ad tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:24.911935 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-14fdeff1-6e07-44c5-abb1-22220c02c6ad tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:24.919472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-14fdeff1-6e07-44c5-abb1-22220c02c6ad tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.148466 May 10 21:13:24.920046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 305/637] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:24 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:25.025514 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c6672308-9bfe-4e60-826e-c26e1baff466 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:25.026470 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c6672308-9bfe-4e60-826e-c26e1baff466 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:25.033284 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c6672308-9bfe-4e60-826e-c26e1baff466 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:25.033727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c6672308-9bfe-4e60-826e-c26e1baff466 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:25.034488 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c6672308-9bfe-4e60-826e-c26e1baff466 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:25.034946 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c6672308-9bfe-4e60-826e-c26e1baff466 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:25.063652 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c6672308-9bfe-4e60-826e-c26e1baff466 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042715 May 10 21:13:25.064126 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 333/638] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:25 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:25.331855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4d512395-f036-4797-9ed3-a471f834dd68 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:25.332403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4d512395-f036-4797-9ed3-a471f834dd68 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:25.338807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4d512395-f036-4797-9ed3-a471f834dd68 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:25.339293 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4d512395-f036-4797-9ed3-a471f834dd68 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:25.340057 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4d512395-f036-4797-9ed3-a471f834dd68 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:25.340494 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4d512395-f036-4797-9ed3-a471f834dd68 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:25.416468 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9ec28a32-8df6-46f8-bde0-a5a961834c55 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:25.417071 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-9ec28a32-8df6-46f8-bde0-a5a961834c55 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:25.423074 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9ec28a32-8df6-46f8-bde0-a5a961834c55 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:25.423554 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9ec28a32-8df6-46f8-bde0-a5a961834c55 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:25.424368 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9ec28a32-8df6-46f8-bde0-a5a961834c55 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:25.424799 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9ec28a32-8df6-46f8-bde0-a5a961834c55 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:25.473794 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4d512395-f036-4797-9ed3-a471f834dd68 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:25.481749 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4d512395-f036-4797-9ed3-a471f834dd68 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.153819 May 10 21:13:25.482312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 306/639] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:25 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:25.560960 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-9ec28a32-8df6-46f8-bde0-a5a961834c55 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:25.568583 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9ec28a32-8df6-46f8-bde0-a5a961834c55 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.156553 May 10 21:13:25.569172 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 334/640] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:25 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:25.935923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e503bbd2-5490-40a5-92c3-4fa69d7b6b21 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:25.936531 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e503bbd2-5490-40a5-92c3-4fa69d7b6b21 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:25.942772 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e503bbd2-5490-40a5-92c3-4fa69d7b6b21 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:25.943249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e503bbd2-5490-40a5-92c3-4fa69d7b6b21 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:25.944901 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e503bbd2-5490-40a5-92c3-4fa69d7b6b21 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:25.945365 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e503bbd2-5490-40a5-92c3-4fa69d7b6b21 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:26.075028 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e503bbd2-5490-40a5-92c3-4fa69d7b6b21 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:26.076683 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9a81c4a4-cfc7-48bd-bbef-110d93ce5842 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:26.077624 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-9a81c4a4-cfc7-48bd-bbef-110d93ce5842 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:26.082768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e503bbd2-5490-40a5-92c3-4fa69d7b6b21 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.150797 May 10 21:13:26.083430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 307/641] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:25 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:26.086347 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9a81c4a4-cfc7-48bd-bbef-110d93ce5842 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:26.086799 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9a81c4a4-cfc7-48bd-bbef-110d93ce5842 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:26.087613 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9a81c4a4-cfc7-48bd-bbef-110d93ce5842 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:26.088057 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9a81c4a4-cfc7-48bd-bbef-110d93ce5842 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:26.118922 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9a81c4a4-cfc7-48bd-bbef-110d93ce5842 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046069 May 10 21:13:26.119430 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 335/642] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:26 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:13:26.499661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8f251b7a-842e-4561-b799-5560096cb286 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:26.500201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8f251b7a-842e-4561-b799-5560096cb286 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:26.506588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8f251b7a-842e-4561-b799-5560096cb286 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:26.507073 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8f251b7a-842e-4561-b799-5560096cb286 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:26.507864 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8f251b7a-842e-4561-b799-5560096cb286 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:26.508303 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8f251b7a-842e-4561-b799-5560096cb286 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:26.585555 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-b457fe94-0d37-495f-97eb-1ecce86ee6bb tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:26.586187 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-b457fe94-0d37-495f-97eb-1ecce86ee6bb tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:26.592103 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b457fe94-0d37-495f-97eb-1ecce86ee6bb tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:26.592620 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b457fe94-0d37-495f-97eb-1ecce86ee6bb tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:26.593393 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b457fe94-0d37-495f-97eb-1ecce86ee6bb tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:26.593826 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b457fe94-0d37-495f-97eb-1ecce86ee6bb tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:26.643366 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8f251b7a-842e-4561-b799-5560096cb286 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:26.651466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8f251b7a-842e-4561-b799-5560096cb286 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.155818 May 10 21:13:26.652039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 308/643] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:26 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:26.724601 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-b457fe94-0d37-495f-97eb-1ecce86ee6bb tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:26.732613 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-b457fe94-0d37-495f-97eb-1ecce86ee6bb tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.151448 May 10 21:13:26.733180 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 336/644] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:26 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:27.100002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a973c77a-f964-43e3-bb3d-f75a4a0c6cfd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:27.100652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a973c77a-f964-43e3-bb3d-f75a4a0c6cfd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:27.106842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a973c77a-f964-43e3-bb3d-f75a4a0c6cfd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:27.107322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a973c77a-f964-43e3-bb3d-f75a4a0c6cfd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:27.108086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a973c77a-f964-43e3-bb3d-f75a4a0c6cfd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:27.108519 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a973c77a-f964-43e3-bb3d-f75a4a0c6cfd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:27.129984 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a79ffdd0-76a6-4145-947d-1dacb609f7e8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:27.130844 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a79ffdd0-76a6-4145-947d-1dacb609f7e8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:27.138026 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a79ffdd0-76a6-4145-947d-1dacb609f7e8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:27.138478 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a79ffdd0-76a6-4145-947d-1dacb609f7e8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:27.139294 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a79ffdd0-76a6-4145-947d-1dacb609f7e8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:27.139740 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a79ffdd0-76a6-4145-947d-1dacb609f7e8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:27.169699 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a79ffdd0-76a6-4145-947d-1dacb609f7e8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043680 May 10 21:13:27.170272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 337/645] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:27 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:27.234624 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a973c77a-f964-43e3-bb3d-f75a4a0c6cfd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:27.241948 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a973c77a-f964-43e3-bb3d-f75a4a0c6cfd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.145751 May 10 21:13:27.242510 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 309/646] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:27 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:27.669951 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-647588c5-1857-4666-9737-30621783d493 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:27.670498 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-647588c5-1857-4666-9737-30621783d493 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:27.676492 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-647588c5-1857-4666-9737-30621783d493 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:27.676944 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-647588c5-1857-4666-9737-30621783d493 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:27.677701 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-647588c5-1857-4666-9737-30621783d493 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:27.678794 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-647588c5-1857-4666-9737-30621783d493 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:27.749442 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-656db9c9-7515-4e80-9cd7-7ca93d8ad75c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:27.750272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-656db9c9-7515-4e80-9cd7-7ca93d8ad75c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:27.760047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-656db9c9-7515-4e80-9cd7-7ca93d8ad75c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:27.760047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-656db9c9-7515-4e80-9cd7-7ca93d8ad75c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:27.760047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-656db9c9-7515-4e80-9cd7-7ca93d8ad75c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:27.760047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-656db9c9-7515-4e80-9cd7-7ca93d8ad75c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:27.810877 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-647588c5-1857-4666-9737-30621783d493 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:27.818616 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-647588c5-1857-4666-9737-30621783d493 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.152619 May 10 21:13:27.819332 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 338/647] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:27 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:27.893747 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-656db9c9-7515-4e80-9cd7-7ca93d8ad75c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:27.901071 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-656db9c9-7515-4e80-9cd7-7ca93d8ad75c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.155457 May 10 21:13:27.901642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 310/648] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:27 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:28.181101 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d82df515-2c01-4f7f-bb5b-ea8100462acf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:28.181944 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d82df515-2c01-4f7f-bb5b-ea8100462acf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:28.188550 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d82df515-2c01-4f7f-bb5b-ea8100462acf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:28.188998 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d82df515-2c01-4f7f-bb5b-ea8100462acf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:28.190014 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d82df515-2c01-4f7f-bb5b-ea8100462acf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:28.190478 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d82df515-2c01-4f7f-bb5b-ea8100462acf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:28.219663 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d82df515-2c01-4f7f-bb5b-ea8100462acf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042343 May 10 21:13:28.220207 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 339/649] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:28 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:28.258758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6bf5dacc-0a40-4049-b00e-2cb5a818a814 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:28.259469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6bf5dacc-0a40-4049-b00e-2cb5a818a814 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:28.265382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6bf5dacc-0a40-4049-b00e-2cb5a818a814 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:28.265839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6bf5dacc-0a40-4049-b00e-2cb5a818a814 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:28.266612 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6bf5dacc-0a40-4049-b00e-2cb5a818a814 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:28.267053 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6bf5dacc-0a40-4049-b00e-2cb5a818a814 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:28.391410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6bf5dacc-0a40-4049-b00e-2cb5a818a814 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:28.399810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6bf5dacc-0a40-4049-b00e-2cb5a818a814 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.144874 May 10 21:13:28.400379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 311/650] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:28 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:28.835851 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d3be2f81-551f-4c12-939e-290259abeea3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:28.836465 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d3be2f81-551f-4c12-939e-290259abeea3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:28.842292 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d3be2f81-551f-4c12-939e-290259abeea3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:28.842775 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d3be2f81-551f-4c12-939e-290259abeea3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:28.843528 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d3be2f81-551f-4c12-939e-290259abeea3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:28.843963 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d3be2f81-551f-4c12-939e-290259abeea3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:28.918238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-32f559ad-32df-48d2-ada4-f07dac6af85a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:28.918844 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-32f559ad-32df-48d2-ada4-f07dac6af85a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:28.925474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-32f559ad-32df-48d2-ada4-f07dac6af85a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:28.928601 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-32f559ad-32df-48d2-ada4-f07dac6af85a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:28.928601 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-32f559ad-32df-48d2-ada4-f07dac6af85a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:28.928601 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-32f559ad-32df-48d2-ada4-f07dac6af85a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:28.978306 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-d3be2f81-551f-4c12-939e-290259abeea3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:28.985877 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d3be2f81-551f-4c12-939e-290259abeea3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.154135 May 10 21:13:28.986751 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 340/651] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:28 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:29.061654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-32f559ad-32df-48d2-ada4-f07dac6af85a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:29.069155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-32f559ad-32df-48d2-ada4-f07dac6af85a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.154820 May 10 21:13:29.069714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 312/652] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:28 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:29.232088 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-fc794f61-0f21-420d-8f0b-892d085d236a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:29.233010 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-fc794f61-0f21-420d-8f0b-892d085d236a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:29.239531 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fc794f61-0f21-420d-8f0b-892d085d236a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:29.239977 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fc794f61-0f21-420d-8f0b-892d085d236a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:29.240747 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fc794f61-0f21-420d-8f0b-892d085d236a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:29.241184 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fc794f61-0f21-420d-8f0b-892d085d236a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:29.270311 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-fc794f61-0f21-420d-8f0b-892d085d236a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042389 May 10 21:13:29.270852 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 341/653] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:29 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:29.417494 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9af04f5e-d70b-4c04-8e25-f23c0570249b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:29.418172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9af04f5e-d70b-4c04-8e25-f23c0570249b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:29.423948 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9af04f5e-d70b-4c04-8e25-f23c0570249b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:29.431682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9af04f5e-d70b-4c04-8e25-f23c0570249b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:29.431682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9af04f5e-d70b-4c04-8e25-f23c0570249b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:29.431682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9af04f5e-d70b-4c04-8e25-f23c0570249b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:29.558538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9af04f5e-d70b-4c04-8e25-f23c0570249b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:29.566173 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9af04f5e-d70b-4c04-8e25-f23c0570249b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.153194 May 10 21:13:29.566743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 313/654] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:29 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:30.004188 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-dd6573dc-2387-47d4-b4a8-b0e22116b2f6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:30.004798 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-dd6573dc-2387-47d4-b4a8-b0e22116b2f6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:30.011380 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-dd6573dc-2387-47d4-b4a8-b0e22116b2f6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:30.011834 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-dd6573dc-2387-47d4-b4a8-b0e22116b2f6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:30.012635 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-dd6573dc-2387-47d4-b4a8-b0e22116b2f6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:30.013081 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-dd6573dc-2387-47d4-b4a8-b0e22116b2f6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:30.086533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9c2dc08a-cc59-4dad-aa6a-090e821f9a7a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:30.087349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9c2dc08a-cc59-4dad-aa6a-090e821f9a7a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:30.094253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c2dc08a-cc59-4dad-aa6a-090e821f9a7a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:30.094503 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c2dc08a-cc59-4dad-aa6a-090e821f9a7a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:30.095541 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c2dc08a-cc59-4dad-aa6a-090e821f9a7a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:30.095939 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c2dc08a-cc59-4dad-aa6a-090e821f9a7a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:30.147021 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-dd6573dc-2387-47d4-b4a8-b0e22116b2f6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:30.155020 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-dd6573dc-2387-47d4-b4a8-b0e22116b2f6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.154733 May 10 21:13:30.155637 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 342/655] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:29 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:30.233720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9c2dc08a-cc59-4dad-aa6a-090e821f9a7a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:30.240970 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9c2dc08a-cc59-4dad-aa6a-090e821f9a7a tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.159107 May 10 21:13:30.241533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 314/656] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:30 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:30.281879 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a4acaf6d-8422-47d0-aed9-e1db43d938ed tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:30.282846 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a4acaf6d-8422-47d0-aed9-e1db43d938ed tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:30.289733 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a4acaf6d-8422-47d0-aed9-e1db43d938ed tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:30.290184 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a4acaf6d-8422-47d0-aed9-e1db43d938ed tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:30.290959 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a4acaf6d-8422-47d0-aed9-e1db43d938ed tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:30.291433 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a4acaf6d-8422-47d0-aed9-e1db43d938ed tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:30.324270 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a4acaf6d-8422-47d0-aed9-e1db43d938ed tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042433 May 10 21:13:30.324270 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 343/657] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:30 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:30.584160 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-191a129d-9388-493c-8679-5fc25699bb14 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:30.584745 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-191a129d-9388-493c-8679-5fc25699bb14 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:30.591445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-191a129d-9388-493c-8679-5fc25699bb14 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:30.591895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-191a129d-9388-493c-8679-5fc25699bb14 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:30.592653 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-191a129d-9388-493c-8679-5fc25699bb14 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:30.593088 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-191a129d-9388-493c-8679-5fc25699bb14 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:30.730627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-191a129d-9388-493c-8679-5fc25699bb14 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:30.737921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-191a129d-9388-493c-8679-5fc25699bb14 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.157718 May 10 21:13:30.738487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 315/658] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:30 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:31.172821 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-280e972d-4e06-4f0f-a0aa-bc6cf7db3848 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:31.173357 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-280e972d-4e06-4f0f-a0aa-bc6cf7db3848 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:31.180052 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-280e972d-4e06-4f0f-a0aa-bc6cf7db3848 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:31.180507 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-280e972d-4e06-4f0f-a0aa-bc6cf7db3848 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:31.181261 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-280e972d-4e06-4f0f-a0aa-bc6cf7db3848 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:31.181692 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-280e972d-4e06-4f0f-a0aa-bc6cf7db3848 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:31.259061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-05d7de0e-5bf1-4f5f-90cc-f8b8912002a9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:31.259702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-05d7de0e-5bf1-4f5f-90cc-f8b8912002a9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:31.266257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-05d7de0e-5bf1-4f5f-90cc-f8b8912002a9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:31.266705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-05d7de0e-5bf1-4f5f-90cc-f8b8912002a9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:31.267507 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-05d7de0e-5bf1-4f5f-90cc-f8b8912002a9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:31.267952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-05d7de0e-5bf1-4f5f-90cc-f8b8912002a9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:31.310987 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-280e972d-4e06-4f0f-a0aa-bc6cf7db3848 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:31.318689 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-280e972d-4e06-4f0f-a0aa-bc6cf7db3848 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.149751 May 10 21:13:31.319281 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 344/659] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:31 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:31.333767 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-0fd5187b-f384-4f93-bc9d-51240b9a5237 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:31.334694 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-0fd5187b-f384-4f93-bc9d-51240b9a5237 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:31.341098 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0fd5187b-f384-4f93-bc9d-51240b9a5237 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:31.341542 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0fd5187b-f384-4f93-bc9d-51240b9a5237 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:31.342307 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0fd5187b-f384-4f93-bc9d-51240b9a5237 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:31.342744 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0fd5187b-f384-4f93-bc9d-51240b9a5237 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:31.371985 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-0fd5187b-f384-4f93-bc9d-51240b9a5237 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041996 May 10 21:13:31.372552 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 345/660] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:31 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:13:31.397923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-05d7de0e-5bf1-4f5f-90cc-f8b8912002a9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:31.405338 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-05d7de0e-5bf1-4f5f-90cc-f8b8912002a9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.150961 May 10 21:13:31.405906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 316/661] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:31 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:31.754309 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-ceb16204-edac-4faf-a7e8-82d6a774f838 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:31.754916 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-ceb16204-edac-4faf-a7e8-82d6a774f838 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:31.760959 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ceb16204-edac-4faf-a7e8-82d6a774f838 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:31.761405 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ceb16204-edac-4faf-a7e8-82d6a774f838 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:31.762159 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ceb16204-edac-4faf-a7e8-82d6a774f838 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:31.762592 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ceb16204-edac-4faf-a7e8-82d6a774f838 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:31.895522 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-ceb16204-edac-4faf-a7e8-82d6a774f838 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:31.903876 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-ceb16204-edac-4faf-a7e8-82d6a774f838 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.153380 May 10 21:13:31.904445 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 346/662] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:31 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:32.337224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-233fad17-743a-40dc-84c9-ff1be9379961 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:32.337837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-233fad17-743a-40dc-84c9-ff1be9379961 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:32.344224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-233fad17-743a-40dc-84c9-ff1be9379961 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:32.344672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-233fad17-743a-40dc-84c9-ff1be9379961 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:32.345434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-233fad17-743a-40dc-84c9-ff1be9379961 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:32.345872 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-233fad17-743a-40dc-84c9-ff1be9379961 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:32.384302 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9c0198a5-1173-4745-bf09-088fc1b82cb4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:32.385426 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-9c0198a5-1173-4745-bf09-088fc1b82cb4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:32.392051 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9c0198a5-1173-4745-bf09-088fc1b82cb4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:32.392508 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9c0198a5-1173-4745-bf09-088fc1b82cb4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:32.393286 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9c0198a5-1173-4745-bf09-088fc1b82cb4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:32.393729 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9c0198a5-1173-4745-bf09-088fc1b82cb4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:32.423833 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9c0198a5-1173-4745-bf09-088fc1b82cb4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044204 May 10 21:13:32.424415 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 347/663] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:32 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:13:32.428776 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-803aa112-5208-4fb4-9822-529a389d23d9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:32.429436 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-803aa112-5208-4fb4-9822-529a389d23d9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:32.435266 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-803aa112-5208-4fb4-9822-529a389d23d9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:32.435728 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-803aa112-5208-4fb4-9822-529a389d23d9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:32.436508 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-803aa112-5208-4fb4-9822-529a389d23d9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:32.436949 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-803aa112-5208-4fb4-9822-529a389d23d9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:32.476544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-233fad17-743a-40dc-84c9-ff1be9379961 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:32.484111 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-233fad17-743a-40dc-84c9-ff1be9379961 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.151299 May 10 21:13:32.484696 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 317/664] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:32 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:32.566625 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-803aa112-5208-4fb4-9822-529a389d23d9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:32.574797 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-803aa112-5208-4fb4-9822-529a389d23d9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.149447 May 10 21:13:32.575410 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 348/665] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:32 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:32.920982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5d06c848-1669-4ca2-b054-c7a21ada4eb0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:32.921591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5d06c848-1669-4ca2-b054-c7a21ada4eb0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:32.927541 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5d06c848-1669-4ca2-b054-c7a21ada4eb0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:32.927988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5d06c848-1669-4ca2-b054-c7a21ada4eb0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:32.928871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5d06c848-1669-4ca2-b054-c7a21ada4eb0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:32.929407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5d06c848-1669-4ca2-b054-c7a21ada4eb0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:33.061512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5d06c848-1669-4ca2-b054-c7a21ada4eb0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:33.069098 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5d06c848-1669-4ca2-b054-c7a21ada4eb0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.152017 May 10 21:13:33.069664 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 318/666] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:32 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:33.436205 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-1e547943-ee32-4d48-8235-2cbe41a2fa82 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:33.436969 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-1e547943-ee32-4d48-8235-2cbe41a2fa82 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:33.443643 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1e547943-ee32-4d48-8235-2cbe41a2fa82 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:33.444096 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1e547943-ee32-4d48-8235-2cbe41a2fa82 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:33.444895 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1e547943-ee32-4d48-8235-2cbe41a2fa82 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:33.446589 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1e547943-ee32-4d48-8235-2cbe41a2fa82 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:33.477138 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-1e547943-ee32-4d48-8235-2cbe41a2fa82 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044935 May 10 21:13:33.477899 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 349/667] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:33 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:33.501328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dca55da3-f2c6-4c0e-b894-502350fca806 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:33.501980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dca55da3-f2c6-4c0e-b894-502350fca806 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:33.509104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dca55da3-f2c6-4c0e-b894-502350fca806 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:33.509514 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dca55da3-f2c6-4c0e-b894-502350fca806 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:33.510315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dca55da3-f2c6-4c0e-b894-502350fca806 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:33.510747 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dca55da3-f2c6-4c0e-b894-502350fca806 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:33.591665 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-56de7031-7a5b-44e1-9d92-2f8a7d192edd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:33.592272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-56de7031-7a5b-44e1-9d92-2f8a7d192edd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:33.598387 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-56de7031-7a5b-44e1-9d92-2f8a7d192edd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:33.599039 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-56de7031-7a5b-44e1-9d92-2f8a7d192edd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:33.600163 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-56de7031-7a5b-44e1-9d92-2f8a7d192edd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:33.600612 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-56de7031-7a5b-44e1-9d92-2f8a7d192edd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:33.640432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dca55da3-f2c6-4c0e-b894-502350fca806 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:33.647897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dca55da3-f2c6-4c0e-b894-502350fca806 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.150534 May 10 21:13:33.648961 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 319/668] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:33 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:33.730681 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-56de7031-7a5b-44e1-9d92-2f8a7d192edd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:33.737974 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-56de7031-7a5b-44e1-9d92-2f8a7d192edd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.150121 May 10 21:13:33.738538 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 350/669] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:33 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:34.086274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c690055c-2033-4ec8-a64f-6f09c6f7964d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:34.086885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c690055c-2033-4ec8-a64f-6f09c6f7964d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:34.092758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c690055c-2033-4ec8-a64f-6f09c6f7964d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:34.093207 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c690055c-2033-4ec8-a64f-6f09c6f7964d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:34.093996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c690055c-2033-4ec8-a64f-6f09c6f7964d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:34.094454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c690055c-2033-4ec8-a64f-6f09c6f7964d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:34.227073 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c690055c-2033-4ec8-a64f-6f09c6f7964d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:34.234511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c690055c-2033-4ec8-a64f-6f09c6f7964d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.152189 May 10 21:13:34.235075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 320/670] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:34 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:34.488220 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-20e66c42-efff-4fdf-ab83-97fa5c74f0d2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:34.489141 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-20e66c42-efff-4fdf-ab83-97fa5c74f0d2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:34.495802 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-20e66c42-efff-4fdf-ab83-97fa5c74f0d2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:34.496244 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-20e66c42-efff-4fdf-ab83-97fa5c74f0d2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:34.497003 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-20e66c42-efff-4fdf-ab83-97fa5c74f0d2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:34.497441 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-20e66c42-efff-4fdf-ab83-97fa5c74f0d2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:34.525513 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-20e66c42-efff-4fdf-ab83-97fa5c74f0d2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041247 May 10 21:13:34.526065 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 351/671] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:34 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:34.665387 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0209b42d-f46e-4bce-94ec-692f21fd635e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:34.666002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0209b42d-f46e-4bce-94ec-692f21fd635e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:34.672382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0209b42d-f46e-4bce-94ec-692f21fd635e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:34.672839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0209b42d-f46e-4bce-94ec-692f21fd635e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:34.673601 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0209b42d-f46e-4bce-94ec-692f21fd635e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:34.674035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0209b42d-f46e-4bce-94ec-692f21fd635e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:34.755397 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-2c98f365-c03b-4f2d-80e2-75fbeb6f72dd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:34.756036 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-2c98f365-c03b-4f2d-80e2-75fbeb6f72dd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:34.762787 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2c98f365-c03b-4f2d-80e2-75fbeb6f72dd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:34.763278 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2c98f365-c03b-4f2d-80e2-75fbeb6f72dd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:34.764047 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2c98f365-c03b-4f2d-80e2-75fbeb6f72dd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:34.764480 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2c98f365-c03b-4f2d-80e2-75fbeb6f72dd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:34.804259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0209b42d-f46e-4bce-94ec-692f21fd635e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:34.811647 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0209b42d-f46e-4bce-94ec-692f21fd635e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.150745 May 10 21:13:34.812210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 321/672] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:34 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:34.893404 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-2c98f365-c03b-4f2d-80e2-75fbeb6f72dd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:34.900841 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-2c98f365-c03b-4f2d-80e2-75fbeb6f72dd tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.149351 May 10 21:13:34.901423 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 352/673] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:34 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:35.252438 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a0fa447e-ae60-4afa-b87b-47c410fde628 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:35.253045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a0fa447e-ae60-4afa-b87b-47c410fde628 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:35.258987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0fa447e-ae60-4afa-b87b-47c410fde628 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:35.259463 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0fa447e-ae60-4afa-b87b-47c410fde628 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:35.260221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0fa447e-ae60-4afa-b87b-47c410fde628 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:35.260645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0fa447e-ae60-4afa-b87b-47c410fde628 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:35.388943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a0fa447e-ae60-4afa-b87b-47c410fde628 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:35.396166 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a0fa447e-ae60-4afa-b87b-47c410fde628 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.147502 May 10 21:13:35.396724 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 322/674] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:35 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:35.537249 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-14a04165-24c5-4239-8d30-fa110ca58079 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:35.538180 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-14a04165-24c5-4239-8d30-fa110ca58079 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:35.545224 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-14a04165-24c5-4239-8d30-fa110ca58079 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:35.545678 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-14a04165-24c5-4239-8d30-fa110ca58079 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:35.546448 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-14a04165-24c5-4239-8d30-fa110ca58079 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:35.546888 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-14a04165-24c5-4239-8d30-fa110ca58079 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:35.575654 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-14a04165-24c5-4239-8d30-fa110ca58079 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042341 May 10 21:13:35.576205 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 353/675] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:35 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:35.829005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dcbdebab-a15b-49b2-8c14-86d364c67c78 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:35.829620 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dcbdebab-a15b-49b2-8c14-86d364c67c78 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:35.836665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dcbdebab-a15b-49b2-8c14-86d364c67c78 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:35.844549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dcbdebab-a15b-49b2-8c14-86d364c67c78 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:35.844549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dcbdebab-a15b-49b2-8c14-86d364c67c78 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:35.844549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dcbdebab-a15b-49b2-8c14-86d364c67c78 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:35.918072 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6d4f0091-ef78-4a41-844d-d918a3c2dffe tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:35.918727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6d4f0091-ef78-4a41-844d-d918a3c2dffe tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:35.925559 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6d4f0091-ef78-4a41-844d-d918a3c2dffe tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:35.926016 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6d4f0091-ef78-4a41-844d-d918a3c2dffe tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:35.926793 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6d4f0091-ef78-4a41-844d-d918a3c2dffe tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:35.927263 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6d4f0091-ef78-4a41-844d-d918a3c2dffe tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:35.971921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dcbdebab-a15b-49b2-8c14-86d364c67c78 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:35.988846 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dcbdebab-a15b-49b2-8c14-86d364c67c78 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.163622 May 10 21:13:35.993521 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 323/676] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:35 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:36.059231 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-6d4f0091-ef78-4a41-844d-d918a3c2dffe tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:36.067294 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6d4f0091-ef78-4a41-844d-d918a3c2dffe tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.153213 May 10 21:13:36.068018 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 354/677] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:35 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:36.414054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-13615730-ca6b-4842-9aed-cb22a414e939 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:36.414924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-13615730-ca6b-4842-9aed-cb22a414e939 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:36.420885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-13615730-ca6b-4842-9aed-cb22a414e939 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:36.421275 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-13615730-ca6b-4842-9aed-cb22a414e939 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:36.422028 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-13615730-ca6b-4842-9aed-cb22a414e939 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:36.422461 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-13615730-ca6b-4842-9aed-cb22a414e939 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:36.547457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-13615730-ca6b-4842-9aed-cb22a414e939 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:36.555266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-13615730-ca6b-4842-9aed-cb22a414e939 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.145288 May 10 21:13:36.555828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 324/678] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:36 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:36.587936 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-618f3c31-48d4-4c56-8476-08da4703472a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:36.588854 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-618f3c31-48d4-4c56-8476-08da4703472a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:36.594765 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-618f3c31-48d4-4c56-8476-08da4703472a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:36.595252 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-618f3c31-48d4-4c56-8476-08da4703472a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:36.596028 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-618f3c31-48d4-4c56-8476-08da4703472a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:36.596474 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-618f3c31-48d4-4c56-8476-08da4703472a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:36.626642 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-618f3c31-48d4-4c56-8476-08da4703472a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042857 May 10 21:13:36.627224 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 355/679] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:36 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:37.005795 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-759bf241-ec77-48fd-a366-a44444013020 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:37.006386 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-759bf241-ec77-48fd-a366-a44444013020 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:37.012858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-759bf241-ec77-48fd-a366-a44444013020 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:37.013301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-759bf241-ec77-48fd-a366-a44444013020 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:37.014059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-759bf241-ec77-48fd-a366-a44444013020 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:37.014490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-759bf241-ec77-48fd-a366-a44444013020 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:37.085015 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-815c5f90-c539-41c9-a217-f81ff9a54569 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:37.086403 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-815c5f90-c539-41c9-a217-f81ff9a54569 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:37.092661 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-815c5f90-c539-41c9-a217-f81ff9a54569 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:37.093114 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-815c5f90-c539-41c9-a217-f81ff9a54569 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:37.093885 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-815c5f90-c539-41c9-a217-f81ff9a54569 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:37.094323 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-815c5f90-c539-41c9-a217-f81ff9a54569 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:37.154224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-759bf241-ec77-48fd-a366-a44444013020 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:37.163485 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-759bf241-ec77-48fd-a366-a44444013020 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.161494 May 10 21:13:37.165269 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 325/680] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:37 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:37.235565 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-815c5f90-c539-41c9-a217-f81ff9a54569 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:37.243185 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-815c5f90-c539-41c9-a217-f81ff9a54569 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.161950 May 10 21:13:37.243741 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 356/681] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:37 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:37.572963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7c0dc0bc-47ec-47f1-a48d-0cc3739d279f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:37.573536 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7c0dc0bc-47ec-47f1-a48d-0cc3739d279f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:37.579550 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c0dc0bc-47ec-47f1-a48d-0cc3739d279f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:37.580051 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c0dc0bc-47ec-47f1-a48d-0cc3739d279f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:37.580822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c0dc0bc-47ec-47f1-a48d-0cc3739d279f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:37.581263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c0dc0bc-47ec-47f1-a48d-0cc3739d279f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:37.639202 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-5af9d5c2-d4a3-459a-8cf2-898278098dfb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:37.640275 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5af9d5c2-d4a3-459a-8cf2-898278098dfb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:37.646013 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5af9d5c2-d4a3-459a-8cf2-898278098dfb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:37.646461 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5af9d5c2-d4a3-459a-8cf2-898278098dfb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:37.647257 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5af9d5c2-d4a3-459a-8cf2-898278098dfb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:37.647694 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5af9d5c2-d4a3-459a-8cf2-898278098dfb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:37.677284 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-5af9d5c2-d4a3-459a-8cf2-898278098dfb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042224 May 10 21:13:37.677858 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 357/682] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:37 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:13:37.712687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7c0dc0bc-47ec-47f1-a48d-0cc3739d279f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:37.720369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7c0dc0bc-47ec-47f1-a48d-0cc3739d279f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.151982 May 10 21:13:37.720941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 326/683] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:37 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:38.182308 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c2cf23f2-72bf-4bbd-b873-6b5ae25ad742 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:38.182920 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c2cf23f2-72bf-4bbd-b873-6b5ae25ad742 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:38.189223 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c2cf23f2-72bf-4bbd-b873-6b5ae25ad742 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:38.189673 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c2cf23f2-72bf-4bbd-b873-6b5ae25ad742 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:38.190688 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c2cf23f2-72bf-4bbd-b873-6b5ae25ad742 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:38.191148 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c2cf23f2-72bf-4bbd-b873-6b5ae25ad742 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:38.260243 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-677c9a41-28ce-4c50-828a-ecfba8d8f7ab tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:38.260994 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-677c9a41-28ce-4c50-828a-ecfba8d8f7ab tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:38.271263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-677c9a41-28ce-4c50-828a-ecfba8d8f7ab tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:38.271576 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-677c9a41-28ce-4c50-828a-ecfba8d8f7ab tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:38.272502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-677c9a41-28ce-4c50-828a-ecfba8d8f7ab tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:38.272966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-677c9a41-28ce-4c50-828a-ecfba8d8f7ab tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:38.330562 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-c2cf23f2-72bf-4bbd-b873-6b5ae25ad742 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:38.338649 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c2cf23f2-72bf-4bbd-b873-6b5ae25ad742 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.160802 May 10 21:13:38.339231 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 358/684] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:38 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:38.407683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-677c9a41-28ce-4c50-828a-ecfba8d8f7ab tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:38.416182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-677c9a41-28ce-4c50-828a-ecfba8d8f7ab tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.160059 May 10 21:13:38.416765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 327/685] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:38 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:38.688457 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-3e480002-cf6b-44bd-9e42-1684d5a08f48 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:38.689318 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-3e480002-cf6b-44bd-9e42-1684d5a08f48 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:38.695846 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3e480002-cf6b-44bd-9e42-1684d5a08f48 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:38.696293 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3e480002-cf6b-44bd-9e42-1684d5a08f48 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:38.697064 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3e480002-cf6b-44bd-9e42-1684d5a08f48 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:38.697503 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3e480002-cf6b-44bd-9e42-1684d5a08f48 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:38.727103 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-3e480002-cf6b-44bd-9e42-1684d5a08f48 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042008 May 10 21:13:38.727880 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 359/686] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:38 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:13:38.737342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-da00d880-a4f9-40ca-880f-0d8a89a0a2a0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:38.737957 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-da00d880-a4f9-40ca-880f-0d8a89a0a2a0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:38.744034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-da00d880-a4f9-40ca-880f-0d8a89a0a2a0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:38.744490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-da00d880-a4f9-40ca-880f-0d8a89a0a2a0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:38.745259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-da00d880-a4f9-40ca-880f-0d8a89a0a2a0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:38.745697 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-da00d880-a4f9-40ca-880f-0d8a89a0a2a0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:38.871542 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-da00d880-a4f9-40ca-880f-0d8a89a0a2a0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:38.878873 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-da00d880-a4f9-40ca-880f-0d8a89a0a2a0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.145489 May 10 21:13:38.879476 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 328/687] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:38 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:39.356139 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c690cd09-9d5a-4aba-92c8-56c446c8a142 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:39.356753 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c690cd09-9d5a-4aba-92c8-56c446c8a142 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:39.363080 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c690cd09-9d5a-4aba-92c8-56c446c8a142 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:39.363566 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c690cd09-9d5a-4aba-92c8-56c446c8a142 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:39.364331 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c690cd09-9d5a-4aba-92c8-56c446c8a142 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:39.364772 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c690cd09-9d5a-4aba-92c8-56c446c8a142 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:39.433376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-847a98f0-e450-4c31-b16a-2599fde44ad0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:39.433963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-847a98f0-e450-4c31-b16a-2599fde44ad0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:39.440590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-847a98f0-e450-4c31-b16a-2599fde44ad0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:39.441070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-847a98f0-e450-4c31-b16a-2599fde44ad0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:39.441838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-847a98f0-e450-4c31-b16a-2599fde44ad0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:39.442271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-847a98f0-e450-4c31-b16a-2599fde44ad0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:39.496680 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-c690cd09-9d5a-4aba-92c8-56c446c8a142 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:39.504354 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c690cd09-9d5a-4aba-92c8-56c446c8a142 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.151955 May 10 21:13:39.505084 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 360/688] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:39 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:39.572907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-847a98f0-e450-4c31-b16a-2599fde44ad0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:39.580350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-847a98f0-e450-4c31-b16a-2599fde44ad0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.150986 May 10 21:13:39.580925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 329/689] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:39 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:39.738901 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9d31943f-d26b-4ac8-a597-171f0152ba52 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:39.739851 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-9d31943f-d26b-4ac8-a597-171f0152ba52 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:39.745989 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9d31943f-d26b-4ac8-a597-171f0152ba52 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:39.746430 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9d31943f-d26b-4ac8-a597-171f0152ba52 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:39.747225 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9d31943f-d26b-4ac8-a597-171f0152ba52 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:39.747664 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9d31943f-d26b-4ac8-a597-171f0152ba52 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:39.776495 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9d31943f-d26b-4ac8-a597-171f0152ba52 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041572 May 10 21:13:39.777030 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 361/690] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:39 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:39.897079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-231124ae-6f55-4b8d-8244-13b81949505c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:39.897729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-231124ae-6f55-4b8d-8244-13b81949505c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:39.904715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-231124ae-6f55-4b8d-8244-13b81949505c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:39.905170 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-231124ae-6f55-4b8d-8244-13b81949505c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:39.905944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-231124ae-6f55-4b8d-8244-13b81949505c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:39.906384 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-231124ae-6f55-4b8d-8244-13b81949505c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:40.034603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-231124ae-6f55-4b8d-8244-13b81949505c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:40.042044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-231124ae-6f55-4b8d-8244-13b81949505c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.148872 May 10 21:13:40.042619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 330/691] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:39 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:40.521063 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6adb8564-25e3-4e7b-8ae4-f07e934ae38a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:40.521726 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6adb8564-25e3-4e7b-8ae4-f07e934ae38a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:40.528073 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6adb8564-25e3-4e7b-8ae4-f07e934ae38a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:40.528515 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6adb8564-25e3-4e7b-8ae4-f07e934ae38a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:40.529308 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6adb8564-25e3-4e7b-8ae4-f07e934ae38a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:40.529741 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6adb8564-25e3-4e7b-8ae4-f07e934ae38a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:40.597710 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a0b7ebba-c5a8-4c65-a308-4c5c8a3777fe tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:40.598404 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a0b7ebba-c5a8-4c65-a308-4c5c8a3777fe tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:40.609826 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0b7ebba-c5a8-4c65-a308-4c5c8a3777fe tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:40.610273 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0b7ebba-c5a8-4c65-a308-4c5c8a3777fe tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:40.611040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0b7ebba-c5a8-4c65-a308-4c5c8a3777fe tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:40.611504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0b7ebba-c5a8-4c65-a308-4c5c8a3777fe tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:40.659604 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-6adb8564-25e3-4e7b-8ae4-f07e934ae38a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:40.668368 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6adb8564-25e3-4e7b-8ae4-f07e934ae38a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.151166 May 10 21:13:40.668948 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 362/692] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:40 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:40.739978 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a0b7ebba-c5a8-4c65-a308-4c5c8a3777fe tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:40.747800 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a0b7ebba-c5a8-4c65-a308-4c5c8a3777fe tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.153996 May 10 21:13:40.748368 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 331/693] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:40 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:40.788038 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-852849bd-c5b8-48e0-be4a-87875d422558 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:40.789002 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-852849bd-c5b8-48e0-be4a-87875d422558 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:40.794920 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-852849bd-c5b8-48e0-be4a-87875d422558 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:40.795401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-852849bd-c5b8-48e0-be4a-87875d422558 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:40.796167 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-852849bd-c5b8-48e0-be4a-87875d422558 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:40.796608 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-852849bd-c5b8-48e0-be4a-87875d422558 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:40.825965 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-852849bd-c5b8-48e0-be4a-87875d422558 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041881 May 10 21:13:40.826509 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 363/694] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:40 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:13:41.060600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2e4670aa-c088-4862-8696-c1a87c45b36f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:41.061123 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2e4670aa-c088-4862-8696-c1a87c45b36f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:41.067287 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e4670aa-c088-4862-8696-c1a87c45b36f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:41.067734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e4670aa-c088-4862-8696-c1a87c45b36f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:41.068493 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e4670aa-c088-4862-8696-c1a87c45b36f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:41.068927 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e4670aa-c088-4862-8696-c1a87c45b36f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:41.198820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2e4670aa-c088-4862-8696-c1a87c45b36f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:41.206187 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2e4670aa-c088-4862-8696-c1a87c45b36f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.150463 May 10 21:13:41.206764 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 332/695] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:41 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:41.685462 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-7881d86e-1621-4581-8551-317a0dcc8427 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:41.686097 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-7881d86e-1621-4581-8551-317a0dcc8427 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:41.692732 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7881d86e-1621-4581-8551-317a0dcc8427 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:41.693185 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7881d86e-1621-4581-8551-317a0dcc8427 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:41.693958 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7881d86e-1621-4581-8551-317a0dcc8427 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:41.694398 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7881d86e-1621-4581-8551-317a0dcc8427 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:41.764253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e68df4a4-6fbd-49df-b38b-561bc58cf30c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:41.764926 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e68df4a4-6fbd-49df-b38b-561bc58cf30c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:41.771254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e68df4a4-6fbd-49df-b38b-561bc58cf30c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:41.771715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e68df4a4-6fbd-49df-b38b-561bc58cf30c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:41.772495 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e68df4a4-6fbd-49df-b38b-561bc58cf30c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:41.773607 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e68df4a4-6fbd-49df-b38b-561bc58cf30c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:41.826432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-7881d86e-1621-4581-8551-317a0dcc8427 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:41.834015 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-7881d86e-1621-4581-8551-317a0dcc8427 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.152356 May 10 21:13:41.834580 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 364/696] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:41 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:41.840408 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-3acd4992-6a3b-488c-89b4-09ca50a5ee33 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:41.841318 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-3acd4992-6a3b-488c-89b4-09ca50a5ee33 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:41.847690 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3acd4992-6a3b-488c-89b4-09ca50a5ee33 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:41.848139 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3acd4992-6a3b-488c-89b4-09ca50a5ee33 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:41.848906 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3acd4992-6a3b-488c-89b4-09ca50a5ee33 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:41.849338 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3acd4992-6a3b-488c-89b4-09ca50a5ee33 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:41.879666 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-3acd4992-6a3b-488c-89b4-09ca50a5ee33 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043939 May 10 21:13:41.880146 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 365/697] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:41 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:41.902340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e68df4a4-6fbd-49df-b38b-561bc58cf30c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:41.909900 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e68df4a4-6fbd-49df-b38b-561bc58cf30c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.149528 May 10 21:13:41.910473 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 333/698] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:41 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:42.223409 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-05fdc6e0-45ac-4e1e-ba48-5b68299aae5e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:42.224023 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-05fdc6e0-45ac-4e1e-ba48-5b68299aae5e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:42.230378 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-05fdc6e0-45ac-4e1e-ba48-5b68299aae5e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:42.230819 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-05fdc6e0-45ac-4e1e-ba48-5b68299aae5e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:42.231604 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-05fdc6e0-45ac-4e1e-ba48-5b68299aae5e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:42.232037 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-05fdc6e0-45ac-4e1e-ba48-5b68299aae5e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:42.361173 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-05fdc6e0-45ac-4e1e-ba48-5b68299aae5e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:42.368693 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-05fdc6e0-45ac-4e1e-ba48-5b68299aae5e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.149168 May 10 21:13:42.369255 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 366/699] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:42 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:42.852156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-03055fdd-4329-403b-b630-ca204d7799e9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:42.852763 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-03055fdd-4329-403b-b630-ca204d7799e9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:42.859077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03055fdd-4329-403b-b630-ca204d7799e9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:42.859574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03055fdd-4329-403b-b630-ca204d7799e9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:42.860332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03055fdd-4329-403b-b630-ca204d7799e9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:42.860761 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03055fdd-4329-403b-b630-ca204d7799e9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:42.891951 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-8e845ba7-406f-40eb-aa00-20076b0cc71a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:42.894774 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-8e845ba7-406f-40eb-aa00-20076b0cc71a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:42.900573 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8e845ba7-406f-40eb-aa00-20076b0cc71a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:42.901035 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8e845ba7-406f-40eb-aa00-20076b0cc71a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:42.901852 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8e845ba7-406f-40eb-aa00-20076b0cc71a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:42.902307 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8e845ba7-406f-40eb-aa00-20076b0cc71a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:42.933710 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-8e845ba7-406f-40eb-aa00-20076b0cc71a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045556 May 10 21:13:42.934272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 367/700] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:42 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:13:42.938758 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c6e3826a-aa76-4f6d-95ef-30450de8eed7 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:42.939267 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c6e3826a-aa76-4f6d-95ef-30450de8eed7 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:42.945381 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c6e3826a-aa76-4f6d-95ef-30450de8eed7 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:42.945829 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c6e3826a-aa76-4f6d-95ef-30450de8eed7 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:42.946607 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c6e3826a-aa76-4f6d-95ef-30450de8eed7 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:42.947043 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c6e3826a-aa76-4f6d-95ef-30450de8eed7 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:42.995807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-03055fdd-4329-403b-b630-ca204d7799e9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:43.002999 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-03055fdd-4329-403b-b630-ca204d7799e9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.155196 May 10 21:13:43.003598 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 334/701] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:42 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:43.076887 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-c6e3826a-aa76-4f6d-95ef-30450de8eed7 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:43.084155 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c6e3826a-aa76-4f6d-95ef-30450de8eed7 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.148959 May 10 21:13:43.084718 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 368/702] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:42 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:43.386246 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3649beeb-43a1-45b2-ba43-90faed6f4761 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:43.386864 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3649beeb-43a1-45b2-ba43-90faed6f4761 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:43.392854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3649beeb-43a1-45b2-ba43-90faed6f4761 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:43.393309 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3649beeb-43a1-45b2-ba43-90faed6f4761 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:43.394079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3649beeb-43a1-45b2-ba43-90faed6f4761 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:43.394521 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3649beeb-43a1-45b2-ba43-90faed6f4761 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:43.525538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3649beeb-43a1-45b2-ba43-90faed6f4761 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:43.532734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3649beeb-43a1-45b2-ba43-90faed6f4761 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.150848 May 10 21:13:43.533298 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 335/703] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:43 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:43.946976 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a86fa61c-453e-42bc-b60c-4ac073dd5ccd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:43.947874 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a86fa61c-453e-42bc-b60c-4ac073dd5ccd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:43.954321 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a86fa61c-453e-42bc-b60c-4ac073dd5ccd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:43.954768 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a86fa61c-453e-42bc-b60c-4ac073dd5ccd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:43.955575 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a86fa61c-453e-42bc-b60c-4ac073dd5ccd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:43.956022 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a86fa61c-453e-42bc-b60c-4ac073dd5ccd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:43.984140 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a86fa61c-453e-42bc-b60c-4ac073dd5ccd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042274 May 10 21:13:43.984684 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 369/704] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:43 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:44.019540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-42908e27-89d4-4182-85f1-dc59d5408dde tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:44.020174 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-42908e27-89d4-4182-85f1-dc59d5408dde tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:44.026183 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-42908e27-89d4-4182-85f1-dc59d5408dde tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:44.026627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-42908e27-89d4-4182-85f1-dc59d5408dde tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:44.027412 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-42908e27-89d4-4182-85f1-dc59d5408dde tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:44.027845 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-42908e27-89d4-4182-85f1-dc59d5408dde tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:44.101848 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-44a80179-603c-4345-a435-43eebd7a2f07 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:44.102776 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-44a80179-603c-4345-a435-43eebd7a2f07 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:44.109451 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-44a80179-603c-4345-a435-43eebd7a2f07 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:44.109899 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-44a80179-603c-4345-a435-43eebd7a2f07 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:44.110664 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-44a80179-603c-4345-a435-43eebd7a2f07 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:44.111145 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-44a80179-603c-4345-a435-43eebd7a2f07 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:44.160318 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-42908e27-89d4-4182-85f1-dc59d5408dde tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:44.168332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-42908e27-89d4-4182-85f1-dc59d5408dde tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.152546 May 10 21:13:44.168909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 336/705] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:44 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:44.238868 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-44a80179-603c-4345-a435-43eebd7a2f07 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:44.246946 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-44a80179-603c-4345-a435-43eebd7a2f07 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.149314 May 10 21:13:44.247573 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 370/706] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:44 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:44.550028 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c1119545-3f38-4f91-a64f-1ea87e57db13 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:44.550569 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c1119545-3f38-4f91-a64f-1ea87e57db13 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:44.556681 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c1119545-3f38-4f91-a64f-1ea87e57db13 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:44.557130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c1119545-3f38-4f91-a64f-1ea87e57db13 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:44.557893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c1119545-3f38-4f91-a64f-1ea87e57db13 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:44.558329 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c1119545-3f38-4f91-a64f-1ea87e57db13 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:44.692632 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c1119545-3f38-4f91-a64f-1ea87e57db13 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:44.700062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c1119545-3f38-4f91-a64f-1ea87e57db13 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.154225 May 10 21:13:44.700638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 337/707] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:44 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:44.996214 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9e2f2cef-54d2-4f58-bacc-0e1895b3ae1a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:44.997139 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-9e2f2cef-54d2-4f58-bacc-0e1895b3ae1a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:45.003403 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9e2f2cef-54d2-4f58-bacc-0e1895b3ae1a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:45.003903 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9e2f2cef-54d2-4f58-bacc-0e1895b3ae1a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:45.004663 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9e2f2cef-54d2-4f58-bacc-0e1895b3ae1a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:45.005118 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9e2f2cef-54d2-4f58-bacc-0e1895b3ae1a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:45.034975 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9e2f2cef-54d2-4f58-bacc-0e1895b3ae1a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043093 May 10 21:13:45.035556 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 371/708] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:44 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:45.185478 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e7c7fec6-fff6-4f9a-a2dc-466c49d443ec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:45.186114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e7c7fec6-fff6-4f9a-a2dc-466c49d443ec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:45.192639 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e7c7fec6-fff6-4f9a-a2dc-466c49d443ec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:45.193083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e7c7fec6-fff6-4f9a-a2dc-466c49d443ec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:45.193837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e7c7fec6-fff6-4f9a-a2dc-466c49d443ec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:45.194268 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e7c7fec6-fff6-4f9a-a2dc-466c49d443ec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:45.263750 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-022e4a37-842c-4dc3-840d-dcf6f796f6f0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:45.264281 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-022e4a37-842c-4dc3-840d-dcf6f796f6f0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:45.270322 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-022e4a37-842c-4dc3-840d-dcf6f796f6f0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:45.270782 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-022e4a37-842c-4dc3-840d-dcf6f796f6f0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:45.271584 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-022e4a37-842c-4dc3-840d-dcf6f796f6f0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:45.272024 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-022e4a37-842c-4dc3-840d-dcf6f796f6f0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:45.323170 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e7c7fec6-fff6-4f9a-a2dc-466c49d443ec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:45.330585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e7c7fec6-fff6-4f9a-a2dc-466c49d443ec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.148893 May 10 21:13:45.331169 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 338/709] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:45 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:45.398583 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-022e4a37-842c-4dc3-840d-dcf6f796f6f0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:45.405917 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-022e4a37-842c-4dc3-840d-dcf6f796f6f0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.146142 May 10 21:13:45.406481 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 372/710] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:45 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:45.717365 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-04517c96-0841-47a9-b376-269de76bd42b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:45.717973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-04517c96-0841-47a9-b376-269de76bd42b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:45.723900 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04517c96-0841-47a9-b376-269de76bd42b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:45.724341 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04517c96-0841-47a9-b376-269de76bd42b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:45.725089 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04517c96-0841-47a9-b376-269de76bd42b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:45.725517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04517c96-0841-47a9-b376-269de76bd42b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:45.855108 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-04517c96-0841-47a9-b376-269de76bd42b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:45.870775 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-04517c96-0841-47a9-b376-269de76bd42b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.149028 May 10 21:13:45.870775 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 339/711] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:45 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:46.045959 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e14c2121-4e5f-4812-be83-130a87d5bc66 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:46.046879 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e14c2121-4e5f-4812-be83-130a87d5bc66 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:46.053291 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e14c2121-4e5f-4812-be83-130a87d5bc66 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:46.053733 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e14c2121-4e5f-4812-be83-130a87d5bc66 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:46.055105 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e14c2121-4e5f-4812-be83-130a87d5bc66 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:46.055569 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e14c2121-4e5f-4812-be83-130a87d5bc66 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:46.085206 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e14c2121-4e5f-4812-be83-130a87d5bc66 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043173 May 10 21:13:46.086049 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 373/712] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:46 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:46.348335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-853b3735-b7d0-4174-b5ee-89da3c5f9597 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:46.348942 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-853b3735-b7d0-4174-b5ee-89da3c5f9597 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:46.355417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-853b3735-b7d0-4174-b5ee-89da3c5f9597 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:46.355863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-853b3735-b7d0-4174-b5ee-89da3c5f9597 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:46.356618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-853b3735-b7d0-4174-b5ee-89da3c5f9597 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:46.357051 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-853b3735-b7d0-4174-b5ee-89da3c5f9597 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:46.423961 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-723d2bd6-611c-4e30-a637-f026ea6fd777 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:46.424579 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-723d2bd6-611c-4e30-a637-f026ea6fd777 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:46.431045 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-723d2bd6-611c-4e30-a637-f026ea6fd777 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:46.431620 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-723d2bd6-611c-4e30-a637-f026ea6fd777 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:46.432282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-723d2bd6-611c-4e30-a637-f026ea6fd777 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:46.432712 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-723d2bd6-611c-4e30-a637-f026ea6fd777 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:46.486427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-853b3735-b7d0-4174-b5ee-89da3c5f9597 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:46.495695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-853b3735-b7d0-4174-b5ee-89da3c5f9597 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.151129 May 10 21:13:46.496658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 340/713] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:46 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:46.562174 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-723d2bd6-611c-4e30-a637-f026ea6fd777 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:46.569722 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-723d2bd6-611c-4e30-a637-f026ea6fd777 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.149619 May 10 21:13:46.570555 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 374/714] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:46 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:46.885761 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3ff52856-de0a-4648-b1f2-3277033b7264 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:46.895713 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3ff52856-de0a-4648-b1f2-3277033b7264 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:46.895713 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ff52856-de0a-4648-b1f2-3277033b7264 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:46.895713 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ff52856-de0a-4648-b1f2-3277033b7264 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:46.895713 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ff52856-de0a-4648-b1f2-3277033b7264 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:46.896097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ff52856-de0a-4648-b1f2-3277033b7264 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:47.018496 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3ff52856-de0a-4648-b1f2-3277033b7264 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:47.026367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3ff52856-de0a-4648-b1f2-3277033b7264 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.144586 May 10 21:13:47.026930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 341/715] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:46 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:47.097178 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-38e8ac2d-b039-41d9-bd38-0e9ab9b219e0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:47.098096 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-38e8ac2d-b039-41d9-bd38-0e9ab9b219e0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:47.105103 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-38e8ac2d-b039-41d9-bd38-0e9ab9b219e0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:47.105544 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-38e8ac2d-b039-41d9-bd38-0e9ab9b219e0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:47.106344 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-38e8ac2d-b039-41d9-bd38-0e9ab9b219e0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:47.106762 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-38e8ac2d-b039-41d9-bd38-0e9ab9b219e0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:47.135578 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-38e8ac2d-b039-41d9-bd38-0e9ab9b219e0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042302 May 10 21:13:47.136117 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 375/716] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:47 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:47.512908 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-aa760e8b-3574-4fff-ae31-1becde164ddf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:47.513463 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-aa760e8b-3574-4fff-ae31-1becde164ddf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:47.519867 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aa760e8b-3574-4fff-ae31-1becde164ddf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:47.520319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aa760e8b-3574-4fff-ae31-1becde164ddf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:47.521090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aa760e8b-3574-4fff-ae31-1becde164ddf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:47.521523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aa760e8b-3574-4fff-ae31-1becde164ddf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:47.586994 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-63c32d9e-2604-46f8-9cf0-e9e18d9add84 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:47.587771 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-63c32d9e-2604-46f8-9cf0-e9e18d9add84 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:47.593596 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-63c32d9e-2604-46f8-9cf0-e9e18d9add84 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:47.594044 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-63c32d9e-2604-46f8-9cf0-e9e18d9add84 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:47.594834 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-63c32d9e-2604-46f8-9cf0-e9e18d9add84 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:47.595343 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-63c32d9e-2604-46f8-9cf0-e9e18d9add84 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:47.659683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-aa760e8b-3574-4fff-ae31-1becde164ddf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:47.667018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-aa760e8b-3574-4fff-ae31-1becde164ddf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.158005 May 10 21:13:47.667633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 342/717] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:47 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:47.732350 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-63c32d9e-2604-46f8-9cf0-e9e18d9add84 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:47.739553 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-63c32d9e-2604-46f8-9cf0-e9e18d9add84 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.156427 May 10 21:13:47.740120 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 376/718] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:47 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:48.044279 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-76e51136-d4e4-499e-97ef-e9f63481ec7a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:48.044896 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-76e51136-d4e4-499e-97ef-e9f63481ec7a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:48.050838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76e51136-d4e4-499e-97ef-e9f63481ec7a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:48.051332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76e51136-d4e4-499e-97ef-e9f63481ec7a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:48.052099 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76e51136-d4e4-499e-97ef-e9f63481ec7a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:48.052544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76e51136-d4e4-499e-97ef-e9f63481ec7a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:48.147295 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-5ad5197c-8e40-4c8b-bfe0-46b9e57b5e9c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:48.149110 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5ad5197c-8e40-4c8b-bfe0-46b9e57b5e9c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:48.156001 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5ad5197c-8e40-4c8b-bfe0-46b9e57b5e9c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:48.156442 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5ad5197c-8e40-4c8b-bfe0-46b9e57b5e9c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:48.157205 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5ad5197c-8e40-4c8b-bfe0-46b9e57b5e9c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:48.157637 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5ad5197c-8e40-4c8b-bfe0-46b9e57b5e9c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:48.180996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-76e51136-d4e4-499e-97ef-e9f63481ec7a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:48.187913 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-5ad5197c-8e40-4c8b-bfe0-46b9e57b5e9c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044627 May 10 21:13:48.188214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-76e51136-d4e4-499e-97ef-e9f63481ec7a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.147897 May 10 21:13:48.188476 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 377/719] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:48 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:13:48.189431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 343/720] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:48 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:48.683736 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-19249935-66cd-42a9-9691-24585f1f60c2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:48.684362 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-19249935-66cd-42a9-9691-24585f1f60c2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:48.690606 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-19249935-66cd-42a9-9691-24585f1f60c2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:48.691059 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-19249935-66cd-42a9-9691-24585f1f60c2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:48.691857 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-19249935-66cd-42a9-9691-24585f1f60c2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:48.692306 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-19249935-66cd-42a9-9691-24585f1f60c2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:48.756901 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f2fe9027-c183-490d-b46b-e68ef294080d tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:48.757539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f2fe9027-c183-490d-b46b-e68ef294080d tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:48.764983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2fe9027-c183-490d-b46b-e68ef294080d tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:48.765441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2fe9027-c183-490d-b46b-e68ef294080d tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:48.766227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2fe9027-c183-490d-b46b-e68ef294080d tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:48.766677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2fe9027-c183-490d-b46b-e68ef294080d tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:48.825991 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-19249935-66cd-42a9-9691-24585f1f60c2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:48.833521 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-19249935-66cd-42a9-9691-24585f1f60c2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.153662 May 10 21:13:48.834219 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 378/721] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:48 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:48.903245 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f2fe9027-c183-490d-b46b-e68ef294080d tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:48.910543 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f2fe9027-c183-490d-b46b-e68ef294080d tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.157502 May 10 21:13:48.911112 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 344/722] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:48 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:49.200645 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-8b10cc14-3a1f-4244-a500-15233e710a1e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:49.201645 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-8b10cc14-3a1f-4244-a500-15233e710a1e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:49.205474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-588ad15d-26ed-4d43-a2b8-53ed743c10c8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:49.206082 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-588ad15d-26ed-4d43-a2b8-53ed743c10c8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:49.208080 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8b10cc14-3a1f-4244-a500-15233e710a1e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:49.208538 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8b10cc14-3a1f-4244-a500-15233e710a1e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:49.209316 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8b10cc14-3a1f-4244-a500-15233e710a1e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:49.209758 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8b10cc14-3a1f-4244-a500-15233e710a1e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:49.212329 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-588ad15d-26ed-4d43-a2b8-53ed743c10c8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:49.212775 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-588ad15d-26ed-4d43-a2b8-53ed743c10c8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:49.213532 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-588ad15d-26ed-4d43-a2b8-53ed743c10c8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:49.213965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-588ad15d-26ed-4d43-a2b8-53ed743c10c8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:49.239975 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-8b10cc14-3a1f-4244-a500-15233e710a1e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043406 May 10 21:13:49.240538 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 379/723] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:49 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:49.338438 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-588ad15d-26ed-4d43-a2b8-53ed743c10c8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:49.345641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-588ad15d-26ed-4d43-a2b8-53ed743c10c8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.143915 May 10 21:13:49.346206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 345/724] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:49 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:49.850286 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-92240837-8c8a-4cdd-a155-9073f4d62cea tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:49.850931 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-92240837-8c8a-4cdd-a155-9073f4d62cea tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:49.857096 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-92240837-8c8a-4cdd-a155-9073f4d62cea tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:49.857547 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-92240837-8c8a-4cdd-a155-9073f4d62cea tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:49.858317 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-92240837-8c8a-4cdd-a155-9073f4d62cea tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:49.858751 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-92240837-8c8a-4cdd-a155-9073f4d62cea tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:49.928095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0653acb9-f112-4b36-9cfc-85a56d6a51b9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:49.929366 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0653acb9-f112-4b36-9cfc-85a56d6a51b9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:49.936450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0653acb9-f112-4b36-9cfc-85a56d6a51b9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:49.936871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0653acb9-f112-4b36-9cfc-85a56d6a51b9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:49.937651 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0653acb9-f112-4b36-9cfc-85a56d6a51b9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:49.938083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0653acb9-f112-4b36-9cfc-85a56d6a51b9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:49.993557 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-92240837-8c8a-4cdd-a155-9073f4d62cea tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:50.000845 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-92240837-8c8a-4cdd-a155-9073f4d62cea tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.154311 May 10 21:13:50.001422 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 380/725] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:49 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:50.072218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0653acb9-f112-4b36-9cfc-85a56d6a51b9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:50.079518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0653acb9-f112-4b36-9cfc-85a56d6a51b9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.155259 May 10 21:13:50.080097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 346/726] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:49 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:50.251727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-172a60ae-fec7-4e01-b3ba-24b84cef012b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:50.252648 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-172a60ae-fec7-4e01-b3ba-24b84cef012b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:50.259263 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-172a60ae-fec7-4e01-b3ba-24b84cef012b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:50.259710 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-172a60ae-fec7-4e01-b3ba-24b84cef012b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:50.260468 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-172a60ae-fec7-4e01-b3ba-24b84cef012b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:50.260901 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-172a60ae-fec7-4e01-b3ba-24b84cef012b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:50.288630 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-172a60ae-fec7-4e01-b3ba-24b84cef012b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040895 May 10 21:13:50.289695 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 381/727] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:50 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:13:50.362927 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7031b708-68ff-453d-b3fa-0aecb1d527a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:50.363611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7031b708-68ff-453d-b3fa-0aecb1d527a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:50.370899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7031b708-68ff-453d-b3fa-0aecb1d527a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:50.371386 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7031b708-68ff-453d-b3fa-0aecb1d527a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:50.372173 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7031b708-68ff-453d-b3fa-0aecb1d527a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:50.372607 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7031b708-68ff-453d-b3fa-0aecb1d527a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:50.505219 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7031b708-68ff-453d-b3fa-0aecb1d527a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:50.513691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7031b708-68ff-453d-b3fa-0aecb1d527a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.154560 May 10 21:13:50.514262 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 347/728] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:50 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:51.018857 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-119e9b3b-c0ef-4bcf-9fb6-82e74e2b0129 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:51.019516 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-119e9b3b-c0ef-4bcf-9fb6-82e74e2b0129 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:51.026167 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-119e9b3b-c0ef-4bcf-9fb6-82e74e2b0129 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:51.026978 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-119e9b3b-c0ef-4bcf-9fb6-82e74e2b0129 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:51.028425 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-119e9b3b-c0ef-4bcf-9fb6-82e74e2b0129 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:51.029028 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-119e9b3b-c0ef-4bcf-9fb6-82e74e2b0129 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:51.096764 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-833fc36c-f746-4bc4-957b-e48fb78d7fb8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:51.097475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-833fc36c-f746-4bc4-957b-e48fb78d7fb8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:51.105457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-833fc36c-f746-4bc4-957b-e48fb78d7fb8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:51.105905 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-833fc36c-f746-4bc4-957b-e48fb78d7fb8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:51.106752 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-833fc36c-f746-4bc4-957b-e48fb78d7fb8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:51.107223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-833fc36c-f746-4bc4-957b-e48fb78d7fb8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:51.160792 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-119e9b3b-c0ef-4bcf-9fb6-82e74e2b0129 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:51.168893 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-119e9b3b-c0ef-4bcf-9fb6-82e74e2b0129 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1259 microversion: 2.1 time: 0.153800 May 10 21:13:51.169466 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 382/729] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:51 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:51.237750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-833fc36c-f746-4bc4-957b-e48fb78d7fb8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:51.245736 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-833fc36c-f746-4bc4-957b-e48fb78d7fb8 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1677 microversion: 2.1 time: 0.152797 May 10 21:13:51.246502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 348/730] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:51 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:51.300790 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-cca37d5c-58c3-43c4-93bd-d18be6238bde tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:51.301723 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-cca37d5c-58c3-43c4-93bd-d18be6238bde tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:51.308137 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cca37d5c-58c3-43c4-93bd-d18be6238bde tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:51.308593 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cca37d5c-58c3-43c4-93bd-d18be6238bde tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:51.309373 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cca37d5c-58c3-43c4-93bd-d18be6238bde tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:51.309815 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cca37d5c-58c3-43c4-93bd-d18be6238bde tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:51.338433 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-cca37d5c-58c3-43c4-93bd-d18be6238bde tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041580 May 10 21:13:51.338978 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 383/731] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:51 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:51.531038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a64cc6b1-6a8f-4969-9ef7-4ef150cd95a5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:51.531603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a64cc6b1-6a8f-4969-9ef7-4ef150cd95a5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:51.537580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a64cc6b1-6a8f-4969-9ef7-4ef150cd95a5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:51.538029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a64cc6b1-6a8f-4969-9ef7-4ef150cd95a5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:51.538864 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a64cc6b1-6a8f-4969-9ef7-4ef150cd95a5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:51.539852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a64cc6b1-6a8f-4969-9ef7-4ef150cd95a5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:51.671698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a64cc6b1-6a8f-4969-9ef7-4ef150cd95a5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:51.678921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a64cc6b1-6a8f-4969-9ef7-4ef150cd95a5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.151937 May 10 21:13:51.679523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 349/732] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:51 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:52.186641 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e848c501-325c-4643-9216-f284c0bf1f13 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:52.187211 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e848c501-325c-4643-9216-f284c0bf1f13 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:52.193629 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e848c501-325c-4643-9216-f284c0bf1f13 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:52.194078 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e848c501-325c-4643-9216-f284c0bf1f13 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:52.194841 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e848c501-325c-4643-9216-f284c0bf1f13 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:52.195316 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e848c501-325c-4643-9216-f284c0bf1f13 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:52.262530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0749d804-aa23-4064-bb19-ac628f0f151e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:52.263271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0749d804-aa23-4064-bb19-ac628f0f151e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:52.269585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0749d804-aa23-4064-bb19-ac628f0f151e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:52.270100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0749d804-aa23-4064-bb19-ac628f0f151e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:52.271042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0749d804-aa23-4064-bb19-ac628f0f151e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:52.271564 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0749d804-aa23-4064-bb19-ac628f0f151e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:52.323597 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-e848c501-325c-4643-9216-f284c0bf1f13 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:52.330999 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e848c501-325c-4643-9216-f284c0bf1f13 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1442 microversion: 2.1 time: 0.148279 May 10 21:13:52.331606 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 384/733] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:52 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1442 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:52.346803 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-b8bece61-dec1-4c57-8319-039c230967cb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:52.347530 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-b8bece61-dec1-4c57-8319-039c230967cb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:52.353700 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b8bece61-dec1-4c57-8319-039c230967cb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:52.354159 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b8bece61-dec1-4c57-8319-039c230967cb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:52.354938 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b8bece61-dec1-4c57-8319-039c230967cb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:52.355410 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b8bece61-dec1-4c57-8319-039c230967cb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:52.400691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0749d804-aa23-4064-bb19-ac628f0f151e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:52.408012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0749d804-aa23-4064-bb19-ac628f0f151e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1654 microversion: 2.1 time: 0.150199 May 10 21:13:52.408577 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 350/734] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:52 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1654 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:52.413046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fa094763-2446-4c26-9d2f-b86135f54f6e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:52.414865 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fa094763-2446-4c26-9d2f-b86135f54f6e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:52.420777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fa094763-2446-4c26-9d2f-b86135f54f6e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:52.421228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fa094763-2446-4c26-9d2f-b86135f54f6e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:52.421994 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fa094763-2446-4c26-9d2f-b86135f54f6e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:52.422424 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fa094763-2446-4c26-9d2f-b86135f54f6e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:52.463877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fa094763-2446-4c26-9d2f-b86135f54f6e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043894 May 10 21:13:52.463877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 351/735] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:52 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:52.463877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-01c27c7c-b07b-48d8-b863-17e98d983512 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:13:52.465779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01c27c7c-b07b-48d8-b863-17e98d983512 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:52.466231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01c27c7c-b07b-48d8-b863-17e98d983512 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:52.489328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-01c27c7c-b07b-48d8-b863-17e98d983512 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Going to try to start instance {{(pid=117714) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 21:13:52.490666 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-b8bece61-dec1-4c57-8319-039c230967cb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:52.499730 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-b8bece61-dec1-4c57-8319-039c230967cb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1442 microversion: 2.1 time: 0.156366 May 10 21:13:52.500326 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 385/736] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:52 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1442 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:52.632506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-01c27c7c-b07b-48d8-b863-17e98d983512 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "POST /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932/action" status: 202 len: 0 microversion: 2.1 time: 0.177021 May 10 21:13:52.634431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 352/737] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 21:13:52 2022] POST /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:13:52.642705 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-ddbfd9bb-fa95-4791-8a5c-6bdf9c8471f6 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:52.643368 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-ddbfd9bb-fa95-4791-8a5c-6bdf9c8471f6 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:52.650358 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ddbfd9bb-fa95-4791-8a5c-6bdf9c8471f6 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:52.650821 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ddbfd9bb-fa95-4791-8a5c-6bdf9c8471f6 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:52.651690 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ddbfd9bb-fa95-4791-8a5c-6bdf9c8471f6 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:52.652144 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ddbfd9bb-fa95-4791-8a5c-6bdf9c8471f6 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:52.697657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bdbe7c95-1675-4d43-9547-0c1cd2a311b2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:52.698370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bdbe7c95-1675-4d43-9547-0c1cd2a311b2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:52.704810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bdbe7c95-1675-4d43-9547-0c1cd2a311b2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:52.705273 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bdbe7c95-1675-4d43-9547-0c1cd2a311b2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:52.706225 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bdbe7c95-1675-4d43-9547-0c1cd2a311b2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:52.706667 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bdbe7c95-1675-4d43-9547-0c1cd2a311b2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:52.786598 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-ddbfd9bb-fa95-4791-8a5c-6bdf9c8471f6 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:52.794374 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-ddbfd9bb-fa95-4791-8a5c-6bdf9c8471f6 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1663 microversion: 2.1 time: 0.155487 May 10 21:13:52.795152 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 386/738] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:52 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1663 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:52.901547 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bdbe7c95-1675-4d43-9547-0c1cd2a311b2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:52.909211 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bdbe7c95-1675-4d43-9547-0c1cd2a311b2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.216456 May 10 21:13:52.909816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 353/739] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:52 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:53.473736 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-99e8958e-2f70-4255-b1e3-603f47c40c8a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:53.474801 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-99e8958e-2f70-4255-b1e3-603f47c40c8a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:53.482109 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-99e8958e-2f70-4255-b1e3-603f47c40c8a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:53.482566 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-99e8958e-2f70-4255-b1e3-603f47c40c8a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:53.483392 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-99e8958e-2f70-4255-b1e3-603f47c40c8a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:53.483829 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-99e8958e-2f70-4255-b1e3-603f47c40c8a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:53.514640 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-99e8958e-2f70-4255-b1e3-603f47c40c8a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044813 May 10 21:13:53.515449 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 387/740] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:53 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:53.812144 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ee9e98b3-133f-4c5f-bd7c-2461df7224ed tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:53.812734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ee9e98b3-133f-4c5f-bd7c-2461df7224ed tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:53.819435 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee9e98b3-133f-4c5f-bd7c-2461df7224ed tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:53.819888 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee9e98b3-133f-4c5f-bd7c-2461df7224ed tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:53.820711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee9e98b3-133f-4c5f-bd7c-2461df7224ed tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:53.821142 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee9e98b3-133f-4c5f-bd7c-2461df7224ed tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:53.928817 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-8a50fb75-449b-4f95-816f-f4f1ef5c8275 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:53.930822 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-8a50fb75-449b-4f95-816f-f4f1ef5c8275 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:53.936695 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8a50fb75-449b-4f95-816f-f4f1ef5c8275 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:53.937146 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8a50fb75-449b-4f95-816f-f4f1ef5c8275 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:53.937908 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8a50fb75-449b-4f95-816f-f4f1ef5c8275 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:53.938441 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8a50fb75-449b-4f95-816f-f4f1ef5c8275 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:54.034694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ee9e98b3-133f-4c5f-bd7c-2461df7224ed tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:54.044907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ee9e98b3-133f-4c5f-bd7c-2461df7224ed tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1663 microversion: 2.1 time: 0.236870 May 10 21:13:54.055824 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 354/741] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:53 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1663 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:54.146812 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-8a50fb75-449b-4f95-816f-f4f1ef5c8275 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:54.155362 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-8a50fb75-449b-4f95-816f-f4f1ef5c8275 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.232124 May 10 21:13:54.155936 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 388/742] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:53 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:54.526385 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-10f72a0b-0c6e-4070-a121-b60460e11d1f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:54.527873 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-10f72a0b-0c6e-4070-a121-b60460e11d1f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:54.534712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-10f72a0b-0c6e-4070-a121-b60460e11d1f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:54.535556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-10f72a0b-0c6e-4070-a121-b60460e11d1f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:54.536412 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-10f72a0b-0c6e-4070-a121-b60460e11d1f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:54.536926 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-10f72a0b-0c6e-4070-a121-b60460e11d1f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:54.573906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-10f72a0b-0c6e-4070-a121-b60460e11d1f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051727 May 10 21:13:54.574845 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 355/743] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:54 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:55.064679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e051fed8-5532-4fec-b9b2-0b62a16cf073 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:55.065484 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e051fed8-5532-4fec-b9b2-0b62a16cf073 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:55.072247 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e051fed8-5532-4fec-b9b2-0b62a16cf073 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:55.072697 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e051fed8-5532-4fec-b9b2-0b62a16cf073 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:55.073465 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e051fed8-5532-4fec-b9b2-0b62a16cf073 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:55.073905 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e051fed8-5532-4fec-b9b2-0b62a16cf073 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:55.173099 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-42bbdaeb-c353-4923-9619-3fb9d1d7bc62 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:55.173791 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-42bbdaeb-c353-4923-9619-3fb9d1d7bc62 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:55.181757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-42bbdaeb-c353-4923-9619-3fb9d1d7bc62 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:55.182491 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-42bbdaeb-c353-4923-9619-3fb9d1d7bc62 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:55.183536 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-42bbdaeb-c353-4923-9619-3fb9d1d7bc62 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:55.184197 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-42bbdaeb-c353-4923-9619-3fb9d1d7bc62 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:55.306394 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-e051fed8-5532-4fec-b9b2-0b62a16cf073 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:55.313861 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e051fed8-5532-4fec-b9b2-0b62a16cf073 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1663 microversion: 2.1 time: 0.253705 May 10 21:13:55.314528 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 389/744] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:55 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1663 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:55.321927 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-02d18494-b3e6-481b-bd6d-9f85289d6346 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:13:55.323182 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-02d18494-b3e6-481b-bd6d-9f85289d6346 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:55.329725 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-02d18494-b3e6-481b-bd6d-9f85289d6346 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:55.332301 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-02d18494-b3e6-481b-bd6d-9f85289d6346 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:55.332301 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-02d18494-b3e6-481b-bd6d-9f85289d6346 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:55.333073 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-02d18494-b3e6-481b-bd6d-9f85289d6346 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:55.361065 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.objects.instance [None req-02d18494-b3e6-481b-bd6d-9f85289d6346 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lazy-loading 'flavor' on Instance uuid cf6fc652-5ef0-417d-af13-69c7c058d50e {{(pid=117713) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:13:55.637370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-42bbdaeb-c353-4923-9619-3fb9d1d7bc62 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:55.644665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-42bbdaeb-c353-4923-9619-3fb9d1d7bc62 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1681 microversion: 2.1 time: 0.475765 May 10 21:13:55.645241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 356/745] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:55 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1681 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:55.650066 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b84b3add-85d3-41a3-b7dc-1eca99b3e4ef tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:55.651222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b84b3add-85d3-41a3-b7dc-1eca99b3e4ef tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:55.657150 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b84b3add-85d3-41a3-b7dc-1eca99b3e4ef tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:55.657602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b84b3add-85d3-41a3-b7dc-1eca99b3e4ef tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:55.658385 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b84b3add-85d3-41a3-b7dc-1eca99b3e4ef tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:55.658830 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b84b3add-85d3-41a3-b7dc-1eca99b3e4ef tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:55.688904 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b84b3add-85d3-41a3-b7dc-1eca99b3e4ef tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042444 May 10 21:13:55.689693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 357/746] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:55 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:55.775581 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-02d18494-b3e6-481b-bd6d-9f85289d6346 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "POST /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/action" status: 200 len: 32 microversion: 2.1 time: 0.459192 May 10 21:13:55.777976 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 390/747] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 21:13:55 2022] POST /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/action => generated 32 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 21:13:55.786812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2c1bdcb7-364b-437c-ac9c-e7f7d9446eb0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:55.787456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2c1bdcb7-364b-437c-ac9c-e7f7d9446eb0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:55.805451 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c1bdcb7-364b-437c-ac9c-e7f7d9446eb0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:55.806168 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c1bdcb7-364b-437c-ac9c-e7f7d9446eb0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:55.807326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c1bdcb7-364b-437c-ac9c-e7f7d9446eb0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:55.807796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c1bdcb7-364b-437c-ac9c-e7f7d9446eb0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:56.018436 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [req-e3ec56b9-4315-42f1-9c66-f6dd31c2e0b9 req-a20272f0-b11f-475e-9c81-966cd1df7778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c7c73d-54f3-4695-87bc-4c9d22d5652f", "tag": "b751e302-b05a-4d37-b886-85ba68540b75"}]} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:13:56.035934 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-e3ec56b9-4315-42f1-9c66-f6dd31c2e0b9 req-a20272f0-b11f-475e-9c81-966cd1df7778 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:56.036841 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-e3ec56b9-4315-42f1-9c66-f6dd31c2e0b9 req-a20272f0-b11f-475e-9c81-966cd1df7778 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:56.055905 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.compute.server_external_events [req-e3ec56b9-4315-42f1-9c66-f6dd31c2e0b9 req-a20272f0-b11f-475e-9c81-966cd1df7778 service nova] Creating event network-changed:b751e302-b05a-4d37-b886-85ba68540b75 for instance d4c7c73d-54f3-4695-87bc-4c9d22d5652f on hv-cinder-82880 May 10 21:13:56.067429 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [req-e3ec56b9-4315-42f1-9c66-f6dd31c2e0b9 req-a20272f0-b11f-475e-9c81-966cd1df7778 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053390 May 10 21:13:56.069076 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 391/748] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:13:56.154391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2c1bdcb7-364b-437c-ac9c-e7f7d9446eb0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:56.162454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2c1bdcb7-364b-437c-ac9c-e7f7d9446eb0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.379162 May 10 21:13:56.162832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 358/749] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:55 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:56.332932 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-05311c10-c892-4b68-a592-91d9eeb3b4d3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:56.333767 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-05311c10-c892-4b68-a592-91d9eeb3b4d3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:56.342321 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-05311c10-c892-4b68-a592-91d9eeb3b4d3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:56.342953 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-05311c10-c892-4b68-a592-91d9eeb3b4d3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:56.344763 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-05311c10-c892-4b68-a592-91d9eeb3b4d3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:56.345526 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-05311c10-c892-4b68-a592-91d9eeb3b4d3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:56.537515 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-05311c10-c892-4b68-a592-91d9eeb3b4d3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:56.547642 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-05311c10-c892-4b68-a592-91d9eeb3b4d3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1663 microversion: 2.1 time: 0.218952 May 10 21:13:56.548531 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 392/750] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:56 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1663 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:56.662271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8daec38a-bbae-431c-b34d-b8c60d5eeb07 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:56.662899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8daec38a-bbae-431c-b34d-b8c60d5eeb07 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:56.677251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8daec38a-bbae-431c-b34d-b8c60d5eeb07 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:56.677251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8daec38a-bbae-431c-b34d-b8c60d5eeb07 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:56.677251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8daec38a-bbae-431c-b34d-b8c60d5eeb07 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:56.677609 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8daec38a-bbae-431c-b34d-b8c60d5eeb07 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:56.701165 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-7ee70cdf-ee41-49a7-8575-158d8cc1c403 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:56.702449 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-7ee70cdf-ee41-49a7-8575-158d8cc1c403 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:56.711556 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7ee70cdf-ee41-49a7-8575-158d8cc1c403 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:56.712426 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7ee70cdf-ee41-49a7-8575-158d8cc1c403 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:56.716358 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7ee70cdf-ee41-49a7-8575-158d8cc1c403 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:56.720118 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7ee70cdf-ee41-49a7-8575-158d8cc1c403 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:56.786716 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-7ee70cdf-ee41-49a7-8575-158d8cc1c403 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089985 May 10 21:13:56.794944 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 393/751] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:56 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:56.817200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8daec38a-bbae-431c-b34d-b8c60d5eeb07 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:56.826385 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8daec38a-bbae-431c-b34d-b8c60d5eeb07 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1614 microversion: 2.1 time: 0.168271 May 10 21:13:56.834368 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 359/752] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:56 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1614 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:57.180956 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f34f664b-3108-4a8c-a7d7-cb4de18faa82 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:57.182507 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f34f664b-3108-4a8c-a7d7-cb4de18faa82 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:57.191354 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f34f664b-3108-4a8c-a7d7-cb4de18faa82 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:57.194169 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f34f664b-3108-4a8c-a7d7-cb4de18faa82 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:57.196085 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f34f664b-3108-4a8c-a7d7-cb4de18faa82 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:57.201082 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f34f664b-3108-4a8c-a7d7-cb4de18faa82 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:57.496176 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-f34f664b-3108-4a8c-a7d7-cb4de18faa82 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:57.504525 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f34f664b-3108-4a8c-a7d7-cb4de18faa82 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.327479 May 10 21:13:57.505358 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 394/753] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:57 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:57.568882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e45ac429-debe-4fb3-94ff-ec312395e66b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:57.574854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e45ac429-debe-4fb3-94ff-ec312395e66b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:57.607762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e45ac429-debe-4fb3-94ff-ec312395e66b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:57.608744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e45ac429-debe-4fb3-94ff-ec312395e66b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:57.612196 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e45ac429-debe-4fb3-94ff-ec312395e66b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:57.615309 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e45ac429-debe-4fb3-94ff-ec312395e66b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:57.801021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e45ac429-debe-4fb3-94ff-ec312395e66b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:57.803563 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-833fce1c-cfce-4a38-adac-70f84653995b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:57.804804 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-833fce1c-cfce-4a38-adac-70f84653995b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:57.816566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e45ac429-debe-4fb3-94ff-ec312395e66b tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1667 microversion: 2.1 time: 0.253402 May 10 21:13:57.817897 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-833fce1c-cfce-4a38-adac-70f84653995b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:57.818389 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-833fce1c-cfce-4a38-adac-70f84653995b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:57.827275 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-833fce1c-cfce-4a38-adac-70f84653995b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:57.827685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 360/754] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:57 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1667 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:57.827795 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-833fce1c-cfce-4a38-adac-70f84653995b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:57.849925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8e08a732-93df-4115-8f83-3d6b2993af2d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:57.850739 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8e08a732-93df-4115-8f83-3d6b2993af2d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:57.856296 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-833fce1c-cfce-4a38-adac-70f84653995b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058056 May 10 21:13:57.857370 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 395/755] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:57 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:57.862138 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e08a732-93df-4115-8f83-3d6b2993af2d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:57.862597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e08a732-93df-4115-8f83-3d6b2993af2d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:57.863422 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e08a732-93df-4115-8f83-3d6b2993af2d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:57.863855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e08a732-93df-4115-8f83-3d6b2993af2d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:57.897987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e08a732-93df-4115-8f83-3d6b2993af2d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:57.898135 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e08a732-93df-4115-8f83-3d6b2993af2d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:57.899035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.objects.instance [None req-8e08a732-93df-4115-8f83-3d6b2993af2d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lazy-loading 'fault' on Instance uuid f2a9d425-c6f1-4f23-8fb7-7311ca431fdf {{(pid=117714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:13:57.955815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8e08a732-93df-4115-8f83-3d6b2993af2d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:57.969766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8e08a732-93df-4115-8f83-3d6b2993af2d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 200 len: 1331 microversion: 2.1 time: 0.123857 May 10 21:13:57.979102 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 361/756] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:57 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 1331 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:13:58.096977 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [req-a49706dd-d9f4-4580-9974-4c58f506edf8 req-5dcdcad3-d651-49cc-93f4-630114437b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2a9d425-c6f1-4f23-8fb7-7311ca431fdf", "name": "network-vif-deleted", "tag": "d05ef2a7-f2fb-4df8-8e70-5029d667aaa7"}]} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:13:58.109794 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-a49706dd-d9f4-4580-9974-4c58f506edf8 req-5dcdcad3-d651-49cc-93f4-630114437b7d service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:58.110890 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-a49706dd-d9f4-4580-9974-4c58f506edf8 req-5dcdcad3-d651-49cc-93f4-630114437b7d service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:58.126084 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.compute.server_external_events [req-a49706dd-d9f4-4580-9974-4c58f506edf8 req-5dcdcad3-d651-49cc-93f4-630114437b7d service nova] Creating event network-vif-deleted:d05ef2a7-f2fb-4df8-8e70-5029d667aaa7 for instance f2a9d425-c6f1-4f23-8fb7-7311ca431fdf on hv-cinder-82880 May 10 21:13:58.134645 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [req-a49706dd-d9f4-4580-9974-4c58f506edf8 req-5dcdcad3-d651-49cc-93f4-630114437b7d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039588 May 10 21:13:58.136103 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 396/757] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:13:58.524480 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-350fbb47-4f08-4389-a88b-45289c89ca47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:58.525190 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-350fbb47-4f08-4389-a88b-45289c89ca47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:58.531207 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-350fbb47-4f08-4389-a88b-45289c89ca47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:58.531672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-350fbb47-4f08-4389-a88b-45289c89ca47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:58.532434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-350fbb47-4f08-4389-a88b-45289c89ca47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:58.532865 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-350fbb47-4f08-4389-a88b-45289c89ca47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:58.666921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-350fbb47-4f08-4389-a88b-45289c89ca47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:58.674948 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-350fbb47-4f08-4389-a88b-45289c89ca47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.155099 May 10 21:13:58.675550 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 362/758] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:58 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:58.871408 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-08099e94-17ff-44b8-a233-557b6cd184cd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:58.872726 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-08099e94-17ff-44b8-a233-557b6cd184cd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:58.879916 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-08099e94-17ff-44b8-a233-557b6cd184cd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:58.880670 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-08099e94-17ff-44b8-a233-557b6cd184cd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:58.882180 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-08099e94-17ff-44b8-a233-557b6cd184cd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:58.883880 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-08099e94-17ff-44b8-a233-557b6cd184cd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:58.918365 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-08099e94-17ff-44b8-a233-557b6cd184cd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053251 May 10 21:13:58.919220 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 397/759] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:58 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:58.994798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8367d5fe-92e6-4de1-803a-bf4560054fda tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:58.995434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8367d5fe-92e6-4de1-803a-bf4560054fda tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:59.001871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8367d5fe-92e6-4de1-803a-bf4560054fda tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:59.002324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8367d5fe-92e6-4de1-803a-bf4560054fda tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:59.003094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8367d5fe-92e6-4de1-803a-bf4560054fda tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:59.003570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8367d5fe-92e6-4de1-803a-bf4560054fda tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:59.017905 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-8367d5fe-92e6-4de1-803a-bf4560054fda tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] HTTP exception thrown: Instance f2a9d425-c6f1-4f23-8fb7-7311ca431fdf could not be found. May 10 21:13:59.019565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8367d5fe-92e6-4de1-803a-bf4560054fda tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Request method failure captured: May 10 21:13:59.019565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf HTTP/1.1 May 10 21:13:59.019565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:13:59.019565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:13:59.019565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:13:59.019565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:13:59.019565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:13:59.019565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:13:59.019565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:13:59.019565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:13:59.019565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietSE5zX3cUzqYcL4439JiFsqE4YiilwKjmw-zwJrvzsKCKk2V0t2rgnfCfWB9fMDqHcwDYx66Osidv5Nb3ivvjsId3P0K5BlinPK-pYoxdKcKRbo0A46AEZFFXEAkT7Vt_ZFHlOxIkEow-5P_dpFvNFYY0aq5XGlXkN1VnlT95XyJvw May 10 21:13:59.019565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:13:59.019565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:13:59.019565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:13:59.019565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:13:59.019565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:13:59.019565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:13:59.019565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 9582743483fa4fb88f4e91d3f787c945 May 10 21:13:59.019565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-AttachVolumeNegativeTest-297208105 May 10 21:13:59.019565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:13:59.019565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:13:59.021231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9582743483fa4fb88f4e91d3f787c945", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:13:59.021231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-AttachVolumeNegativeTest-297208105 May 10 21:13:59.021231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 9582743483fa4fb88f4e91d3f787c945 May 10 21:13:59.021231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-297208105 May 10 21:13:59.021231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-AttachVolumeNegativeTest-297208105-project May 10 21:13:59.021231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:13:59.021231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:13:59.021231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 62bc5605a22d408f9b4bac69a0f5f486 May 10 21:13:59.021231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-AttachVolumeNegativeTest-297208105-project May 10 21:13:59.021231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:13:59.021231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance f2a9d425-c6f1-4f23-8fb7-7311ca431fdf could not be found. May 10 21:13:59.021231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': 'f2a9d425-c6f1-4f23-8fb7-7311ca431fdf'} May 10 21:13:59.022156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:13:59.022156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:13:59.022156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:13:59.022156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:13:59.022156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:13:59.022156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:13:59.022156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:13:59.022156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:13:59.022156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:13:59.022156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:13:59.022156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2a9d425-c6f1-4f23-8fb7-7311ca431fdf could not be found. May 10 21:13:59.022156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:13:59.022156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:13:59.022156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:13:59.022156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:13:59.022156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:13:59.022156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:13:59.022156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:13:59.022156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:13:59.022156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:13:59.024122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:13:59.024122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:13:59.024122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:13:59.024122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:13:59.024122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:13:59.024122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:13:59.024122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:13:59.024122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2a9d425-c6f1-4f23-8fb7-7311ca431fdf could not be found. May 10 21:13:59.024122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:13:59.024122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:13:59.024122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:13:59.024122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:13:59.024122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:13:59.024122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:13:59.024122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:13:59.024122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:13:59.024122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2a9d425-c6f1-4f23-8fb7-7311ca431fdf could not be found. May 10 21:13:59.024122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:13:59.025765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8367d5fe-92e6-4de1-803a-bf4560054fda tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Returning 404 to user: Instance f2a9d425-c6f1-4f23-8fb7-7311ca431fdf could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:13:59.025765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8367d5fe-92e6-4de1-803a-bf4560054fda tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 404 len: 111 microversion: 2.1 time: 0.031052 May 10 21:13:59.025765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 363/760] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:58 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:13:59.031129 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-043b6631-7064-484b-bb09-576ed433eae7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '.version_select at 0x7f85d5455820>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:59.104813 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-043b6631-7064-484b-bb09-576ed433eae7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1354916562" status: 202 len: 0 microversion: 2.1 time: 0.077348 May 10 21:13:59.105318 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 398/761] 10.222.0.49 () {58 vars in 1220 bytes} [Tue May 10 21:13:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1354916562 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:13:59.692482 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9ed5b905-3d8f-4add-b128-73b9b92e43dc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:59.693016 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9ed5b905-3d8f-4add-b128-73b9b92e43dc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:59.699777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ed5b905-3d8f-4add-b128-73b9b92e43dc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:59.700226 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ed5b905-3d8f-4add-b128-73b9b92e43dc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:59.701048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ed5b905-3d8f-4add-b128-73b9b92e43dc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:59.701509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ed5b905-3d8f-4add-b128-73b9b92e43dc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:59.903873 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9ed5b905-3d8f-4add-b128-73b9b92e43dc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:13:59.912422 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9ed5b905-3d8f-4add-b128-73b9b92e43dc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.223922 May 10 21:13:59.912673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 364/762] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:13:59 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:13:59.930641 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f02383dd-f6c6-4765-8cc8-8844eb517027 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:59.931688 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f02383dd-f6c6-4765-8cc8-8844eb517027 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:59.938848 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f02383dd-f6c6-4765-8cc8-8844eb517027 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:59.939408 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f02383dd-f6c6-4765-8cc8-8844eb517027 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:59.942843 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f02383dd-f6c6-4765-8cc8-8844eb517027 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:59.942843 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f02383dd-f6c6-4765-8cc8-8844eb517027 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:59.969917 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f02383dd-f6c6-4765-8cc8-8844eb517027 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043946 May 10 21:13:59.970788 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 399/763] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:13:59 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:13:59.972621 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-50b6cb0c-f127-44e3-b370-37d2038d635d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:13:59.973166 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-50b6cb0c-f127-44e3-b370-37d2038d635d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:13:59.979860 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50b6cb0c-f127-44e3-b370-37d2038d635d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:59.980311 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50b6cb0c-f127-44e3-b370-37d2038d635d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:13:59.981084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50b6cb0c-f127-44e3-b370-37d2038d635d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:13:59.981521 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50b6cb0c-f127-44e3-b370-37d2038d635d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:00.060982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.objects.instance [None req-50b6cb0c-f127-44e3-b370-37d2038d635d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lazy-loading 'services' on Instance uuid 4b28c992-788d-4e37-b194-aaf2fb61577b {{(pid=117714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:14:00.229012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-50b6cb0c-f127-44e3-b370-37d2038d635d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments/678a2357-0815-4dbd-af6f-4f32d017941d" status: 202 len: 0 microversion: 2.1 time: 0.260624 May 10 21:14:00.229606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 365/764] 10.222.0.49 () {58 vars in 1415 bytes} [Tue May 10 21:13:59 2022] DELETE /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments/678a2357-0815-4dbd-af6f-4f32d017941d => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 21:14:00.238145 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-8989bbd6-1643-48a4-b178-e9d923aeb869 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:00.239189 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-8989bbd6-1643-48a4-b178-e9d923aeb869 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:00.245775 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8989bbd6-1643-48a4-b178-e9d923aeb869 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:00.246299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8989bbd6-1643-48a4-b178-e9d923aeb869 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:00.247158 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8989bbd6-1643-48a4-b178-e9d923aeb869 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:00.247682 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8989bbd6-1643-48a4-b178-e9d923aeb869 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:00.277122 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-8989bbd6-1643-48a4-b178-e9d923aeb869 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043141 May 10 21:14:00.277672 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 400/765] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:00 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:00.930288 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2aea070a-7813-4c03-8812-7637f2befdf7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:00.930996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2aea070a-7813-4c03-8812-7637f2befdf7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:00.937287 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2aea070a-7813-4c03-8812-7637f2befdf7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:00.937743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2aea070a-7813-4c03-8812-7637f2befdf7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:00.938521 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2aea070a-7813-4c03-8812-7637f2befdf7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:00.941082 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2aea070a-7813-4c03-8812-7637f2befdf7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:00.980892 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6f55eab1-2d91-433d-90a1-aeb760554a5c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:00.982123 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6f55eab1-2d91-433d-90a1-aeb760554a5c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:00.988418 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6f55eab1-2d91-433d-90a1-aeb760554a5c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:00.988872 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6f55eab1-2d91-433d-90a1-aeb760554a5c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:00.989648 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6f55eab1-2d91-433d-90a1-aeb760554a5c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:00.990094 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6f55eab1-2d91-433d-90a1-aeb760554a5c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:01.020423 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6f55eab1-2d91-433d-90a1-aeb760554a5c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043540 May 10 21:14:01.020985 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 401/766] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:00 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:14:01.134166 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2aea070a-7813-4c03-8812-7637f2befdf7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:01.141855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2aea070a-7813-4c03-8812-7637f2befdf7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.215905 May 10 21:14:01.142409 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 366/767] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:00 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:14:01.289092 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6174fec9-b85a-4581-8281-c8086ef703d0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:01.290076 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6174fec9-b85a-4581-8281-c8086ef703d0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:01.296045 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6174fec9-b85a-4581-8281-c8086ef703d0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:01.296496 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6174fec9-b85a-4581-8281-c8086ef703d0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:01.297263 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6174fec9-b85a-4581-8281-c8086ef703d0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:01.297703 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6174fec9-b85a-4581-8281-c8086ef703d0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:01.326900 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6174fec9-b85a-4581-8281-c8086ef703d0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041952 May 10 21:14:01.327482 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 402/768] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:01 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:02.032871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-85d65464-0c07-4eea-8cb2-d846260d1faa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:02.033871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-85d65464-0c07-4eea-8cb2-d846260d1faa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:02.040375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-85d65464-0c07-4eea-8cb2-d846260d1faa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:02.040821 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-85d65464-0c07-4eea-8cb2-d846260d1faa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:02.041592 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-85d65464-0c07-4eea-8cb2-d846260d1faa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:02.042035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-85d65464-0c07-4eea-8cb2-d846260d1faa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:02.072933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-85d65464-0c07-4eea-8cb2-d846260d1faa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044028 May 10 21:14:02.073501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 367/769] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:02 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:02.159000 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-8302623a-75e2-4810-b96d-3e75ba34b05a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:02.159581 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-8302623a-75e2-4810-b96d-3e75ba34b05a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:02.166805 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8302623a-75e2-4810-b96d-3e75ba34b05a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:02.167297 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8302623a-75e2-4810-b96d-3e75ba34b05a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:02.168087 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8302623a-75e2-4810-b96d-3e75ba34b05a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:02.168534 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8302623a-75e2-4810-b96d-3e75ba34b05a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:02.338489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d5495b0e-949d-4ca2-a2ad-c2a7f52ef665 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:02.339492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d5495b0e-949d-4ca2-a2ad-c2a7f52ef665 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:02.345612 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d5495b0e-949d-4ca2-a2ad-c2a7f52ef665 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:02.346070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d5495b0e-949d-4ca2-a2ad-c2a7f52ef665 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:02.346862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d5495b0e-949d-4ca2-a2ad-c2a7f52ef665 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:02.347581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d5495b0e-949d-4ca2-a2ad-c2a7f52ef665 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:02.381352 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d5495b0e-949d-4ca2-a2ad-c2a7f52ef665 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047147 May 10 21:14:02.381966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 368/770] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:02 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:14:02.635741 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-8302623a-75e2-4810-b96d-3e75ba34b05a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:02.643545 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-8302623a-75e2-4810-b96d-3e75ba34b05a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.488387 May 10 21:14:02.644114 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 403/771] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:02 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:14:03.084653 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8acdd2fe-bbf2-429e-8bca-4a3772cdcd22 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:03.085499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8acdd2fe-bbf2-429e-8bca-4a3772cdcd22 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:03.092612 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8acdd2fe-bbf2-429e-8bca-4a3772cdcd22 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:03.093070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8acdd2fe-bbf2-429e-8bca-4a3772cdcd22 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:03.093860 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8acdd2fe-bbf2-429e-8bca-4a3772cdcd22 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:03.094283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8acdd2fe-bbf2-429e-8bca-4a3772cdcd22 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:03.122246 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8acdd2fe-bbf2-429e-8bca-4a3772cdcd22 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041687 May 10 21:14:03.122794 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 369/772] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:03 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:03.395245 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-0ed34176-a763-47e0-859a-0c8b785eac05 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:03.396348 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-0ed34176-a763-47e0-859a-0c8b785eac05 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:03.405726 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0ed34176-a763-47e0-859a-0c8b785eac05 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:03.406323 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0ed34176-a763-47e0-859a-0c8b785eac05 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:03.407143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0ed34176-a763-47e0-859a-0c8b785eac05 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:03.407595 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0ed34176-a763-47e0-859a-0c8b785eac05 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:03.436893 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-0ed34176-a763-47e0-859a-0c8b785eac05 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046909 May 10 21:14:03.437446 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 404/773] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:03 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:03.660927 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-605701b9-23d1-4c34-98b8-81a5192322a7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:03.661475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-605701b9-23d1-4c34-98b8-81a5192322a7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:03.667987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-605701b9-23d1-4c34-98b8-81a5192322a7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:03.668440 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-605701b9-23d1-4c34-98b8-81a5192322a7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:03.669211 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-605701b9-23d1-4c34-98b8-81a5192322a7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:03.669650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-605701b9-23d1-4c34-98b8-81a5192322a7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:03.801008 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-605701b9-23d1-4c34-98b8-81a5192322a7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:03.809594 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-605701b9-23d1-4c34-98b8-81a5192322a7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.152661 May 10 21:14:03.810148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 370/774] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:03 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:14:04.134621 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-66d2ca32-9032-4f49-a268-53305f42b295 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:04.135563 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-66d2ca32-9032-4f49-a268-53305f42b295 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:04.141677 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-66d2ca32-9032-4f49-a268-53305f42b295 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:04.142120 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-66d2ca32-9032-4f49-a268-53305f42b295 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:04.142913 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-66d2ca32-9032-4f49-a268-53305f42b295 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:04.143379 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-66d2ca32-9032-4f49-a268-53305f42b295 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:04.172104 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-66d2ca32-9032-4f49-a268-53305f42b295 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042245 May 10 21:14:04.172647 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 405/775] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:04 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:04.448893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1b3c176b-4e50-466b-99e7-1e7ebe5b08f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:04.449813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1b3c176b-4e50-466b-99e7-1e7ebe5b08f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:04.456315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1b3c176b-4e50-466b-99e7-1e7ebe5b08f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:04.456762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1b3c176b-4e50-466b-99e7-1e7ebe5b08f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:04.457518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1b3c176b-4e50-466b-99e7-1e7ebe5b08f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:04.457950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1b3c176b-4e50-466b-99e7-1e7ebe5b08f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:04.486781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1b3c176b-4e50-466b-99e7-1e7ebe5b08f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041990 May 10 21:14:04.487368 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 371/776] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:04 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:04.826023 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-2352a2d6-85bb-472d-9e76-c10db096eef6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:04.826638 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-2352a2d6-85bb-472d-9e76-c10db096eef6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:04.832837 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2352a2d6-85bb-472d-9e76-c10db096eef6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:04.833289 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2352a2d6-85bb-472d-9e76-c10db096eef6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:04.834063 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2352a2d6-85bb-472d-9e76-c10db096eef6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:04.834501 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2352a2d6-85bb-472d-9e76-c10db096eef6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:04.965902 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-2352a2d6-85bb-472d-9e76-c10db096eef6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:04.974041 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-2352a2d6-85bb-472d-9e76-c10db096eef6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151821 May 10 21:14:04.974614 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 406/777] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:04 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:14:05.183734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1ad94804-cbc7-441a-8722-3f6dd9bcf3b9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:05.184843 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1ad94804-cbc7-441a-8722-3f6dd9bcf3b9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:05.191075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1ad94804-cbc7-441a-8722-3f6dd9bcf3b9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:05.191570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1ad94804-cbc7-441a-8722-3f6dd9bcf3b9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:05.192338 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1ad94804-cbc7-441a-8722-3f6dd9bcf3b9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:05.192779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1ad94804-cbc7-441a-8722-3f6dd9bcf3b9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:05.222169 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1ad94804-cbc7-441a-8722-3f6dd9bcf3b9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042479 May 10 21:14:05.222720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 372/778] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:05 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:05.498265 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-3f270359-b1dd-4604-8440-22b21cbe4aa5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:05.499256 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-3f270359-b1dd-4604-8440-22b21cbe4aa5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:05.505703 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3f270359-b1dd-4604-8440-22b21cbe4aa5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:05.506156 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3f270359-b1dd-4604-8440-22b21cbe4aa5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:05.506925 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3f270359-b1dd-4604-8440-22b21cbe4aa5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:05.507398 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3f270359-b1dd-4604-8440-22b21cbe4aa5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:05.535837 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-3f270359-b1dd-4604-8440-22b21cbe4aa5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041543 May 10 21:14:05.536381 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 407/779] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:05 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:05.993312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-62d764b4-b97b-42dd-a6ba-e6c55152c77e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:05.993957 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-62d764b4-b97b-42dd-a6ba-e6c55152c77e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:06.000277 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-62d764b4-b97b-42dd-a6ba-e6c55152c77e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:06.000731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-62d764b4-b97b-42dd-a6ba-e6c55152c77e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:06.001505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-62d764b4-b97b-42dd-a6ba-e6c55152c77e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:06.001945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-62d764b4-b97b-42dd-a6ba-e6c55152c77e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:06.134322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-62d764b4-b97b-42dd-a6ba-e6c55152c77e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:06.142103 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-62d764b4-b97b-42dd-a6ba-e6c55152c77e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.153309 May 10 21:14:06.142670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 373/780] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:05 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:14:06.233499 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-b6c1d25d-8c54-4ec4-b235-b34727d5ceec tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:06.234719 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-b6c1d25d-8c54-4ec4-b235-b34727d5ceec tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:06.240766 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b6c1d25d-8c54-4ec4-b235-b34727d5ceec tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:06.241213 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b6c1d25d-8c54-4ec4-b235-b34727d5ceec tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:06.241971 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b6c1d25d-8c54-4ec4-b235-b34727d5ceec tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:06.242995 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b6c1d25d-8c54-4ec4-b235-b34727d5ceec tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:06.270721 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-b6c1d25d-8c54-4ec4-b235-b34727d5ceec tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041173 May 10 21:14:06.271288 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 408/781] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:06 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:06.546653 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-593601d0-97de-4d9d-abdb-5bf10bfbe130 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:06.547610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-593601d0-97de-4d9d-abdb-5bf10bfbe130 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:06.553589 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-593601d0-97de-4d9d-abdb-5bf10bfbe130 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:06.554042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-593601d0-97de-4d9d-abdb-5bf10bfbe130 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:06.554811 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-593601d0-97de-4d9d-abdb-5bf10bfbe130 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:06.555297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-593601d0-97de-4d9d-abdb-5bf10bfbe130 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:06.587994 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-593601d0-97de-4d9d-abdb-5bf10bfbe130 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045297 May 10 21:14:06.588549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 374/782] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:06 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:07.159889 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-08d39cf7-8c20-47c1-a423-a08ced8bafef tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:07.160497 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-08d39cf7-8c20-47c1-a423-a08ced8bafef tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:07.167254 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-08d39cf7-8c20-47c1-a423-a08ced8bafef tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:07.167698 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-08d39cf7-8c20-47c1-a423-a08ced8bafef tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:07.168457 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-08d39cf7-8c20-47c1-a423-a08ced8bafef tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:07.168888 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-08d39cf7-8c20-47c1-a423-a08ced8bafef tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:07.282555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1efa88ce-e658-4a00-8841-0d4a543b74ae tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:07.283626 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1efa88ce-e658-4a00-8841-0d4a543b74ae tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:07.290177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1efa88ce-e658-4a00-8841-0d4a543b74ae tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:07.290692 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1efa88ce-e658-4a00-8841-0d4a543b74ae tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:07.291491 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1efa88ce-e658-4a00-8841-0d4a543b74ae tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:07.291928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1efa88ce-e658-4a00-8841-0d4a543b74ae tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:07.297892 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-08d39cf7-8c20-47c1-a423-a08ced8bafef tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:07.306209 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-08d39cf7-8c20-47c1-a423-a08ced8bafef tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150146 May 10 21:14:07.306941 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 409/783] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:07 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:14:07.322020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1efa88ce-e658-4a00-8841-0d4a543b74ae tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043363 May 10 21:14:07.322561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 375/784] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:07 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:14:07.599674 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-455fff84-0886-4ee8-a0d9-13b9ebb9e5d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:07.600649 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-455fff84-0886-4ee8-a0d9-13b9ebb9e5d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:07.607926 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-455fff84-0886-4ee8-a0d9-13b9ebb9e5d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:07.608376 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-455fff84-0886-4ee8-a0d9-13b9ebb9e5d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:07.609150 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-455fff84-0886-4ee8-a0d9-13b9ebb9e5d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:07.609587 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-455fff84-0886-4ee8-a0d9-13b9ebb9e5d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:07.639365 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-455fff84-0886-4ee8-a0d9-13b9ebb9e5d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043655 May 10 21:14:07.639923 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 410/785] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:07 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:08.323969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-175ddf74-4b30-4e7b-947b-a591c3730a04 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:08.324573 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-175ddf74-4b30-4e7b-947b-a591c3730a04 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:08.331169 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-175ddf74-4b30-4e7b-947b-a591c3730a04 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:08.331621 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-175ddf74-4b30-4e7b-947b-a591c3730a04 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:08.332394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-175ddf74-4b30-4e7b-947b-a591c3730a04 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:08.332829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-175ddf74-4b30-4e7b-947b-a591c3730a04 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:08.333461 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-180645dd-fb98-4a23-ae51-e0cd4138dcba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:08.334409 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-180645dd-fb98-4a23-ae51-e0cd4138dcba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:08.341464 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-180645dd-fb98-4a23-ae51-e0cd4138dcba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:08.341918 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-180645dd-fb98-4a23-ae51-e0cd4138dcba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:08.342679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-180645dd-fb98-4a23-ae51-e0cd4138dcba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:08.343112 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-180645dd-fb98-4a23-ae51-e0cd4138dcba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:08.371606 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-180645dd-fb98-4a23-ae51-e0cd4138dcba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041990 May 10 21:14:08.372172 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 411/786] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:08 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:14:08.464071 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-175ddf74-4b30-4e7b-947b-a591c3730a04 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:08.471804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-175ddf74-4b30-4e7b-947b-a591c3730a04 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.152163 May 10 21:14:08.472378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 376/787] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:08 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:14:08.651003 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-1f4e3457-efdd-4f0e-9c05-9bcb541ad48a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:08.651946 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-1f4e3457-efdd-4f0e-9c05-9bcb541ad48a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:08.657865 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1f4e3457-efdd-4f0e-9c05-9bcb541ad48a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:08.658312 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1f4e3457-efdd-4f0e-9c05-9bcb541ad48a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:08.659066 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1f4e3457-efdd-4f0e-9c05-9bcb541ad48a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:08.659528 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1f4e3457-efdd-4f0e-9c05-9bcb541ad48a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:08.689463 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-1f4e3457-efdd-4f0e-9c05-9bcb541ad48a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042426 May 10 21:14:08.690045 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 412/788] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:08 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:09.382904 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-30e9e540-df9e-40c2-a375-763fc1d95c54 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:09.383939 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-30e9e540-df9e-40c2-a375-763fc1d95c54 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:09.390216 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-30e9e540-df9e-40c2-a375-763fc1d95c54 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:09.390655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-30e9e540-df9e-40c2-a375-763fc1d95c54 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:09.391451 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-30e9e540-df9e-40c2-a375-763fc1d95c54 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:09.391896 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-30e9e540-df9e-40c2-a375-763fc1d95c54 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:09.420766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-30e9e540-df9e-40c2-a375-763fc1d95c54 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041841 May 10 21:14:09.421311 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 377/789] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:09 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:09.488280 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-b5a9bf09-745f-49f9-9b5f-701f20306ea0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:09.488897 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-b5a9bf09-745f-49f9-9b5f-701f20306ea0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:09.495314 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b5a9bf09-745f-49f9-9b5f-701f20306ea0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:09.503037 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b5a9bf09-745f-49f9-9b5f-701f20306ea0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:09.503037 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b5a9bf09-745f-49f9-9b5f-701f20306ea0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:09.503037 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b5a9bf09-745f-49f9-9b5f-701f20306ea0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:09.626956 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-b5a9bf09-745f-49f9-9b5f-701f20306ea0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:09.635681 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-b5a9bf09-745f-49f9-9b5f-701f20306ea0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151082 May 10 21:14:09.636213 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 413/790] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:09 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:14:09.702249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f375be60-0a03-416f-b98d-6082d1071e5f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:09.703315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f375be60-0a03-416f-b98d-6082d1071e5f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:09.709319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f375be60-0a03-416f-b98d-6082d1071e5f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:09.709761 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f375be60-0a03-416f-b98d-6082d1071e5f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:09.710530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f375be60-0a03-416f-b98d-6082d1071e5f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:09.710961 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f375be60-0a03-416f-b98d-6082d1071e5f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:09.742816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f375be60-0a03-416f-b98d-6082d1071e5f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044205 May 10 21:14:09.743523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 378/791] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:09 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:10.433232 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-390f87a8-f7fc-4152-a28a-f40fc51ea16f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:10.434163 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-390f87a8-f7fc-4152-a28a-f40fc51ea16f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:10.440951 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-390f87a8-f7fc-4152-a28a-f40fc51ea16f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:10.449021 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-390f87a8-f7fc-4152-a28a-f40fc51ea16f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:10.449021 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-390f87a8-f7fc-4152-a28a-f40fc51ea16f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:10.449021 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-390f87a8-f7fc-4152-a28a-f40fc51ea16f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:10.474386 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-390f87a8-f7fc-4152-a28a-f40fc51ea16f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045851 May 10 21:14:10.474952 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 414/792] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:10 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:10.653194 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4889249c-74dd-4f64-a9a7-e20ea43211ad tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:10.653809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4889249c-74dd-4f64-a9a7-e20ea43211ad tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:10.660707 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4889249c-74dd-4f64-a9a7-e20ea43211ad tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:10.661165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4889249c-74dd-4f64-a9a7-e20ea43211ad tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:10.661965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4889249c-74dd-4f64-a9a7-e20ea43211ad tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:10.662397 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4889249c-74dd-4f64-a9a7-e20ea43211ad tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:10.754692 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6007a699-92b0-427b-8aa2-0ec520517451 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:10.755664 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6007a699-92b0-427b-8aa2-0ec520517451 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:10.762984 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6007a699-92b0-427b-8aa2-0ec520517451 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:10.763468 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6007a699-92b0-427b-8aa2-0ec520517451 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:10.764250 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6007a699-92b0-427b-8aa2-0ec520517451 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:10.764693 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6007a699-92b0-427b-8aa2-0ec520517451 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:10.795092 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6007a699-92b0-427b-8aa2-0ec520517451 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044380 May 10 21:14:10.795704 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 415/793] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:10 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:10.804207 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4889249c-74dd-4f64-a9a7-e20ea43211ad tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:10.815076 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4889249c-74dd-4f64-a9a7-e20ea43211ad tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.166351 May 10 21:14:10.815951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 379/794] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:10 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:14:11.486306 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9e55f9f4-4853-46b8-b8a7-81c1699e234f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:11.487274 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-9e55f9f4-4853-46b8-b8a7-81c1699e234f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:11.493979 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9e55f9f4-4853-46b8-b8a7-81c1699e234f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:11.494456 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9e55f9f4-4853-46b8-b8a7-81c1699e234f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:11.495328 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9e55f9f4-4853-46b8-b8a7-81c1699e234f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:11.495773 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9e55f9f4-4853-46b8-b8a7-81c1699e234f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:11.525577 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9e55f9f4-4853-46b8-b8a7-81c1699e234f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043483 May 10 21:14:11.526121 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 416/795] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:11 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:14:11.806712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-654ea00b-aa49-42a3-8d53-65ce7579c28f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:11.807718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-654ea00b-aa49-42a3-8d53-65ce7579c28f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:11.814528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-654ea00b-aa49-42a3-8d53-65ce7579c28f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:11.815069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-654ea00b-aa49-42a3-8d53-65ce7579c28f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:11.816113 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-654ea00b-aa49-42a3-8d53-65ce7579c28f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:11.816544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-654ea00b-aa49-42a3-8d53-65ce7579c28f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:11.833620 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c9088ea9-51dd-421f-8862-010a98fdf0d3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:11.836998 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c9088ea9-51dd-421f-8862-010a98fdf0d3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:11.840479 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c9088ea9-51dd-421f-8862-010a98fdf0d3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:11.840928 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c9088ea9-51dd-421f-8862-010a98fdf0d3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:11.841712 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c9088ea9-51dd-421f-8862-010a98fdf0d3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:11.842201 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c9088ea9-51dd-421f-8862-010a98fdf0d3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:11.846979 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-654ea00b-aa49-42a3-8d53-65ce7579c28f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044081 May 10 21:14:11.846979 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 380/796] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:11 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:11.975921 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-c9088ea9-51dd-421f-8862-010a98fdf0d3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:11.984270 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c9088ea9-51dd-421f-8862-010a98fdf0d3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1715 microversion: 2.1 time: 0.154508 May 10 21:14:11.984832 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 417/797] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:11 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1715 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:14:12.037917 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-389ebb2c-dcbe-4618-a580-18bd810ee2eb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:12.038412 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-389ebb2c-dcbe-4618-a580-18bd810ee2eb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:12.044680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-389ebb2c-dcbe-4618-a580-18bd810ee2eb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:12.045126 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-389ebb2c-dcbe-4618-a580-18bd810ee2eb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:12.045882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-389ebb2c-dcbe-4618-a580-18bd810ee2eb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:12.046322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-389ebb2c-dcbe-4618-a580-18bd810ee2eb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:12.157511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-389ebb2c-dcbe-4618-a580-18bd810ee2eb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] HTTP exception thrown: Cannot 'detach_volume' instance cf6fc652-5ef0-417d-af13-69c7c058d50e while it is in vm_state rescued May 10 21:14:12.159148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-389ebb2c-dcbe-4618-a580-18bd810ee2eb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Request method failure captured: May 10 21:14:12.159148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: DELETE /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments/1b1f159c-b02f-49b7-bcdc-8267b5586104 HTTP/1.1 May 10 21:14:12.159148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:14:12.159148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:14:12.159148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:14:12.159148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:14:12.159148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:14:12.159148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:14:12.159148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:14:12.159148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:14:12.159148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietRu9ss3zgPFeC7849fUJOM8Q7EL5_flR4rJLt-W88oUCLUpwLmWbh98c8K1xLUyN74oKQGClHuOnEt6Xj1A1n_QZ5oD8Vcsq78BUnvY-1ELPjE6x7POzOrC2wKu1Ebpq6A7wmyq8_x_zbC73jSynu5MTHLRXN5eyRUhQ9bV1BQSx8s May 10 21:14:12.159148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:14:12.159148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:14:12.159148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:14:12.159148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:14:12.159148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:14:12.159148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:14:12.159148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: bba0283b32bc4c54ae7cfcb1f984db42 May 10 21:14:12.159148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-171931591 May 10 21:14:12.159148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:14:12.159148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:14:12.160744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bba0283b32bc4c54ae7cfcb1f984db42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bba0283b32bc4c54ae7cfcb1f984db42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bba0283b32bc4c54ae7cfcb1f984db42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bba0283b32bc4c54ae7cfcb1f984db42", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:14:12.160744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-ServerRescueNegativeTestJSON-171931591 May 10 21:14:12.160744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: bba0283b32bc4c54ae7cfcb1f984db42 May 10 21:14:12.160744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-171931591 May 10 21:14:12.160744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-ServerRescueNegativeTestJSON-171931591-project May 10 21:14:12.160744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:14:12.160744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:14:12.160744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: fe93eb8c93fb4cb4bec6f7cc2c03e1eb May 10 21:14:12.160744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-ServerRescueNegativeTestJSON-171931591-project May 10 21:14:12.160744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:14:12.160744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Cannot 'detach_volume' instance cf6fc652-5ef0-417d-af13-69c7c058d50e while it is in vm_state rescued May 10 21:14:12.161633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'server_id': 'cf6fc652-5ef0-417d-af13-69c7c058d50e', 'id': '1b1f159c-b02f-49b7-bcdc-8267b5586104'} May 10 21:14:12.161633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:14:12.161633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:14:12.161633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 10 21:14:12.161633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 10 21:14:12.161633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 21:14:12.161633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 21:14:12.161633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 21:14:12.161633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 21:14:12.161633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cf6fc652-5ef0-417d-af13-69c7c058d50e in vm_state rescued. Cannot detach_volume while the instance is in this state. May 10 21:14:12.161633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:14:12.161633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:14:12.161633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:14:12.161633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:14:12.161633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:14:12.161633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:14:12.161633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:14:12.161633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:14:12.161633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:14:12.161633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:14:12.163251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 10 21:14:12.163251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 21:14:12.163251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 21:14:12.163251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 21:14:12.163251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance cf6fc652-5ef0-417d-af13-69c7c058d50e while it is in vm_state rescued May 10 21:14:12.163251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:14:12.163251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:14:12.163251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:14:12.163251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:14:12.163251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:14:12.163251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:14:12.163251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:14:12.163251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:14:12.163251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance cf6fc652-5ef0-417d-af13-69c7c058d50e while it is in vm_state rescued May 10 21:14:12.163251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:14:12.163251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-389ebb2c-dcbe-4618-a580-18bd810ee2eb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Returning 409 to user: Cannot 'detach_volume' instance cf6fc652-5ef0-417d-af13-69c7c058d50e while it is in vm_state rescued {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:14:12.166133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-389ebb2c-dcbe-4618-a580-18bd810ee2eb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments/1b1f159c-b02f-49b7-bcdc-8267b5586104" status: 409 len: 152 microversion: 2.1 time: 0.126598 May 10 21:14:12.166133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 381/798] 10.222.0.49 () {58 vars in 1415 bytes} [Tue May 10 21:14:12 2022] DELETE /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments/1b1f159c-b02f-49b7-bcdc-8267b5586104 => generated 152 bytes in 128 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 21:14:12.169604 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d3bd7a51-1dba-4a82-8c52-b1c684287b0c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:14:12.170140 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d3bd7a51-1dba-4a82-8c52-b1c684287b0c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:12.176057 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d3bd7a51-1dba-4a82-8c52-b1c684287b0c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:12.176502 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d3bd7a51-1dba-4a82-8c52-b1c684287b0c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:12.177261 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d3bd7a51-1dba-4a82-8c52-b1c684287b0c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:12.177699 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d3bd7a51-1dba-4a82-8c52-b1c684287b0c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:12.398828 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d3bd7a51-1dba-4a82-8c52-b1c684287b0c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "POST /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/action" status: 202 len: 0 microversion: 2.1 time: 0.232715 May 10 21:14:12.399493 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 418/799] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 21:14:12 2022] POST /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:14:12.408195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b0f07427-53ca-4b17-9ab9-7ad8dd34742e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:12.408893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b0f07427-53ca-4b17-9ab9-7ad8dd34742e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:12.415967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b0f07427-53ca-4b17-9ab9-7ad8dd34742e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:12.416411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b0f07427-53ca-4b17-9ab9-7ad8dd34742e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:12.418376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b0f07427-53ca-4b17-9ab9-7ad8dd34742e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:12.418376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b0f07427-53ca-4b17-9ab9-7ad8dd34742e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:12.537882 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-005b402b-25df-4a98-9bf8-55cf6207fa70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:12.538900 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-005b402b-25df-4a98-9bf8-55cf6207fa70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:12.545694 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-005b402b-25df-4a98-9bf8-55cf6207fa70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:12.546143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-005b402b-25df-4a98-9bf8-55cf6207fa70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:12.546917 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-005b402b-25df-4a98-9bf8-55cf6207fa70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:12.547403 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-005b402b-25df-4a98-9bf8-55cf6207fa70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:12.578293 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-005b402b-25df-4a98-9bf8-55cf6207fa70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044760 May 10 21:14:12.578854 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 419/800] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:12 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:14:12.583297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b0f07427-53ca-4b17-9ab9-7ad8dd34742e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:12.591853 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b0f07427-53ca-4b17-9ab9-7ad8dd34742e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1723 microversion: 2.1 time: 0.187536 May 10 21:14:12.592412 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 382/801] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:12 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:14:12.858741 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-565770df-6e03-44f8-8950-e5b55be94b3f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:12.859693 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-565770df-6e03-44f8-8950-e5b55be94b3f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:12.865968 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-565770df-6e03-44f8-8950-e5b55be94b3f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:12.866413 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-565770df-6e03-44f8-8950-e5b55be94b3f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:12.867185 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-565770df-6e03-44f8-8950-e5b55be94b3f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:12.868241 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-565770df-6e03-44f8-8950-e5b55be94b3f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:12.896673 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-565770df-6e03-44f8-8950-e5b55be94b3f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041857 May 10 21:14:12.899087 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 420/802] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:12 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:13.590156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-78cfdddc-cb7e-469a-b1aa-22d88a84e048 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:13.591086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-78cfdddc-cb7e-469a-b1aa-22d88a84e048 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:13.597239 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-78cfdddc-cb7e-469a-b1aa-22d88a84e048 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:13.597688 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-78cfdddc-cb7e-469a-b1aa-22d88a84e048 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:13.598458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-78cfdddc-cb7e-469a-b1aa-22d88a84e048 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:13.598912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-78cfdddc-cb7e-469a-b1aa-22d88a84e048 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:13.608712 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c8b894ef-4e80-492f-b432-75639f4342b3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:13.609667 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c8b894ef-4e80-492f-b432-75639f4342b3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:13.615252 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c8b894ef-4e80-492f-b432-75639f4342b3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:13.615704 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c8b894ef-4e80-492f-b432-75639f4342b3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:13.616474 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c8b894ef-4e80-492f-b432-75639f4342b3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:13.616903 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c8b894ef-4e80-492f-b432-75639f4342b3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:13.631048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-78cfdddc-cb7e-469a-b1aa-22d88a84e048 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045367 May 10 21:14:13.631663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 383/803] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:13 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:13.745179 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-c8b894ef-4e80-492f-b432-75639f4342b3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:13.752892 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c8b894ef-4e80-492f-b432-75639f4342b3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1723 microversion: 2.1 time: 0.148064 May 10 21:14:13.753450 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 421/804] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:13 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:14:13.908846 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3d486c02-c589-4bf1-824c-21e34cfb7a04 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:13.909695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3d486c02-c589-4bf1-824c-21e34cfb7a04 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:13.916638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d486c02-c589-4bf1-824c-21e34cfb7a04 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:13.917083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d486c02-c589-4bf1-824c-21e34cfb7a04 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:13.917844 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d486c02-c589-4bf1-824c-21e34cfb7a04 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:13.918276 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d486c02-c589-4bf1-824c-21e34cfb7a04 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:13.947257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3d486c02-c589-4bf1-824c-21e34cfb7a04 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042255 May 10 21:14:13.947809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 384/805] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:13 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:14.643205 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d8a42c26-917f-4a1f-adb4-d91d2d70d44f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:14.644128 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d8a42c26-917f-4a1f-adb4-d91d2d70d44f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:14.650783 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d8a42c26-917f-4a1f-adb4-d91d2d70d44f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:14.651261 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d8a42c26-917f-4a1f-adb4-d91d2d70d44f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:14.652028 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d8a42c26-917f-4a1f-adb4-d91d2d70d44f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:14.652462 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d8a42c26-917f-4a1f-adb4-d91d2d70d44f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:14.682302 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d8a42c26-917f-4a1f-adb4-d91d2d70d44f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043041 May 10 21:14:14.682859 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 422/806] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:14 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:14.769718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d79856a1-a88a-47ef-9cd2-62eaf963ed39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:14.770459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d79856a1-a88a-47ef-9cd2-62eaf963ed39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:14.776855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d79856a1-a88a-47ef-9cd2-62eaf963ed39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:14.777304 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d79856a1-a88a-47ef-9cd2-62eaf963ed39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:14.778064 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d79856a1-a88a-47ef-9cd2-62eaf963ed39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:14.778495 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d79856a1-a88a-47ef-9cd2-62eaf963ed39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:14.905946 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d79856a1-a88a-47ef-9cd2-62eaf963ed39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:14.913705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d79856a1-a88a-47ef-9cd2-62eaf963ed39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1723 microversion: 2.1 time: 0.147882 May 10 21:14:14.915151 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 385/807] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:14 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:14:14.958392 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a3813aef-607d-4996-8969-c656deedf4cf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:14.959377 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a3813aef-607d-4996-8969-c656deedf4cf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:14.965520 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a3813aef-607d-4996-8969-c656deedf4cf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:14.969246 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a3813aef-607d-4996-8969-c656deedf4cf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:14.969246 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a3813aef-607d-4996-8969-c656deedf4cf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:14.969246 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a3813aef-607d-4996-8969-c656deedf4cf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:14.996323 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a3813aef-607d-4996-8969-c656deedf4cf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041855 May 10 21:14:14.996864 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 423/808] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:14 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:15.793574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f47478a2-547c-476f-ab64-a8e761f04816 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:15.794694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f47478a2-547c-476f-ab64-a8e761f04816 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:15.800695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f47478a2-547c-476f-ab64-a8e761f04816 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:15.801143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f47478a2-547c-476f-ab64-a8e761f04816 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:15.801905 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f47478a2-547c-476f-ab64-a8e761f04816 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:15.802341 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f47478a2-547c-476f-ab64-a8e761f04816 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:15.832077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f47478a2-547c-476f-ab64-a8e761f04816 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.142305 May 10 21:14:15.832639 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 386/809] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:15 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:15.932323 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-24fb21cc-c5eb-4c73-a6e4-d697d81697c1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:15.932866 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-24fb21cc-c5eb-4c73-a6e4-d697d81697c1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:15.939081 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-24fb21cc-c5eb-4c73-a6e4-d697d81697c1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:15.941364 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-24fb21cc-c5eb-4c73-a6e4-d697d81697c1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:15.941364 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-24fb21cc-c5eb-4c73-a6e4-d697d81697c1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:15.941364 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-24fb21cc-c5eb-4c73-a6e4-d697d81697c1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:16.010578 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4e295ded-34a4-4289-ac26-b712fbf32779 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:16.010578 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4e295ded-34a4-4289-ac26-b712fbf32779 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:16.015683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4e295ded-34a4-4289-ac26-b712fbf32779 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:16.016387 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4e295ded-34a4-4289-ac26-b712fbf32779 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:16.017231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4e295ded-34a4-4289-ac26-b712fbf32779 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:16.017737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4e295ded-34a4-4289-ac26-b712fbf32779 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:16.049858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4e295ded-34a4-4289-ac26-b712fbf32779 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045779 May 10 21:14:16.050418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 387/810] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:16 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:14:16.073472 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-24fb21cc-c5eb-4c73-a6e4-d697d81697c1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:16.081414 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-24fb21cc-c5eb-4c73-a6e4-d697d81697c1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1729 microversion: 2.1 time: 0.153188 May 10 21:14:16.081975 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 424/811] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:15 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:14:16.098204 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-82a17eb4-cf71-40b5-9d26-e0238ed7adf5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:16.098690 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-82a17eb4-cf71-40b5-9d26-e0238ed7adf5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:16.104757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-82a17eb4-cf71-40b5-9d26-e0238ed7adf5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:16.105201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-82a17eb4-cf71-40b5-9d26-e0238ed7adf5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:16.105959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-82a17eb4-cf71-40b5-9d26-e0238ed7adf5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:16.106390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-82a17eb4-cf71-40b5-9d26-e0238ed7adf5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:16.183199 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-82a17eb4-cf71-40b5-9d26-e0238ed7adf5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088852 May 10 21:14:16.183768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 388/812] 10.222.0.49 () {58 vars in 1274 bytes} [Tue May 10 21:14:16 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:16.843856 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-8f3bd555-8313-4ae4-9288-bbe8f0d7ff48 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:16.844816 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-8f3bd555-8313-4ae4-9288-bbe8f0d7ff48 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:16.850658 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8f3bd555-8313-4ae4-9288-bbe8f0d7ff48 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:16.851106 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8f3bd555-8313-4ae4-9288-bbe8f0d7ff48 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:16.851948 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8f3bd555-8313-4ae4-9288-bbe8f0d7ff48 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:16.852391 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8f3bd555-8313-4ae4-9288-bbe8f0d7ff48 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:16.886778 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-8f3bd555-8313-4ae4-9288-bbe8f0d7ff48 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044391 May 10 21:14:16.886778 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 425/813] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:16 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:17.063416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f42ee711-0629-47ca-aa05-52011e9f8d4d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:17.064363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f42ee711-0629-47ca-aa05-52011e9f8d4d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:17.072205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f42ee711-0629-47ca-aa05-52011e9f8d4d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:17.072652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f42ee711-0629-47ca-aa05-52011e9f8d4d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:17.073474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f42ee711-0629-47ca-aa05-52011e9f8d4d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:17.073918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f42ee711-0629-47ca-aa05-52011e9f8d4d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:17.105030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f42ee711-0629-47ca-aa05-52011e9f8d4d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046444 May 10 21:14:17.105622 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 389/814] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:17 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:17.402700 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [req-1033c85c-85ff-4c52-a840-76847e62f0da req-95467972-fa8f-497e-913a-9f77c8f067b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf6fc652-5ef0-417d-af13-69c7c058d50e", "tag": "ced08b04-cda9-4a73-82de-1764e13bc529"}]} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:14:17.412130 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-1033c85c-85ff-4c52-a840-76847e62f0da req-95467972-fa8f-497e-913a-9f77c8f067b6 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:17.412662 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-1033c85c-85ff-4c52-a840-76847e62f0da req-95467972-fa8f-497e-913a-9f77c8f067b6 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:17.428796 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.compute.server_external_events [req-1033c85c-85ff-4c52-a840-76847e62f0da req-95467972-fa8f-497e-913a-9f77c8f067b6 service nova] Creating event network-changed:ced08b04-cda9-4a73-82de-1764e13bc529 for instance cf6fc652-5ef0-417d-af13-69c7c058d50e on hv-cinder-82880 May 10 21:14:17.433880 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [req-1033c85c-85ff-4c52-a840-76847e62f0da req-95467972-fa8f-497e-913a-9f77c8f067b6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035514 May 10 21:14:17.434522 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 426/815] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:17.896355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-591764ac-4275-4107-9995-826d77cbdb46 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:17.897274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-591764ac-4275-4107-9995-826d77cbdb46 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:17.903772 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-591764ac-4275-4107-9995-826d77cbdb46 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:17.904216 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-591764ac-4275-4107-9995-826d77cbdb46 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:17.904982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-591764ac-4275-4107-9995-826d77cbdb46 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:17.905522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-591764ac-4275-4107-9995-826d77cbdb46 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:17.936188 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-591764ac-4275-4107-9995-826d77cbdb46 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043844 May 10 21:14:17.937172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 390/816] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:17 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:18.117995 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-8aa3513d-2003-48d9-8c79-91671f2a0b67 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:18.119063 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-8aa3513d-2003-48d9-8c79-91671f2a0b67 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:18.125505 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8aa3513d-2003-48d9-8c79-91671f2a0b67 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:18.125958 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8aa3513d-2003-48d9-8c79-91671f2a0b67 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:18.126737 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8aa3513d-2003-48d9-8c79-91671f2a0b67 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:18.127204 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8aa3513d-2003-48d9-8c79-91671f2a0b67 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:18.159720 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-8aa3513d-2003-48d9-8c79-91671f2a0b67 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046595 May 10 21:14:18.160315 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 427/817] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:18 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:18.947930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ae05078b-08b5-4746-8a66-c7a503b9cfdd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:18.949190 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ae05078b-08b5-4746-8a66-c7a503b9cfdd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:18.955723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae05078b-08b5-4746-8a66-c7a503b9cfdd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:18.956171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae05078b-08b5-4746-8a66-c7a503b9cfdd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:18.956929 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae05078b-08b5-4746-8a66-c7a503b9cfdd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:18.957364 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae05078b-08b5-4746-8a66-c7a503b9cfdd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:18.986455 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ae05078b-08b5-4746-8a66-c7a503b9cfdd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042520 May 10 21:14:18.986998 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 391/818] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:18 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:19.171413 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-25561b67-a888-483c-adf4-4b3099f75763 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:19.172343 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-25561b67-a888-483c-adf4-4b3099f75763 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:19.178690 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-25561b67-a888-483c-adf4-4b3099f75763 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:19.179170 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-25561b67-a888-483c-adf4-4b3099f75763 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:19.179943 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-25561b67-a888-483c-adf4-4b3099f75763 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:19.180491 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-25561b67-a888-483c-adf4-4b3099f75763 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:19.208891 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-25561b67-a888-483c-adf4-4b3099f75763 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041456 May 10 21:14:19.209362 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 428/819] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:19 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:19.448453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-d9ca4879-47c4-4abd-9563-77a884cf3b9a req-a0979c04-1356-4eb9-a5bf-27cea25ce31e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf6fc652-5ef0-417d-af13-69c7c058d50e", "tag": "ced08b04-cda9-4a73-82de-1764e13bc529"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:14:19.457339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-d9ca4879-47c4-4abd-9563-77a884cf3b9a req-a0979c04-1356-4eb9-a5bf-27cea25ce31e service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:19.457789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-d9ca4879-47c4-4abd-9563-77a884cf3b9a req-a0979c04-1356-4eb9-a5bf-27cea25ce31e service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:19.469756 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-d9ca4879-47c4-4abd-9563-77a884cf3b9a req-a0979c04-1356-4eb9-a5bf-27cea25ce31e service nova] Creating event network-changed:ced08b04-cda9-4a73-82de-1764e13bc529 for instance cf6fc652-5ef0-417d-af13-69c7c058d50e on hv-cinder-82880 May 10 21:14:19.474746 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-d9ca4879-47c4-4abd-9563-77a884cf3b9a req-a0979c04-1356-4eb9-a5bf-27cea25ce31e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030613 May 10 21:14:19.475393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 392/820] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:19.998084 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-2e1ea2cb-466d-4283-b3be-110d578b3788 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:19.999012 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-2e1ea2cb-466d-4283-b3be-110d578b3788 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:20.004851 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2e1ea2cb-466d-4283-b3be-110d578b3788 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:20.005303 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2e1ea2cb-466d-4283-b3be-110d578b3788 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:20.006075 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2e1ea2cb-466d-4283-b3be-110d578b3788 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:20.006515 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2e1ea2cb-466d-4283-b3be-110d578b3788 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:20.036143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-2e1ea2cb-466d-4283-b3be-110d578b3788 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041993 May 10 21:14:20.036626 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 429/821] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:19 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:20.221835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0d79692b-f5b5-45da-a22e-3a28c184528a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:20.222831 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0d79692b-f5b5-45da-a22e-3a28c184528a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:20.228929 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d79692b-f5b5-45da-a22e-3a28c184528a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:20.229370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d79692b-f5b5-45da-a22e-3a28c184528a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:20.230124 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d79692b-f5b5-45da-a22e-3a28c184528a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:20.230555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d79692b-f5b5-45da-a22e-3a28c184528a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:20.259067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0d79692b-f5b5-45da-a22e-3a28c184528a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041870 May 10 21:14:20.259646 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 393/822] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:20 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:21.049487 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-3d735b32-be4d-4e74-8f0e-5397a67539a1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:21.050410 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-3d735b32-be4d-4e74-8f0e-5397a67539a1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:21.056850 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3d735b32-be4d-4e74-8f0e-5397a67539a1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:21.057356 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3d735b32-be4d-4e74-8f0e-5397a67539a1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:21.058115 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3d735b32-be4d-4e74-8f0e-5397a67539a1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:21.058547 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3d735b32-be4d-4e74-8f0e-5397a67539a1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:21.088969 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-3d735b32-be4d-4e74-8f0e-5397a67539a1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043481 May 10 21:14:21.089518 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 430/823] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:21 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:21.270504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3575e084-0b1f-4cf9-9963-b0607f257b48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:21.271500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3575e084-0b1f-4cf9-9963-b0607f257b48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:21.278118 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3575e084-0b1f-4cf9-9963-b0607f257b48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:21.278563 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3575e084-0b1f-4cf9-9963-b0607f257b48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:21.279349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3575e084-0b1f-4cf9-9963-b0607f257b48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:21.279786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3575e084-0b1f-4cf9-9963-b0607f257b48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:21.308454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3575e084-0b1f-4cf9-9963-b0607f257b48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041830 May 10 21:14:21.309117 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 394/824] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:21 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:22.100789 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9a451e30-b90e-4769-bcd1-e35a8400a303 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:22.102668 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-9a451e30-b90e-4769-bcd1-e35a8400a303 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:22.109263 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9a451e30-b90e-4769-bcd1-e35a8400a303 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:22.109709 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9a451e30-b90e-4769-bcd1-e35a8400a303 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:22.110471 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9a451e30-b90e-4769-bcd1-e35a8400a303 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:22.110908 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9a451e30-b90e-4769-bcd1-e35a8400a303 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:22.139996 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9a451e30-b90e-4769-bcd1-e35a8400a303 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043169 May 10 21:14:22.140537 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 431/825] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:22 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:22.320083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4cd39851-9a37-480a-85dd-98f07bdda742 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:22.321190 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4cd39851-9a37-480a-85dd-98f07bdda742 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:22.327533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4cd39851-9a37-480a-85dd-98f07bdda742 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:22.327980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4cd39851-9a37-480a-85dd-98f07bdda742 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:22.328741 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4cd39851-9a37-480a-85dd-98f07bdda742 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:22.329177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4cd39851-9a37-480a-85dd-98f07bdda742 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:22.358439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4cd39851-9a37-480a-85dd-98f07bdda742 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042531 May 10 21:14:22.358914 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 395/826] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:22 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:23.152918 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-764276f4-490a-40ef-bb7a-8993fc639ad6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:23.153847 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-764276f4-490a-40ef-bb7a-8993fc639ad6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:23.160343 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-764276f4-490a-40ef-bb7a-8993fc639ad6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:23.160832 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-764276f4-490a-40ef-bb7a-8993fc639ad6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:23.161639 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-764276f4-490a-40ef-bb7a-8993fc639ad6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:23.162114 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-764276f4-490a-40ef-bb7a-8993fc639ad6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:23.190500 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-764276f4-490a-40ef-bb7a-8993fc639ad6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042585 May 10 21:14:23.191329 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 432/827] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:23 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:23.370286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b0446f04-9268-4075-b333-bbf4a98172e1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:23.371244 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b0446f04-9268-4075-b333-bbf4a98172e1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:23.377640 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b0446f04-9268-4075-b333-bbf4a98172e1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:23.378093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b0446f04-9268-4075-b333-bbf4a98172e1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:23.378886 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b0446f04-9268-4075-b333-bbf4a98172e1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:23.379361 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b0446f04-9268-4075-b333-bbf4a98172e1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:23.409012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b0446f04-9268-4075-b333-bbf4a98172e1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043209 May 10 21:14:23.409499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 396/828] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:23 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:24.202557 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6e77e684-622f-4f64-bcbc-74243f5531a9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:24.203542 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6e77e684-622f-4f64-bcbc-74243f5531a9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:24.209918 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6e77e684-622f-4f64-bcbc-74243f5531a9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:24.210372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6e77e684-622f-4f64-bcbc-74243f5531a9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:24.211804 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6e77e684-622f-4f64-bcbc-74243f5531a9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:24.212336 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6e77e684-622f-4f64-bcbc-74243f5531a9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:24.241436 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6e77e684-622f-4f64-bcbc-74243f5531a9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042860 May 10 21:14:24.241992 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 433/829] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:24 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:24.419675 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ce70ef40-ffd4-40dd-b58c-beaa6d298df1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:24.420602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ce70ef40-ffd4-40dd-b58c-beaa6d298df1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:24.426966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ce70ef40-ffd4-40dd-b58c-beaa6d298df1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:24.436014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ce70ef40-ffd4-40dd-b58c-beaa6d298df1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:24.436014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ce70ef40-ffd4-40dd-b58c-beaa6d298df1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:24.436014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ce70ef40-ffd4-40dd-b58c-beaa6d298df1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:24.458225 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ce70ef40-ffd4-40dd-b58c-beaa6d298df1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042487 May 10 21:14:24.458785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 397/830] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:24 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:25.253666 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d1c2095a-9df6-4a78-ab10-c0a3ce86411b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:25.254630 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d1c2095a-9df6-4a78-ab10-c0a3ce86411b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:25.261330 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d1c2095a-9df6-4a78-ab10-c0a3ce86411b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:25.261796 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d1c2095a-9df6-4a78-ab10-c0a3ce86411b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:25.262547 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d1c2095a-9df6-4a78-ab10-c0a3ce86411b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:25.262984 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d1c2095a-9df6-4a78-ab10-c0a3ce86411b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:25.292832 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d1c2095a-9df6-4a78-ab10-c0a3ce86411b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043128 May 10 21:14:25.293377 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 434/831] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:25 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:25.565263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fdeede66-b715-4d6e-b6a2-5ec1fa975434 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:25.566433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fdeede66-b715-4d6e-b6a2-5ec1fa975434 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:25.573530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fdeede66-b715-4d6e-b6a2-5ec1fa975434 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:25.573975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fdeede66-b715-4d6e-b6a2-5ec1fa975434 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:25.574739 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fdeede66-b715-4d6e-b6a2-5ec1fa975434 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:25.575205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fdeede66-b715-4d6e-b6a2-5ec1fa975434 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:25.604552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fdeede66-b715-4d6e-b6a2-5ec1fa975434 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138669 May 10 21:14:25.605119 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 398/832] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:25 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:26.304468 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-36dd679d-5387-4314-af45-eb27a343830e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:26.306569 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-36dd679d-5387-4314-af45-eb27a343830e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:26.312934 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-36dd679d-5387-4314-af45-eb27a343830e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:26.313385 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-36dd679d-5387-4314-af45-eb27a343830e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:26.314151 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-36dd679d-5387-4314-af45-eb27a343830e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:26.314589 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-36dd679d-5387-4314-af45-eb27a343830e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:26.343779 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-36dd679d-5387-4314-af45-eb27a343830e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043306 May 10 21:14:26.344334 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 435/833] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:26 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:26.615960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-52b9a1a4-7579-4997-b4fe-48cd8476068f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:26.616889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-52b9a1a4-7579-4997-b4fe-48cd8476068f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:26.624459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52b9a1a4-7579-4997-b4fe-48cd8476068f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:26.624907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52b9a1a4-7579-4997-b4fe-48cd8476068f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:26.625679 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52b9a1a4-7579-4997-b4fe-48cd8476068f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:26.626119 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52b9a1a4-7579-4997-b4fe-48cd8476068f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:26.656567 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-52b9a1a4-7579-4997-b4fe-48cd8476068f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044577 May 10 21:14:26.657127 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 399/834] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:26 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:27.355665 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-4f0b0171-e137-4891-8f91-96be35fc0099 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:27.356582 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-4f0b0171-e137-4891-8f91-96be35fc0099 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:27.362878 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4f0b0171-e137-4891-8f91-96be35fc0099 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:27.366073 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4f0b0171-e137-4891-8f91-96be35fc0099 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:27.366073 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4f0b0171-e137-4891-8f91-96be35fc0099 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:27.366073 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4f0b0171-e137-4891-8f91-96be35fc0099 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:27.395652 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-4f0b0171-e137-4891-8f91-96be35fc0099 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044139 May 10 21:14:27.396200 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 436/835] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:27 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:27.668126 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0073fee6-c49a-4998-b7f3-1f0d3132ebb2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:27.669051 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0073fee6-c49a-4998-b7f3-1f0d3132ebb2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:27.675413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0073fee6-c49a-4998-b7f3-1f0d3132ebb2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:27.675855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0073fee6-c49a-4998-b7f3-1f0d3132ebb2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:27.676606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0073fee6-c49a-4998-b7f3-1f0d3132ebb2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:27.677037 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0073fee6-c49a-4998-b7f3-1f0d3132ebb2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:27.707595 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0073fee6-c49a-4998-b7f3-1f0d3132ebb2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043510 May 10 21:14:27.708150 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 400/836] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:27 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:28.408153 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6e5fcaf7-60fc-4c34-ba79-90292e9cd62b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:28.409080 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6e5fcaf7-60fc-4c34-ba79-90292e9cd62b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:28.416238 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6e5fcaf7-60fc-4c34-ba79-90292e9cd62b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:28.416691 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6e5fcaf7-60fc-4c34-ba79-90292e9cd62b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:28.417455 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6e5fcaf7-60fc-4c34-ba79-90292e9cd62b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:28.417895 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6e5fcaf7-60fc-4c34-ba79-90292e9cd62b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:28.448168 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6e5fcaf7-60fc-4c34-ba79-90292e9cd62b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043994 May 10 21:14:28.448721 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 437/837] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:28 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:28.719767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5286a321-7598-49a2-9836-a9b353b243ce tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:28.720691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5286a321-7598-49a2-9836-a9b353b243ce tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:28.727617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5286a321-7598-49a2-9836-a9b353b243ce tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:28.728071 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5286a321-7598-49a2-9836-a9b353b243ce tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:28.728834 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5286a321-7598-49a2-9836-a9b353b243ce tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:28.729271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5286a321-7598-49a2-9836-a9b353b243ce tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:28.757552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5286a321-7598-49a2-9836-a9b353b243ce tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041749 May 10 21:14:28.758104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 401/838] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:28 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:29.459868 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-7e93feac-34ea-4cec-bd01-1e6eb78939aa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:29.461539 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-7e93feac-34ea-4cec-bd01-1e6eb78939aa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:29.467884 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7e93feac-34ea-4cec-bd01-1e6eb78939aa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:29.468335 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7e93feac-34ea-4cec-bd01-1e6eb78939aa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:29.469113 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7e93feac-34ea-4cec-bd01-1e6eb78939aa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:29.469557 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7e93feac-34ea-4cec-bd01-1e6eb78939aa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:29.498688 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-7e93feac-34ea-4cec-bd01-1e6eb78939aa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042770 May 10 21:14:29.499258 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 438/839] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:29 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:29.768872 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-398638ac-aa11-4928-8a55-3e32bfd40fe3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:29.769727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-398638ac-aa11-4928-8a55-3e32bfd40fe3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:29.776658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-398638ac-aa11-4928-8a55-3e32bfd40fe3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:29.777110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-398638ac-aa11-4928-8a55-3e32bfd40fe3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:29.777876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-398638ac-aa11-4928-8a55-3e32bfd40fe3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:29.778314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-398638ac-aa11-4928-8a55-3e32bfd40fe3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:29.807997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-398638ac-aa11-4928-8a55-3e32bfd40fe3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043151 May 10 21:14:29.808556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 402/840] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:29 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:30.511089 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d8c2fe75-8d56-4791-8ee1-def49e49db85 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:30.512064 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d8c2fe75-8d56-4791-8ee1-def49e49db85 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:30.518327 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d8c2fe75-8d56-4791-8ee1-def49e49db85 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:30.518767 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d8c2fe75-8d56-4791-8ee1-def49e49db85 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:30.519547 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d8c2fe75-8d56-4791-8ee1-def49e49db85 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:30.519981 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d8c2fe75-8d56-4791-8ee1-def49e49db85 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:30.548698 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d8c2fe75-8d56-4791-8ee1-def49e49db85 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042354 May 10 21:14:30.549237 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 439/841] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:30 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:30.819941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f6f03efd-b63a-4f1f-8c72-fe56e95b87ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:30.820938 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f6f03efd-b63a-4f1f-8c72-fe56e95b87ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:30.827535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6f03efd-b63a-4f1f-8c72-fe56e95b87ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:30.827983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6f03efd-b63a-4f1f-8c72-fe56e95b87ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:30.828756 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6f03efd-b63a-4f1f-8c72-fe56e95b87ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:30.829187 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6f03efd-b63a-4f1f-8c72-fe56e95b87ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:30.857678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f6f03efd-b63a-4f1f-8c72-fe56e95b87ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042039 May 10 21:14:30.858247 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 403/842] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:30 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:31.177055 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9fa88f30-5bbd-48c6-abf1-8fa4c6c32b95 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:31.177988 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-9fa88f30-5bbd-48c6-abf1-8fa4c6c32b95 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:31.184172 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9fa88f30-5bbd-48c6-abf1-8fa4c6c32b95 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:31.184629 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9fa88f30-5bbd-48c6-abf1-8fa4c6c32b95 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:31.185414 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9fa88f30-5bbd-48c6-abf1-8fa4c6c32b95 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:31.185856 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9fa88f30-5bbd-48c6-abf1-8fa4c6c32b95 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:31.214065 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9fa88f30-5bbd-48c6-abf1-8fa4c6c32b95 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040914 May 10 21:14:31.214612 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 440/843] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:31 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 21:14:31.269687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bb9c22ec-0636-4813-ba63-ff66c2b21957 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:31.270185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bb9c22ec-0636-4813-ba63-ff66c2b21957 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:31.276625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bb9c22ec-0636-4813-ba63-ff66c2b21957 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:31.277067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bb9c22ec-0636-4813-ba63-ff66c2b21957 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:31.277823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bb9c22ec-0636-4813-ba63-ff66c2b21957 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:31.278252 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bb9c22ec-0636-4813-ba63-ff66c2b21957 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:31.303211 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bb9c22ec-0636-4813-ba63-ff66c2b21957 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Going to try to terminate instance {{(pid=117714) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:14:31.554956 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bb9c22ec-0636-4813-ba63-ff66c2b21957 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "DELETE /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 204 len: 0 microversion: 2.1 time: 0.288639 May 10 21:14:31.555607 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 404/844] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 21:14:31 2022] DELETE /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 21:14:31.560641 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a58eb993-d98e-4ddc-944c-7f816afdca4b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:31.561711 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a58eb993-d98e-4ddc-944c-7f816afdca4b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:31.564003 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4db523f4-4419-4b79-90ad-b51d43905c66 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:31.564840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4db523f4-4419-4b79-90ad-b51d43905c66 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:31.568179 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a58eb993-d98e-4ddc-944c-7f816afdca4b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:31.568740 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a58eb993-d98e-4ddc-944c-7f816afdca4b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:31.569510 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a58eb993-d98e-4ddc-944c-7f816afdca4b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:31.569973 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a58eb993-d98e-4ddc-944c-7f816afdca4b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:31.570834 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4db523f4-4419-4b79-90ad-b51d43905c66 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:31.571822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4db523f4-4419-4b79-90ad-b51d43905c66 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:31.572591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4db523f4-4419-4b79-90ad-b51d43905c66 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:31.573028 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4db523f4-4419-4b79-90ad-b51d43905c66 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:31.602294 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a58eb993-d98e-4ddc-944c-7f816afdca4b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045661 May 10 21:14:31.603414 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 441/845] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:31 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:14:31.710995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4db523f4-4419-4b79-90ad-b51d43905c66 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:31.718968 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4db523f4-4419-4b79-90ad-b51d43905c66 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1673 microversion: 2.1 time: 0.158998 May 10 21:14:31.719566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 405/846] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:31 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:14:31.869985 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e488115e-ccc8-4120-a1a0-6f6a8603ec2e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:31.870921 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e488115e-ccc8-4120-a1a0-6f6a8603ec2e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:31.877115 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e488115e-ccc8-4120-a1a0-6f6a8603ec2e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:31.877557 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e488115e-ccc8-4120-a1a0-6f6a8603ec2e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:31.878317 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e488115e-ccc8-4120-a1a0-6f6a8603ec2e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:31.878753 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e488115e-ccc8-4120-a1a0-6f6a8603ec2e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:31.908335 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e488115e-ccc8-4120-a1a0-6f6a8603ec2e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042942 May 10 21:14:31.908885 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 442/847] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:31 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:32.613965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d1e6f641-4eed-4196-84f0-982407c47ec7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:32.614938 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d1e6f641-4eed-4196-84f0-982407c47ec7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:32.622184 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d1e6f641-4eed-4196-84f0-982407c47ec7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:32.622664 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d1e6f641-4eed-4196-84f0-982407c47ec7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:32.623458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d1e6f641-4eed-4196-84f0-982407c47ec7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:32.623896 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d1e6f641-4eed-4196-84f0-982407c47ec7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:32.652633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d1e6f641-4eed-4196-84f0-982407c47ec7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042676 May 10 21:14:32.653184 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 406/848] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:32 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:32.736185 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c55296d4-fdce-4ae5-bf79-ced46b5198b3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:32.736802 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c55296d4-fdce-4ae5-bf79-ced46b5198b3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:32.743566 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c55296d4-fdce-4ae5-bf79-ced46b5198b3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:32.744013 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c55296d4-fdce-4ae5-bf79-ced46b5198b3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:32.744774 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c55296d4-fdce-4ae5-bf79-ced46b5198b3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:32.745214 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c55296d4-fdce-4ae5-bf79-ced46b5198b3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:32.875059 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-c55296d4-fdce-4ae5-bf79-ced46b5198b3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:32.882480 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c55296d4-fdce-4ae5-bf79-ced46b5198b3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1673 microversion: 2.1 time: 0.150194 May 10 21:14:32.883042 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 443/849] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:32 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:14:32.920600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5f001969-d96b-44fd-9d4e-723b232ca51b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:32.921521 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5f001969-d96b-44fd-9d4e-723b232ca51b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:32.927385 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f001969-d96b-44fd-9d4e-723b232ca51b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:32.927832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f001969-d96b-44fd-9d4e-723b232ca51b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:32.928590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f001969-d96b-44fd-9d4e-723b232ca51b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:32.929022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f001969-d96b-44fd-9d4e-723b232ca51b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:32.957811 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5f001969-d96b-44fd-9d4e-723b232ca51b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041172 May 10 21:14:32.958359 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 407/850] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:32 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:33.664353 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e47552c1-74e4-40b7-ac35-983bfb5c8b11 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:33.665468 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e47552c1-74e4-40b7-ac35-983bfb5c8b11 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:33.671552 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e47552c1-74e4-40b7-ac35-983bfb5c8b11 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:33.672000 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e47552c1-74e4-40b7-ac35-983bfb5c8b11 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:33.672766 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e47552c1-74e4-40b7-ac35-983bfb5c8b11 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:33.673205 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e47552c1-74e4-40b7-ac35-983bfb5c8b11 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:33.703585 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e47552c1-74e4-40b7-ac35-983bfb5c8b11 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043139 May 10 21:14:33.704150 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 444/851] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:33 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:33.900461 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0dbcd656-206e-4aaf-b435-35a5db90b387 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:33.901151 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0dbcd656-206e-4aaf-b435-35a5db90b387 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:33.907446 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0dbcd656-206e-4aaf-b435-35a5db90b387 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:33.908646 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0dbcd656-206e-4aaf-b435-35a5db90b387 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:33.908646 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0dbcd656-206e-4aaf-b435-35a5db90b387 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:33.909074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0dbcd656-206e-4aaf-b435-35a5db90b387 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:33.969876 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-7cde84a1-fa49-48c7-b210-7171ae49e74c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:33.970809 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-7cde84a1-fa49-48c7-b210-7171ae49e74c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:33.976940 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7cde84a1-fa49-48c7-b210-7171ae49e74c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:33.977400 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7cde84a1-fa49-48c7-b210-7171ae49e74c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:33.978188 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7cde84a1-fa49-48c7-b210-7171ae49e74c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:33.978631 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7cde84a1-fa49-48c7-b210-7171ae49e74c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:34.009737 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-7cde84a1-fa49-48c7-b210-7171ae49e74c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042774 May 10 21:14:34.010082 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 445/852] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:33 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:14:34.138072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0dbcd656-206e-4aaf-b435-35a5db90b387 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:34.145391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0dbcd656-206e-4aaf-b435-35a5db90b387 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1673 microversion: 2.1 time: 0.249586 May 10 21:14:34.145972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 408/853] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:33 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1673 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:14:34.716196 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-417c1a38-192d-48a0-b72c-1554b9b64364 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:34.717144 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-417c1a38-192d-48a0-b72c-1554b9b64364 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:34.723636 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-417c1a38-192d-48a0-b72c-1554b9b64364 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:34.724336 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-417c1a38-192d-48a0-b72c-1554b9b64364 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:34.725130 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-417c1a38-192d-48a0-b72c-1554b9b64364 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:34.725579 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-417c1a38-192d-48a0-b72c-1554b9b64364 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:34.762442 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-417c1a38-192d-48a0-b72c-1554b9b64364 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050935 May 10 21:14:34.763460 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 446/854] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:34 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:34.817629 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-8914df9a-fc4b-452a-ad4f-2f233433444f req-1cb65dda-f2d6-4ec2-9dc1-f658306d0b70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "504464a5-03e5-42af-a2f3-ca210277d932", "name": "network-vif-deleted", "tag": "c1351ad9-3f5d-4556-bf2a-38dd3150e8b1"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:14:34.827036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-8914df9a-fc4b-452a-ad4f-2f233433444f req-1cb65dda-f2d6-4ec2-9dc1-f658306d0b70 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:34.827559 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-8914df9a-fc4b-452a-ad4f-2f233433444f req-1cb65dda-f2d6-4ec2-9dc1-f658306d0b70 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:34.839827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-8914df9a-fc4b-452a-ad4f-2f233433444f req-1cb65dda-f2d6-4ec2-9dc1-f658306d0b70 service nova] Creating event network-vif-deleted:c1351ad9-3f5d-4556-bf2a-38dd3150e8b1 for instance 504464a5-03e5-42af-a2f3-ca210277d932 on hv-cinder-82880 May 10 21:14:34.845224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-8914df9a-fc4b-452a-ad4f-2f233433444f req-1cb65dda-f2d6-4ec2-9dc1-f658306d0b70 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092662 May 10 21:14:34.848241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 409/855] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:14:35.020499 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f6a47d05-156b-47f0-b17f-427c589eefdf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:35.021564 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f6a47d05-156b-47f0-b17f-427c589eefdf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:35.027644 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f6a47d05-156b-47f0-b17f-427c589eefdf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:35.028329 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f6a47d05-156b-47f0-b17f-427c589eefdf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:35.029233 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f6a47d05-156b-47f0-b17f-427c589eefdf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:35.029741 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f6a47d05-156b-47f0-b17f-427c589eefdf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:35.066379 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f6a47d05-156b-47f0-b17f-427c589eefdf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045586 May 10 21:14:35.066379 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 447/856] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:35 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:35.164117 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-71310fbc-06e7-4a8e-a3a0-300d9052d807 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:35.165463 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-71310fbc-06e7-4a8e-a3a0-300d9052d807 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:35.172938 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71310fbc-06e7-4a8e-a3a0-300d9052d807 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:35.173472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71310fbc-06e7-4a8e-a3a0-300d9052d807 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:35.174324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71310fbc-06e7-4a8e-a3a0-300d9052d807 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:35.174823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71310fbc-06e7-4a8e-a3a0-300d9052d807 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:35.208550 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71310fbc-06e7-4a8e-a3a0-300d9052d807 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:35.209097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71310fbc-06e7-4a8e-a3a0-300d9052d807 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:35.209556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.objects.instance [None req-71310fbc-06e7-4a8e-a3a0-300d9052d807 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lazy-loading 'fault' on Instance uuid 504464a5-03e5-42af-a2f3-ca210277d932 {{(pid=117714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:14:35.251926 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-71310fbc-06e7-4a8e-a3a0-300d9052d807 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:35.259923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-71310fbc-06e7-4a8e-a3a0-300d9052d807 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 200 len: 1328 microversion: 2.1 time: 0.100111 May 10 21:14:35.260580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 410/857] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:35 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 1328 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:14:35.775709 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-ab796ad1-42c7-4acd-a5a4-a781a908171a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:35.777264 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-ab796ad1-42c7-4acd-a5a4-a781a908171a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:35.784241 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ab796ad1-42c7-4acd-a5a4-a781a908171a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:35.784773 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ab796ad1-42c7-4acd-a5a4-a781a908171a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:35.785761 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ab796ad1-42c7-4acd-a5a4-a781a908171a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:35.786299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ab796ad1-42c7-4acd-a5a4-a781a908171a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:35.818317 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-ab796ad1-42c7-4acd-a5a4-a781a908171a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047966 May 10 21:14:35.818881 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 448/858] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:35 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:36.074944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3f582fb0-9f6f-4f90-aff9-c9d8a6d94374 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:36.076078 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3f582fb0-9f6f-4f90-aff9-c9d8a6d94374 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:36.082670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3f582fb0-9f6f-4f90-aff9-c9d8a6d94374 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:36.083230 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3f582fb0-9f6f-4f90-aff9-c9d8a6d94374 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:36.084172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3f582fb0-9f6f-4f90-aff9-c9d8a6d94374 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:36.084695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3f582fb0-9f6f-4f90-aff9-c9d8a6d94374 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:36.114883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3f582fb0-9f6f-4f90-aff9-c9d8a6d94374 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044722 May 10 21:14:36.115460 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 411/859] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:36 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:36.282309 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-b9a66ee1-bb31-4063-a8ef-6454006e15ac tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:36.282935 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-b9a66ee1-bb31-4063-a8ef-6454006e15ac tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:36.289209 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b9a66ee1-bb31-4063-a8ef-6454006e15ac tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:36.289721 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b9a66ee1-bb31-4063-a8ef-6454006e15ac tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:36.290793 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b9a66ee1-bb31-4063-a8ef-6454006e15ac tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:36.291325 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b9a66ee1-bb31-4063-a8ef-6454006e15ac tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:36.304759 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.wsgi [None req-b9a66ee1-bb31-4063-a8ef-6454006e15ac tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] HTTP exception thrown: Instance 504464a5-03e5-42af-a2f3-ca210277d932 could not be found. May 10 21:14:36.307243 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-b9a66ee1-bb31-4063-a8ef-6454006e15ac tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Request method failure captured: May 10 21:14:36.307243 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: request: GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 HTTP/1.1 May 10 21:14:36.307243 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Accept: application/json May 10 21:14:36.307243 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Accept-Encoding: identity May 10 21:14:36.307243 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Connection: close May 10 21:14:36.307243 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Content-Length: 0 May 10 21:14:36.307243 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Content-Type: application/json May 10 21:14:36.307243 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Host: 10.222.0.49 May 10 21:14:36.307243 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Openstack-System-Scope: None May 10 21:14:36.307243 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: User-Agent: python-urllib3/1.26.9 May 10 21:14:36.307243 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Auth-Token: gAAAAABietSAJMT-hnL6qBkRs7bZ3-110HT4ymfZj92vRoBUEAGHIeo_ldK2Vr4zsDgcllgzjIBDSyio1stjSGyxN0jeNBxfaE1kSHTlyNAeVLUtctiC1v8O3DwT8su8M8miZ3QqxTaNbg2K8kPDMc7k5ZJZ4ZhBF8q-vP6lWzvhhrcux6GAj2A May 10 21:14:36.307243 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Domain-Id: None May 10 21:14:36.307243 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Domain-Name: None May 10 21:14:36.307243 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Identity-Status: Confirmed May 10 21:14:36.307243 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Is-Admin-Project: True May 10 21:14:36.307243 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Domain-Id: default May 10 21:14:36.307243 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Domain-Name: Default May 10 21:14:36.307243 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Id: bd946455713e4c36a8efadbce486ee8b May 10 21:14:36.307243 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Project-Name: tempest-AttachVolumeTestJSON-824855839 May 10 21:14:36.307243 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Role: reader,member May 10 21:14:36.307243 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Roles: reader,member May 10 21:14:36.308827 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd946455713e4c36a8efadbce486ee8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bd946455713e4c36a8efadbce486ee8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd946455713e4c36a8efadbce486ee8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bd946455713e4c36a8efadbce486ee8b", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:14:36.308827 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Tenant: tempest-AttachVolumeTestJSON-824855839 May 10 21:14:36.308827 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Tenant-Id: bd946455713e4c36a8efadbce486ee8b May 10 21:14:36.308827 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-Tenant-Name: tempest-AttachVolumeTestJSON-824855839 May 10 21:14:36.308827 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User: tempest-AttachVolumeTestJSON-824855839-project May 10 21:14:36.308827 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Domain-Id: default May 10 21:14:36.308827 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Domain-Name: Default May 10 21:14:36.308827 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Id: dc411f6a0a024e7eac561ad1b6d2a944 May 10 21:14:36.308827 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: X-User-Name: tempest-AttachVolumeTestJSON-824855839-project May 10 21:14:36.308827 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: method: > May 10 21:14:36.308827 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: exception: Instance 504464a5-03e5-42af-a2f3-ca210277d932 could not be found. May 10 21:14:36.308827 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: action_args: {'id': '504464a5-03e5-42af-a2f3-ca210277d932'} May 10 21:14:36.309727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:14:36.309727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:14:36.309727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:14:36.309727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:14:36.309727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:14:36.309727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:14:36.309727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:14:36.309727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:14:36.309727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:14:36.309727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:14:36.309727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 504464a5-03e5-42af-a2f3-ca210277d932 could not be found. May 10 21:14:36.309727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:14:36.309727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:14:36.309727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:14:36.309727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:14:36.309727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:14:36.309727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:14:36.309727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:14:36.309727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:14:36.309727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:14:36.311181 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:14:36.311181 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:14:36.311181 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:14:36.311181 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:14:36.311181 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:14:36.311181 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:14:36.311181 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:14:36.311181 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 504464a5-03e5-42af-a2f3-ca210277d932 could not be found. May 10 21:14:36.311181 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:14:36.311181 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:14:36.311181 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:14:36.311181 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:14:36.311181 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:14:36.311181 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:14:36.311181 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:14:36.311181 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:14:36.311181 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 504464a5-03e5-42af-a2f3-ca210277d932 could not be found. May 10 21:14:36.311181 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: ERROR nova.api.openstack.wsgi May 10 21:14:36.312495 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-b9a66ee1-bb31-4063-a8ef-6454006e15ac tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Returning 404 to user: Instance 504464a5-03e5-42af-a2f3-ca210277d932 could not be found. {{(pid=117713) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:14:36.312495 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-b9a66ee1-bb31-4063-a8ef-6454006e15ac tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 404 len: 111 microversion: 2.1 time: 0.030231 May 10 21:14:36.312495 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 449/860] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:36 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:14:36.317444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-90834e43-ed20-40c6-87ec-f34c0f95b054 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '.version_select at 0x7f85d532e820>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:36.418868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-90834e43-ed20-40c6-87ec-f34c0f95b054 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1236642330" status: 202 len: 0 microversion: 2.1 time: 0.105307 May 10 21:14:36.419468 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 412/861] 10.222.0.49 () {58 vars in 1220 bytes} [Tue May 10 21:14:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1236642330 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:14:36.830081 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9ddc41d8-d8f2-471b-89a8-5fbe0ddccd17 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:36.831109 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-9ddc41d8-d8f2-471b-89a8-5fbe0ddccd17 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:36.837623 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9ddc41d8-d8f2-471b-89a8-5fbe0ddccd17 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:36.838063 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9ddc41d8-d8f2-471b-89a8-5fbe0ddccd17 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:36.838831 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9ddc41d8-d8f2-471b-89a8-5fbe0ddccd17 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:36.839297 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9ddc41d8-d8f2-471b-89a8-5fbe0ddccd17 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:36.869608 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9ddc41d8-d8f2-471b-89a8-5fbe0ddccd17 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043357 May 10 21:14:36.870389 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 450/862] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:36 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:37.126178 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-34d38dd8-ee84-4612-8cd2-795084b7bfb6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:37.127292 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-34d38dd8-ee84-4612-8cd2-795084b7bfb6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:37.134458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-34d38dd8-ee84-4612-8cd2-795084b7bfb6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:37.135035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-34d38dd8-ee84-4612-8cd2-795084b7bfb6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:37.135955 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-34d38dd8-ee84-4612-8cd2-795084b7bfb6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:37.136517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-34d38dd8-ee84-4612-8cd2-795084b7bfb6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:37.136764 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-0222d563-4caf-4e69-9245-fa5c7ab46be3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Action: 'create', calling method: .version_select at 0x7f85d601d5e0>, body: {"keypair": {"name": "tempest-keypair-401881749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISrorKw3RTLESMA9lq9uIdx6NqTYU6ZLM9CLJoe3abqgjyapi9a2664lxsEq26SaOVRx6xp6CB2Ypmy3Hgm46SxLKsYPAr47YaTtOCeGZ5+3erz8Nff1VVRMqh0olflYQ=="}} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:14:37.151051 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.quota [None req-0222d563-4caf-4e69-9245-fa5c7ab46be3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Getting quotas for project bd946455713e4c36a8efadbce486ee8b. Resources: {'key_pairs'} {{(pid=117713) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:14:37.154859 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.quota [None req-0222d563-4caf-4e69-9245-fa5c7ab46be3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Getting quotas for user dc411f6a0a024e7eac561ad1b6d2a944 and project bd946455713e4c36a8efadbce486ee8b. Resources: {'key_pairs'} {{(pid=117713) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:14:37.165799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-34d38dd8-ee84-4612-8cd2-795084b7bfb6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043775 May 10 21:14:37.166372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 413/863] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:37 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:37.224388 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-0222d563-4caf-4e69-9245-fa5c7ab46be3 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.091566 May 10 21:14:37.224976 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 451/864] 10.222.0.49 () {60 vars in 1158 bytes} [Tue May 10 21:14:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:37.880812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a98846bd-85d2-4201-b09b-e93e1565ef05 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:37.881756 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a98846bd-85d2-4201-b09b-e93e1565ef05 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:37.888775 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a98846bd-85d2-4201-b09b-e93e1565ef05 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:37.889226 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a98846bd-85d2-4201-b09b-e93e1565ef05 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:37.889987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a98846bd-85d2-4201-b09b-e93e1565ef05 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:37.890418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a98846bd-85d2-4201-b09b-e93e1565ef05 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:37.919414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a98846bd-85d2-4201-b09b-e93e1565ef05 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042458 May 10 21:14:37.919929 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 414/865] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:37 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:38.178328 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-7d0a9633-df4d-431b-9503-5776fd301be2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:38.179156 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-7d0a9633-df4d-431b-9503-5776fd301be2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:38.186214 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7d0a9633-df4d-431b-9503-5776fd301be2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:38.186662 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7d0a9633-df4d-431b-9503-5776fd301be2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:38.187457 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7d0a9633-df4d-431b-9503-5776fd301be2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:38.187892 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7d0a9633-df4d-431b-9503-5776fd301be2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:38.218196 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-7d0a9633-df4d-431b-9503-5776fd301be2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044708 May 10 21:14:38.218756 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 452/866] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:38 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:38.931370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dcd251ee-f612-4c52-bc97-1f5382e9b468 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:38.932292 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dcd251ee-f612-4c52-bc97-1f5382e9b468 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:38.938648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dcd251ee-f612-4c52-bc97-1f5382e9b468 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:38.939090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dcd251ee-f612-4c52-bc97-1f5382e9b468 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:38.939882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dcd251ee-f612-4c52-bc97-1f5382e9b468 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:38.940319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dcd251ee-f612-4c52-bc97-1f5382e9b468 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:38.971055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dcd251ee-f612-4c52-bc97-1f5382e9b468 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043775 May 10 21:14:38.971743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 415/867] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:38 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:39.230863 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-7e4dbed1-f94d-4170-99c1-161886c68cff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:39.231840 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-7e4dbed1-f94d-4170-99c1-161886c68cff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:39.238429 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7e4dbed1-f94d-4170-99c1-161886c68cff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:39.238881 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7e4dbed1-f94d-4170-99c1-161886c68cff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:39.239702 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7e4dbed1-f94d-4170-99c1-161886c68cff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:39.240139 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7e4dbed1-f94d-4170-99c1-161886c68cff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:39.271611 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-7e4dbed1-f94d-4170-99c1-161886c68cff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045442 May 10 21:14:39.272175 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 453/868] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:39 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:39.363888 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e32a1ff8-633d-4b59-80a0-dd78c1fd1cac tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-794854075", "imageRef": "cb321ccf-1ce7-4dda-90d0-f05332eb6fe1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "478733af-435d-4c58-bab5-39ad34689a2c"}], "security_groups": [{"name": "tempest-securitygroup--1288484889"}], "key_name": "tempest-keypair-401881749", "user_data": "}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:14:39.468720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.network.neutron [None req-e32a1ff8-633d-4b59-80a0-dd78c1fd1cac tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] validate_networks() for [('478733af-435d-4c58-bab5-39ad34689a2c', None, None, None, None, None)] {{(pid=117714) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:14:39.875041 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-e32a1ff8-633d-4b59-80a0-dd78c1fd1cac tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Flavor limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:14:39.875499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-e32a1ff8-633d-4b59-80a0-dd78c1fd1cac tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Image limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:14:39.875982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-e32a1ff8-633d-4b59-80a0-dd78c1fd1cac tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Flavor pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:14:39.876390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-e32a1ff8-633d-4b59-80a0-dd78c1fd1cac tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Image pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:14:39.876796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-e32a1ff8-633d-4b59-80a0-dd78c1fd1cac tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:14:39.886151 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e32a1ff8-633d-4b59-80a0-dd78c1fd1cac tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:39.886669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e32a1ff8-633d-4b59-80a0-dd78c1fd1cac tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:39.887511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e32a1ff8-633d-4b59-80a0-dd78c1fd1cac tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:39.887947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e32a1ff8-633d-4b59-80a0-dd78c1fd1cac tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:39.904684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-e32a1ff8-633d-4b59-80a0-dd78c1fd1cac tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Getting quotas for project bd946455713e4c36a8efadbce486ee8b. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:14:39.908687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-e32a1ff8-633d-4b59-80a0-dd78c1fd1cac tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Getting quotas for user dc411f6a0a024e7eac561ad1b6d2a944 and project bd946455713e4c36a8efadbce486ee8b. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:14:39.920430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e32a1ff8-633d-4b59-80a0-dd78c1fd1cac tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Going to run 1 instances... {{(pid=117714) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:14:39.922721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e32a1ff8-633d-4b59-80a0-dd78c1fd1cac tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 92b6d664-37d6-422f-a52a-0ffec8a44389] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb321ccf-1ce7-4dda-90d0-f05332eb6fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117714) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:14:39.982825 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-80dfb71b-094b-4727-bb5d-2a00a58e3a3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:39.983781 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-80dfb71b-094b-4727-bb5d-2a00a58e3a3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:39.989644 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-80dfb71b-094b-4727-bb5d-2a00a58e3a3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:39.990091 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-80dfb71b-094b-4727-bb5d-2a00a58e3a3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:39.990856 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-80dfb71b-094b-4727-bb5d-2a00a58e3a3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:39.991328 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-80dfb71b-094b-4727-bb5d-2a00a58e3a3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:40.020444 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-80dfb71b-094b-4727-bb5d-2a00a58e3a3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041545 May 10 21:14:40.020991 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 454/869] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:39 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:14:40.059713 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e32a1ff8-633d-4b59-80a0-dd78c1fd1cac tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.700153 May 10 21:14:40.060343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 416/870] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 21:14:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 21:14:40.070255 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-794c5792-9b8f-42a0-a547-d39bb47d0610 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:40.070869 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-794c5792-9b8f-42a0-a547-d39bb47d0610 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 92b6d664-37d6-422f-a52a-0ffec8a44389] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:40.123679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-794c5792-9b8f-42a0-a547-d39bb47d0610 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:40.130387 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-794c5792-9b8f-42a0-a547-d39bb47d0610 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389" status: 200 len: 1236 microversion: 2.1 time: 0.064115 May 10 21:14:40.131040 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 455/871] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:40 2022] GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389 => generated 1236 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:14:40.283353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-faa83969-ba4f-4405-8a23-e89171cd3983 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:40.284357 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-faa83969-ba4f-4405-8a23-e89171cd3983 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:40.291671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-faa83969-ba4f-4405-8a23-e89171cd3983 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:40.292081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-faa83969-ba4f-4405-8a23-e89171cd3983 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:40.292839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-faa83969-ba4f-4405-8a23-e89171cd3983 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:40.293284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-faa83969-ba4f-4405-8a23-e89171cd3983 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:40.323216 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-faa83969-ba4f-4405-8a23-e89171cd3983 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043747 May 10 21:14:40.325669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 417/872] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:40 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:41.033141 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f219393f-52ac-40ff-b6d3-a258d7acf036 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:41.034823 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f219393f-52ac-40ff-b6d3-a258d7acf036 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:41.044332 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f219393f-52ac-40ff-b6d3-a258d7acf036 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:41.044787 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f219393f-52ac-40ff-b6d3-a258d7acf036 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:41.045757 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f219393f-52ac-40ff-b6d3-a258d7acf036 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:41.046196 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f219393f-52ac-40ff-b6d3-a258d7acf036 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:41.076388 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f219393f-52ac-40ff-b6d3-a258d7acf036 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047213 May 10 21:14:41.076942 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 456/873] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:41 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:41.147764 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-29845a08-6e49-462b-ad59-6d6ee0656b91 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:41.148506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-29845a08-6e49-462b-ad59-6d6ee0656b91 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 92b6d664-37d6-422f-a52a-0ffec8a44389] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:41.155645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-29845a08-6e49-462b-ad59-6d6ee0656b91 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:41.156232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-29845a08-6e49-462b-ad59-6d6ee0656b91 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:41.156997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-29845a08-6e49-462b-ad59-6d6ee0656b91 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:41.157428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-29845a08-6e49-462b-ad59-6d6ee0656b91 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:41.219532 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-29845a08-6e49-462b-ad59-6d6ee0656b91 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:41.226994 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-29845a08-6e49-462b-ad59-6d6ee0656b91 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389" status: 200 len: 1240 microversion: 2.1 time: 0.083216 May 10 21:14:41.227605 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 418/874] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:41 2022] GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:14:41.336493 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-29182d6b-7630-4a64-b53f-f3bc11872edb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:41.339318 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-29182d6b-7630-4a64-b53f-f3bc11872edb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:41.345318 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-29182d6b-7630-4a64-b53f-f3bc11872edb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:41.345767 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-29182d6b-7630-4a64-b53f-f3bc11872edb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:41.346546 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-29182d6b-7630-4a64-b53f-f3bc11872edb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:41.346984 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-29182d6b-7630-4a64-b53f-f3bc11872edb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:41.376394 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-29182d6b-7630-4a64-b53f-f3bc11872edb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045801 May 10 21:14:41.376952 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 457/875] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:41 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:42.089136 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0be99a49-011a-4edc-8a2c-6ec67109dca8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:42.091148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0be99a49-011a-4edc-8a2c-6ec67109dca8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:42.096113 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0be99a49-011a-4edc-8a2c-6ec67109dca8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:42.096568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0be99a49-011a-4edc-8a2c-6ec67109dca8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:42.097350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0be99a49-011a-4edc-8a2c-6ec67109dca8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:42.097865 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0be99a49-011a-4edc-8a2c-6ec67109dca8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:42.129568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0be99a49-011a-4edc-8a2c-6ec67109dca8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045187 May 10 21:14:42.133948 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 419/876] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:42 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:42.244684 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-1dc2dec5-3193-4666-bf2b-a4c80581fac5 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:42.245956 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-1dc2dec5-3193-4666-bf2b-a4c80581fac5 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 92b6d664-37d6-422f-a52a-0ffec8a44389] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:42.252429 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1dc2dec5-3193-4666-bf2b-a4c80581fac5 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:42.252880 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1dc2dec5-3193-4666-bf2b-a4c80581fac5 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:42.253665 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1dc2dec5-3193-4666-bf2b-a4c80581fac5 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:42.254153 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1dc2dec5-3193-4666-bf2b-a4c80581fac5 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:42.318028 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-1dc2dec5-3193-4666-bf2b-a4c80581fac5 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:42.325638 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-1dc2dec5-3193-4666-bf2b-a4c80581fac5 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389" status: 200 len: 1294 microversion: 2.1 time: 0.085680 May 10 21:14:42.326527 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 458/877] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:42 2022] GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389 => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:14:42.387830 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2ca55586-6111-49ae-a1da-a9aa78c14413 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:42.389082 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2ca55586-6111-49ae-a1da-a9aa78c14413 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:42.395369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ca55586-6111-49ae-a1da-a9aa78c14413 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:42.395821 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ca55586-6111-49ae-a1da-a9aa78c14413 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:42.396593 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ca55586-6111-49ae-a1da-a9aa78c14413 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:42.397029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ca55586-6111-49ae-a1da-a9aa78c14413 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:42.426710 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2ca55586-6111-49ae-a1da-a9aa78c14413 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043101 May 10 21:14:42.427308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 420/878] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:42 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:43.141972 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-415bfddb-8eb5-46f3-8833-3b028368e747 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:43.142853 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-415bfddb-8eb5-46f3-8833-3b028368e747 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:43.148938 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-415bfddb-8eb5-46f3-8833-3b028368e747 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:43.149393 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-415bfddb-8eb5-46f3-8833-3b028368e747 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:43.150568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-415bfddb-8eb5-46f3-8833-3b028368e747 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:43.151014 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-415bfddb-8eb5-46f3-8833-3b028368e747 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:43.181590 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-415bfddb-8eb5-46f3-8833-3b028368e747 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043099 May 10 21:14:43.182383 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 459/879] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:43 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:43.342930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-99541389-159b-4d62-a56a-ca61d34a0d21 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:43.346036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-99541389-159b-4d62-a56a-ca61d34a0d21 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 92b6d664-37d6-422f-a52a-0ffec8a44389] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:43.352504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-99541389-159b-4d62-a56a-ca61d34a0d21 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:43.354405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-99541389-159b-4d62-a56a-ca61d34a0d21 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:43.355567 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-99541389-159b-4d62-a56a-ca61d34a0d21 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:43.356176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-99541389-159b-4d62-a56a-ca61d34a0d21 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:43.438858 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6fa1b1f3-ae60-43d2-b8a8-99cc8b448cf3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:43.439981 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6fa1b1f3-ae60-43d2-b8a8-99cc8b448cf3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:43.448976 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6fa1b1f3-ae60-43d2-b8a8-99cc8b448cf3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:43.449559 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6fa1b1f3-ae60-43d2-b8a8-99cc8b448cf3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:43.450474 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6fa1b1f3-ae60-43d2-b8a8-99cc8b448cf3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:43.451009 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6fa1b1f3-ae60-43d2-b8a8-99cc8b448cf3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:43.484316 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6fa1b1f3-ae60-43d2-b8a8-99cc8b448cf3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049535 May 10 21:14:43.488236 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 460/880] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:43 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:43.537991 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-99541389-159b-4d62-a56a-ca61d34a0d21 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:43.549462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-99541389-159b-4d62-a56a-ca61d34a0d21 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389" status: 200 len: 1362 microversion: 2.1 time: 0.210160 May 10 21:14:43.550039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 421/881] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:43 2022] GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:14:43.699763 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [req-3b730deb-4ecd-43cb-affe-a579f007e3ee req-bba40f59-82f1-4c09-bba8-777f3088b535 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b6d664-37d6-422f-a52a-0ffec8a44389", "tag": "d3cf0742-1fc1-49a1-93ca-8273a54dbbef"}]} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:14:43.708061 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-3b730deb-4ecd-43cb-affe-a579f007e3ee req-bba40f59-82f1-4c09-bba8-777f3088b535 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:43.709144 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-3b730deb-4ecd-43cb-affe-a579f007e3ee req-bba40f59-82f1-4c09-bba8-777f3088b535 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:43.720450 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.compute.server_external_events [req-3b730deb-4ecd-43cb-affe-a579f007e3ee req-bba40f59-82f1-4c09-bba8-777f3088b535 service nova] Creating event network-changed:d3cf0742-1fc1-49a1-93ca-8273a54dbbef for instance 92b6d664-37d6-422f-a52a-0ffec8a44389 on hv-cinder-82880 May 10 21:14:43.725645 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [req-3b730deb-4ecd-43cb-affe-a579f007e3ee req-bba40f59-82f1-4c09-bba8-777f3088b535 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030381 May 10 21:14:43.726563 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 461/882] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:44.193837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-791d1215-80f7-4538-a51d-5c8694c2315d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:44.194766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-791d1215-80f7-4538-a51d-5c8694c2315d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:44.202138 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-791d1215-80f7-4538-a51d-5c8694c2315d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:44.202503 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-791d1215-80f7-4538-a51d-5c8694c2315d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:44.203317 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-791d1215-80f7-4538-a51d-5c8694c2315d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:44.203752 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-791d1215-80f7-4538-a51d-5c8694c2315d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:44.237128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-791d1215-80f7-4538-a51d-5c8694c2315d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047643 May 10 21:14:44.241041 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 422/883] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:44 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:44.497101 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-93dd8aad-673b-4ab5-a78b-9218918425dc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:44.498038 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-93dd8aad-673b-4ab5-a78b-9218918425dc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:44.504391 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-93dd8aad-673b-4ab5-a78b-9218918425dc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:44.504844 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-93dd8aad-673b-4ab5-a78b-9218918425dc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:44.505613 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-93dd8aad-673b-4ab5-a78b-9218918425dc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:44.506054 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-93dd8aad-673b-4ab5-a78b-9218918425dc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:44.535363 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-93dd8aad-673b-4ab5-a78b-9218918425dc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043113 May 10 21:14:44.536249 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 462/884] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:44 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:44.567206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-df782523-2bec-4670-9dcd-3651405abdc0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:44.567814 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-df782523-2bec-4670-9dcd-3651405abdc0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 92b6d664-37d6-422f-a52a-0ffec8a44389] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:44.574023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df782523-2bec-4670-9dcd-3651405abdc0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:44.574683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df782523-2bec-4670-9dcd-3651405abdc0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:44.575490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df782523-2bec-4670-9dcd-3651405abdc0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:44.575918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df782523-2bec-4670-9dcd-3651405abdc0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:44.726313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-df782523-2bec-4670-9dcd-3651405abdc0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:44.733911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-df782523-2bec-4670-9dcd-3651405abdc0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389" status: 200 len: 1362 microversion: 2.1 time: 0.170929 May 10 21:14:44.734468 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 423/885] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:44 2022] GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:14:45.248980 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6c43a722-ad86-4b0c-a02f-66e8c914d556 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:45.249909 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6c43a722-ad86-4b0c-a02f-66e8c914d556 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:45.256111 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6c43a722-ad86-4b0c-a02f-66e8c914d556 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:45.256565 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6c43a722-ad86-4b0c-a02f-66e8c914d556 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:45.257335 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6c43a722-ad86-4b0c-a02f-66e8c914d556 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:45.257774 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6c43a722-ad86-4b0c-a02f-66e8c914d556 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:45.286202 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6c43a722-ad86-4b0c-a02f-66e8c914d556 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041318 May 10 21:14:45.286751 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 463/886] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:45 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:45.547001 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c90fa2d4-0168-456d-a04f-91fbdd40edcf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:45.547885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c90fa2d4-0168-456d-a04f-91fbdd40edcf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:45.554250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c90fa2d4-0168-456d-a04f-91fbdd40edcf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:45.554703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c90fa2d4-0168-456d-a04f-91fbdd40edcf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:45.555501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c90fa2d4-0168-456d-a04f-91fbdd40edcf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:45.556591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c90fa2d4-0168-456d-a04f-91fbdd40edcf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:45.586601 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c90fa2d4-0168-456d-a04f-91fbdd40edcf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043575 May 10 21:14:45.587355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 424/887] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:45 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:45.750229 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-51035488-761f-4646-9157-96b1150cfc51 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:45.750848 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-51035488-761f-4646-9157-96b1150cfc51 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 92b6d664-37d6-422f-a52a-0ffec8a44389] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:45.757121 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-51035488-761f-4646-9157-96b1150cfc51 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:45.757569 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-51035488-761f-4646-9157-96b1150cfc51 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:45.758366 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-51035488-761f-4646-9157-96b1150cfc51 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:45.758802 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-51035488-761f-4646-9157-96b1150cfc51 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:45.888842 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-51035488-761f-4646-9157-96b1150cfc51 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:45.896225 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-51035488-761f-4646-9157-96b1150cfc51 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389" status: 200 len: 1362 microversion: 2.1 time: 0.149868 May 10 21:14:45.897692 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 464/888] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:45 2022] GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:14:46.297849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-33f70fe0-b379-48c1-8954-284f6989d891 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:46.298806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-33f70fe0-b379-48c1-8954-284f6989d891 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:46.304766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-33f70fe0-b379-48c1-8954-284f6989d891 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:46.305223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-33f70fe0-b379-48c1-8954-284f6989d891 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:46.306163 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-33f70fe0-b379-48c1-8954-284f6989d891 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:46.306664 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-33f70fe0-b379-48c1-8954-284f6989d891 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:46.335622 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-33f70fe0-b379-48c1-8954-284f6989d891 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041793 May 10 21:14:46.336171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 425/889] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:46 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:46.599158 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-56c26acc-85d1-41ff-b5be-de3f1844f6e6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:46.599158 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-56c26acc-85d1-41ff-b5be-de3f1844f6e6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:46.606169 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-56c26acc-85d1-41ff-b5be-de3f1844f6e6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:46.606626 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-56c26acc-85d1-41ff-b5be-de3f1844f6e6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:46.607447 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-56c26acc-85d1-41ff-b5be-de3f1844f6e6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:46.607888 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-56c26acc-85d1-41ff-b5be-de3f1844f6e6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:46.637648 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-56c26acc-85d1-41ff-b5be-de3f1844f6e6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043595 May 10 21:14:46.638189 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 465/890] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:46 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:46.912988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b705f3e5-6519-40a7-bcd6-91d872333b58 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:46.913534 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b705f3e5-6519-40a7-bcd6-91d872333b58 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 92b6d664-37d6-422f-a52a-0ffec8a44389] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:46.920097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b705f3e5-6519-40a7-bcd6-91d872333b58 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:46.920532 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b705f3e5-6519-40a7-bcd6-91d872333b58 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:46.921286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b705f3e5-6519-40a7-bcd6-91d872333b58 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:46.921724 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b705f3e5-6519-40a7-bcd6-91d872333b58 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:47.106749 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b705f3e5-6519-40a7-bcd6-91d872333b58 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:47.114023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b705f3e5-6519-40a7-bcd6-91d872333b58 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389" status: 200 len: 1362 microversion: 2.1 time: 0.204967 May 10 21:14:47.114590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 426/891] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:46 2022] GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:14:47.348433 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d80ab549-812c-4802-9883-be8fcbebcf1b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:47.349366 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d80ab549-812c-4802-9883-be8fcbebcf1b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:47.356144 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d80ab549-812c-4802-9883-be8fcbebcf1b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:47.356611 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d80ab549-812c-4802-9883-be8fcbebcf1b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:47.357369 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d80ab549-812c-4802-9883-be8fcbebcf1b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:47.357812 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d80ab549-812c-4802-9883-be8fcbebcf1b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:47.388335 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d80ab549-812c-4802-9883-be8fcbebcf1b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043839 May 10 21:14:47.388912 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 466/892] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:47 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:47.649124 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9e26ea00-476a-44dd-b593-f1d7162e61bc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:47.650236 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9e26ea00-476a-44dd-b593-f1d7162e61bc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:47.656179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9e26ea00-476a-44dd-b593-f1d7162e61bc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:47.656623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9e26ea00-476a-44dd-b593-f1d7162e61bc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:47.657378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9e26ea00-476a-44dd-b593-f1d7162e61bc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:47.657811 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9e26ea00-476a-44dd-b593-f1d7162e61bc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:47.688150 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9e26ea00-476a-44dd-b593-f1d7162e61bc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042907 May 10 21:14:47.688714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 427/893] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:47 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:48.129695 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c524cee9-dd78-47be-817b-870e35a0cd62 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:48.130315 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c524cee9-dd78-47be-817b-870e35a0cd62 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 92b6d664-37d6-422f-a52a-0ffec8a44389] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:48.136484 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c524cee9-dd78-47be-817b-870e35a0cd62 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:48.136939 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c524cee9-dd78-47be-817b-870e35a0cd62 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:48.137714 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c524cee9-dd78-47be-817b-870e35a0cd62 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:48.138159 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c524cee9-dd78-47be-817b-870e35a0cd62 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:48.265759 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-c524cee9-dd78-47be-817b-870e35a0cd62 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:48.273006 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c524cee9-dd78-47be-817b-870e35a0cd62 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389" status: 200 len: 1362 microversion: 2.1 time: 0.147169 May 10 21:14:48.273566 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 467/894] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:48 2022] GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:14:48.399952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4b9ac116-08c6-44da-a73b-1b8f4531ab7b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:48.400862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4b9ac116-08c6-44da-a73b-1b8f4531ab7b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:48.407165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4b9ac116-08c6-44da-a73b-1b8f4531ab7b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:48.407615 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4b9ac116-08c6-44da-a73b-1b8f4531ab7b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:48.408372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4b9ac116-08c6-44da-a73b-1b8f4531ab7b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:48.408801 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4b9ac116-08c6-44da-a73b-1b8f4531ab7b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:48.437402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4b9ac116-08c6-44da-a73b-1b8f4531ab7b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041644 May 10 21:14:48.437947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 428/895] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:48 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:48.700268 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-41ffc7b9-6b2c-4369-b157-29d8c543e1ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:48.701133 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-41ffc7b9-6b2c-4369-b157-29d8c543e1ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:48.707583 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-41ffc7b9-6b2c-4369-b157-29d8c543e1ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:48.708041 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-41ffc7b9-6b2c-4369-b157-29d8c543e1ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:48.708804 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-41ffc7b9-6b2c-4369-b157-29d8c543e1ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:48.709243 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-41ffc7b9-6b2c-4369-b157-29d8c543e1ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:48.738322 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-41ffc7b9-6b2c-4369-b157-29d8c543e1ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042280 May 10 21:14:48.738893 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 468/896] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:48 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:49.289813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-63a19233-3b48-4c07-8fee-64f4b83985c9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:49.291255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-63a19233-3b48-4c07-8fee-64f4b83985c9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 92b6d664-37d6-422f-a52a-0ffec8a44389] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:49.297083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-63a19233-3b48-4c07-8fee-64f4b83985c9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:49.297532 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-63a19233-3b48-4c07-8fee-64f4b83985c9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:49.298295 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-63a19233-3b48-4c07-8fee-64f4b83985c9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:49.298731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-63a19233-3b48-4c07-8fee-64f4b83985c9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:49.420218 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [req-fc561fc9-70cf-4e91-952a-87c795fd2256 req-801417a2-4474-421a-b06b-c42d47ebc76e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b6d664-37d6-422f-a52a-0ffec8a44389", "name": "network-vif-plugged", "status": "completed", "tag": "d3cf0742-1fc1-49a1-93ca-8273a54dbbef"}]} {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:14:49.428069 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-fc561fc9-70cf-4e91-952a-87c795fd2256 req-801417a2-4474-421a-b06b-c42d47ebc76e service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:49.428606 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [req-fc561fc9-70cf-4e91-952a-87c795fd2256 req-801417a2-4474-421a-b06b-c42d47ebc76e service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:49.429657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-63a19233-3b48-4c07-8fee-64f4b83985c9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:49.438061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-63a19233-3b48-4c07-8fee-64f4b83985c9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389" status: 200 len: 1362 microversion: 2.1 time: 0.151991 May 10 21:14:49.444282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.compute.server_external_events [req-fc561fc9-70cf-4e91-952a-87c795fd2256 req-801417a2-4474-421a-b06b-c42d47ebc76e service nova] Creating event network-vif-plugged:d3cf0742-1fc1-49a1-93ca-8273a54dbbef for instance 92b6d664-37d6-422f-a52a-0ffec8a44389 on hv-cinder-82880 May 10 21:14:49.448970 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 429/897] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:49 2022] GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:14:49.453531 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [req-fc561fc9-70cf-4e91-952a-87c795fd2256 req-801417a2-4474-421a-b06b-c42d47ebc76e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102252 May 10 21:14:49.456489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5f8fd7e8-8409-4c46-b50d-793dd7a71d29 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:49.456675 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 469/898] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:14:49.456812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5f8fd7e8-8409-4c46-b50d-793dd7a71d29 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:49.461506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f8fd7e8-8409-4c46-b50d-793dd7a71d29 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:49.462055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f8fd7e8-8409-4c46-b50d-793dd7a71d29 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:49.463516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f8fd7e8-8409-4c46-b50d-793dd7a71d29 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:49.463804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f8fd7e8-8409-4c46-b50d-793dd7a71d29 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:49.495345 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5f8fd7e8-8409-4c46-b50d-793dd7a71d29 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045193 May 10 21:14:49.495934 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 430/899] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:49 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:49.713403 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-30103980-8b0c-447c-8aac-e64573bd938a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:49.714032 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-30103980-8b0c-447c-8aac-e64573bd938a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:49.720120 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-30103980-8b0c-447c-8aac-e64573bd938a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:49.720575 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-30103980-8b0c-447c-8aac-e64573bd938a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:49.721353 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-30103980-8b0c-447c-8aac-e64573bd938a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:49.721813 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-30103980-8b0c-447c-8aac-e64573bd938a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:49.750356 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a37c6eed-57a5-4134-a830-fce16ec3ec54 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:49.751655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a37c6eed-57a5-4134-a830-fce16ec3ec54 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:49.757911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a37c6eed-57a5-4134-a830-fce16ec3ec54 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:49.758355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a37c6eed-57a5-4134-a830-fce16ec3ec54 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:49.759820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a37c6eed-57a5-4134-a830-fce16ec3ec54 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:49.760544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a37c6eed-57a5-4134-a830-fce16ec3ec54 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:49.790589 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a37c6eed-57a5-4134-a830-fce16ec3ec54 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043640 May 10 21:14:49.791492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 431/900] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:49 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:14:49.803032 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.objects.instance [None req-30103980-8b0c-447c-8aac-e64573bd938a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lazy-loading 'services' on Instance uuid cf6fc652-5ef0-417d-af13-69c7c058d50e {{(pid=117713) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:14:50.043845 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-30103980-8b0c-447c-8aac-e64573bd938a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments/1b1f159c-b02f-49b7-bcdc-8267b5586104" status: 202 len: 0 microversion: 2.1 time: 0.335658 May 10 21:14:50.044458 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 470/901] 10.222.0.49 () {58 vars in 1415 bytes} [Tue May 10 21:14:49 2022] DELETE /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments/1b1f159c-b02f-49b7-bcdc-8267b5586104 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:14:50.052910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3d0df59a-c677-4c91-9fcf-fcca4038b396 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:50.056434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3d0df59a-c677-4c91-9fcf-fcca4038b396 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:50.061255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d0df59a-c677-4c91-9fcf-fcca4038b396 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:50.061707 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d0df59a-c677-4c91-9fcf-fcca4038b396 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:50.062485 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d0df59a-c677-4c91-9fcf-fcca4038b396 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:50.062923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d0df59a-c677-4c91-9fcf-fcca4038b396 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:50.093475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3d0df59a-c677-4c91-9fcf-fcca4038b396 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044590 May 10 21:14:50.094040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 432/902] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:50 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:50.456413 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-72d8da87-6dd8-4df4-9ac1-16379b97db8e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:50.457117 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-72d8da87-6dd8-4df4-9ac1-16379b97db8e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 92b6d664-37d6-422f-a52a-0ffec8a44389] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:50.463982 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-72d8da87-6dd8-4df4-9ac1-16379b97db8e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:50.465125 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-72d8da87-6dd8-4df4-9ac1-16379b97db8e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:50.465287 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-72d8da87-6dd8-4df4-9ac1-16379b97db8e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:50.465758 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-72d8da87-6dd8-4df4-9ac1-16379b97db8e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:50.507844 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-98d9c45c-75d7-4ba3-b3c0-0f976ec19bb1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:50.514807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-98d9c45c-75d7-4ba3-b3c0-0f976ec19bb1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:50.521279 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-98d9c45c-75d7-4ba3-b3c0-0f976ec19bb1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:50.521736 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-98d9c45c-75d7-4ba3-b3c0-0f976ec19bb1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:50.522546 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-98d9c45c-75d7-4ba3-b3c0-0f976ec19bb1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:50.522982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-98d9c45c-75d7-4ba3-b3c0-0f976ec19bb1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:50.554702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-98d9c45c-75d7-4ba3-b3c0-0f976ec19bb1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050862 May 10 21:14:50.555608 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 433/903] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:50 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:14:50.598874 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-72d8da87-6dd8-4df4-9ac1-16379b97db8e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:50.607205 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-72d8da87-6dd8-4df4-9ac1-16379b97db8e tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389" status: 200 len: 1362 microversion: 2.1 time: 0.154948 May 10 21:14:50.607780 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 471/904] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:50 2022] GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:14:50.801938 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e5024fbe-bd91-418a-a1c9-de5253eb6e19 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:50.802819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e5024fbe-bd91-418a-a1c9-de5253eb6e19 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:50.809396 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e5024fbe-bd91-418a-a1c9-de5253eb6e19 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:50.809841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e5024fbe-bd91-418a-a1c9-de5253eb6e19 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:50.810595 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e5024fbe-bd91-418a-a1c9-de5253eb6e19 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:50.811029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e5024fbe-bd91-418a-a1c9-de5253eb6e19 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:50.839688 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e5024fbe-bd91-418a-a1c9-de5253eb6e19 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041794 May 10 21:14:50.840236 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 434/905] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:50 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:51.105407 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-1318854d-6233-4e1c-9f56-bb918ee27abf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:51.106392 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-1318854d-6233-4e1c-9f56-bb918ee27abf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:51.112750 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1318854d-6233-4e1c-9f56-bb918ee27abf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:51.113234 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1318854d-6233-4e1c-9f56-bb918ee27abf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:51.114005 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1318854d-6233-4e1c-9f56-bb918ee27abf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:51.114443 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1318854d-6233-4e1c-9f56-bb918ee27abf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:51.143605 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-1318854d-6233-4e1c-9f56-bb918ee27abf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042771 May 10 21:14:51.144159 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 472/906] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:51 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:14:51.566067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-46410831-54c4-462c-ae11-19924eb4c44e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:51.567177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-46410831-54c4-462c-ae11-19924eb4c44e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:51.574564 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-46410831-54c4-462c-ae11-19924eb4c44e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:51.575012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-46410831-54c4-462c-ae11-19924eb4c44e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:51.575799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-46410831-54c4-462c-ae11-19924eb4c44e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:51.576228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-46410831-54c4-462c-ae11-19924eb4c44e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:51.605671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-46410831-54c4-462c-ae11-19924eb4c44e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043675 May 10 21:14:51.606231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 435/907] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:51 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:51.624146 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-74d17500-dca8-424b-b05e-335d090d8daa tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:51.624762 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-74d17500-dca8-424b-b05e-335d090d8daa tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 92b6d664-37d6-422f-a52a-0ffec8a44389] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:51.630639 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-74d17500-dca8-424b-b05e-335d090d8daa tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:51.631085 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-74d17500-dca8-424b-b05e-335d090d8daa tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:51.631878 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-74d17500-dca8-424b-b05e-335d090d8daa tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:51.632317 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-74d17500-dca8-424b-b05e-335d090d8daa tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:51.757115 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-74d17500-dca8-424b-b05e-335d090d8daa tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc411f6a0a024e7eac561ad1b6d2a944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd946455713e4c36a8efadbce486ee8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:14:51.765040 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-74d17500-dca8-424b-b05e-335d090d8daa tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389" status: 200 len: 1548 microversion: 2.1 time: 0.144763 May 10 21:14:51.765606 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 473/908] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:14:51 2022] GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389 => generated 1548 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:14:51.781625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5abbcd82-981a-41e5-8906-16c25efd6e20 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:51.782142 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5abbcd82-981a-41e5-8906-16c25efd6e20 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 92b6d664-37d6-422f-a52a-0ffec8a44389] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:51.787989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5abbcd82-981a-41e5-8906-16c25efd6e20 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:51.788434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5abbcd82-981a-41e5-8906-16c25efd6e20 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:51.789196 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5abbcd82-981a-41e5-8906-16c25efd6e20 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:51.789633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5abbcd82-981a-41e5-8906-16c25efd6e20 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:51.851395 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c7b8c859-e78a-41ba-8527-dd34c72927fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:51.852372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c7b8c859-e78a-41ba-8527-dd34c72927fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:51.858764 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c7b8c859-e78a-41ba-8527-dd34c72927fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:51.859265 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c7b8c859-e78a-41ba-8527-dd34c72927fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:51.860038 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c7b8c859-e78a-41ba-8527-dd34c72927fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:51.860477 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c7b8c859-e78a-41ba-8527-dd34c72927fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:51.864907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5abbcd82-981a-41e5-8906-16c25efd6e20 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087072 May 10 21:14:51.865511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 436/909] 10.222.0.49 () {58 vars in 1274 bytes} [Tue May 10 21:14:51 2022] GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:51.891301 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c7b8c859-e78a-41ba-8527-dd34c72927fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043877 May 10 21:14:51.893646 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 474/910] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:51 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:14:52.155191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-71bcbf9f-de12-4e95-8db1-d0cda0250f58 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:52.156049 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-71bcbf9f-de12-4e95-8db1-d0cda0250f58 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:52.161964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71bcbf9f-de12-4e95-8db1-d0cda0250f58 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:52.162418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71bcbf9f-de12-4e95-8db1-d0cda0250f58 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:52.163221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71bcbf9f-de12-4e95-8db1-d0cda0250f58 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:52.163664 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71bcbf9f-de12-4e95-8db1-d0cda0250f58 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:52.194527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-71bcbf9f-de12-4e95-8db1-d0cda0250f58 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043332 May 10 21:14:52.195088 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 437/911] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:52 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:52.616607 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d0aea69e-0ff0-41ac-a526-2dc6abe36c47 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:52.617615 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d0aea69e-0ff0-41ac-a526-2dc6abe36c47 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:52.625370 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d0aea69e-0ff0-41ac-a526-2dc6abe36c47 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:52.625901 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d0aea69e-0ff0-41ac-a526-2dc6abe36c47 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:52.626746 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d0aea69e-0ff0-41ac-a526-2dc6abe36c47 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:52.627299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d0aea69e-0ff0-41ac-a526-2dc6abe36c47 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:52.656808 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d0aea69e-0ff0-41ac-a526-2dc6abe36c47 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044263 May 10 21:14:52.657372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 475/912] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:52 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:52.904081 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-34e93489-bfa0-4a94-8d38-ad223c58e4bf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:52.905079 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-34e93489-bfa0-4a94-8d38-ad223c58e4bf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:52.911151 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-34e93489-bfa0-4a94-8d38-ad223c58e4bf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:52.911615 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-34e93489-bfa0-4a94-8d38-ad223c58e4bf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:52.912385 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-34e93489-bfa0-4a94-8d38-ad223c58e4bf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:52.912822 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-34e93489-bfa0-4a94-8d38-ad223c58e4bf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:52.942464 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-800dd74c-8a0b-47d2-bad2-be83e89528a7 req-23915088-ad47-413c-97e5-fc8a9734311f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b6d664-37d6-422f-a52a-0ffec8a44389", "tag": "d3cf0742-1fc1-49a1-93ca-8273a54dbbef"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:14:52.943294 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-34e93489-bfa0-4a94-8d38-ad223c58e4bf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043819 May 10 21:14:52.947723 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 476/913] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:52 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:14:52.952300 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-800dd74c-8a0b-47d2-bad2-be83e89528a7 req-23915088-ad47-413c-97e5-fc8a9734311f service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:52.952741 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-800dd74c-8a0b-47d2-bad2-be83e89528a7 req-23915088-ad47-413c-97e5-fc8a9734311f service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:52.964552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-800dd74c-8a0b-47d2-bad2-be83e89528a7 req-23915088-ad47-413c-97e5-fc8a9734311f service nova] Creating event network-changed:d3cf0742-1fc1-49a1-93ca-8273a54dbbef for instance 92b6d664-37d6-422f-a52a-0ffec8a44389 on hv-cinder-82880 May 10 21:14:52.969600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-800dd74c-8a0b-47d2-bad2-be83e89528a7 req-23915088-ad47-413c-97e5-fc8a9734311f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089556 May 10 21:14:52.970328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 438/914] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:53.206069 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-87d44c94-8252-41ce-a916-a98c27139888 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:53.207650 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-87d44c94-8252-41ce-a916-a98c27139888 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:53.214998 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-87d44c94-8252-41ce-a916-a98c27139888 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:53.215489 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-87d44c94-8252-41ce-a916-a98c27139888 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:53.216272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-87d44c94-8252-41ce-a916-a98c27139888 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:53.216715 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-87d44c94-8252-41ce-a916-a98c27139888 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:53.247915 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-87d44c94-8252-41ce-a916-a98c27139888 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045707 May 10 21:14:53.248604 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 477/915] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:53 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:53.669921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6eff7235-c50f-4c85-969d-4e51409a0704 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:53.670943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6eff7235-c50f-4c85-969d-4e51409a0704 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:53.681414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6eff7235-c50f-4c85-969d-4e51409a0704 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:53.681414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6eff7235-c50f-4c85-969d-4e51409a0704 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:53.681414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6eff7235-c50f-4c85-969d-4e51409a0704 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:53.681414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6eff7235-c50f-4c85-969d-4e51409a0704 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:53.709312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6eff7235-c50f-4c85-969d-4e51409a0704 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044533 May 10 21:14:53.709876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 439/916] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:53 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:53.954589 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-684f4101-da2e-4e2c-a479-e33943a5d2ca tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:53.955555 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-684f4101-da2e-4e2c-a479-e33943a5d2ca tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:53.962634 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-684f4101-da2e-4e2c-a479-e33943a5d2ca tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:53.963156 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-684f4101-da2e-4e2c-a479-e33943a5d2ca tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:53.963925 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-684f4101-da2e-4e2c-a479-e33943a5d2ca tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:53.964360 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-684f4101-da2e-4e2c-a479-e33943a5d2ca tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:53.992716 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-684f4101-da2e-4e2c-a479-e33943a5d2ca tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042133 May 10 21:14:53.993358 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 478/917] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:53 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:54.260786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c2cf9ea8-f009-4fb2-99cb-753676593566 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:54.261714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c2cf9ea8-f009-4fb2-99cb-753676593566 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:54.268019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c2cf9ea8-f009-4fb2-99cb-753676593566 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:54.268476 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c2cf9ea8-f009-4fb2-99cb-753676593566 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:54.269249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c2cf9ea8-f009-4fb2-99cb-753676593566 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:54.269694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c2cf9ea8-f009-4fb2-99cb-753676593566 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:54.297562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c2cf9ea8-f009-4fb2-99cb-753676593566 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041485 May 10 21:14:54.298110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 440/918] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:54 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:54.721990 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a2495dd8-1260-4f88-a917-b6071728049d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:54.722907 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a2495dd8-1260-4f88-a917-b6071728049d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:54.729500 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a2495dd8-1260-4f88-a917-b6071728049d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:54.729942 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a2495dd8-1260-4f88-a917-b6071728049d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:54.730798 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a2495dd8-1260-4f88-a917-b6071728049d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:54.731273 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a2495dd8-1260-4f88-a917-b6071728049d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:54.759677 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a2495dd8-1260-4f88-a917-b6071728049d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041645 May 10 21:14:54.760221 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 479/919] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:54 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:55.004613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c8e77e75-632d-4ab4-a2f6-41b694032736 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:55.005507 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c8e77e75-632d-4ab4-a2f6-41b694032736 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:55.011920 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c8e77e75-632d-4ab4-a2f6-41b694032736 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:55.012368 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c8e77e75-632d-4ab4-a2f6-41b694032736 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:55.013129 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c8e77e75-632d-4ab4-a2f6-41b694032736 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:55.013563 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c8e77e75-632d-4ab4-a2f6-41b694032736 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:55.043638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c8e77e75-632d-4ab4-a2f6-41b694032736 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043152 May 10 21:14:55.044369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 441/920] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:54 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:55.309319 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a72643d0-c72d-4076-945e-8e5eeb49effe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:55.310213 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a72643d0-c72d-4076-945e-8e5eeb49effe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:55.316908 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a72643d0-c72d-4076-945e-8e5eeb49effe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:55.317370 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a72643d0-c72d-4076-945e-8e5eeb49effe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:55.318128 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a72643d0-c72d-4076-945e-8e5eeb49effe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:55.318562 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a72643d0-c72d-4076-945e-8e5eeb49effe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:55.347560 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a72643d0-c72d-4076-945e-8e5eeb49effe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042470 May 10 21:14:55.348104 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 480/921] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:55 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:55.770657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5d457723-5c17-45c6-83e6-7508f191e0c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:55.771642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5d457723-5c17-45c6-83e6-7508f191e0c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:55.778147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5d457723-5c17-45c6-83e6-7508f191e0c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:55.778604 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5d457723-5c17-45c6-83e6-7508f191e0c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:55.779408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5d457723-5c17-45c6-83e6-7508f191e0c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:55.779856 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5d457723-5c17-45c6-83e6-7508f191e0c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:55.808252 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5d457723-5c17-45c6-83e6-7508f191e0c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041572 May 10 21:14:55.808808 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 442/922] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:55 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:56.056205 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-2a610f6d-2d1e-435e-9130-c10981932164 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:56.057400 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-2a610f6d-2d1e-435e-9130-c10981932164 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:56.063602 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2a610f6d-2d1e-435e-9130-c10981932164 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:56.064053 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2a610f6d-2d1e-435e-9130-c10981932164 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:56.064823 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2a610f6d-2d1e-435e-9130-c10981932164 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:56.065259 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2a610f6d-2d1e-435e-9130-c10981932164 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:56.094965 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-2a610f6d-2d1e-435e-9130-c10981932164 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043494 May 10 21:14:56.098776 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 481/923] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:56 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:56.359268 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-597d808b-3221-4be9-93f8-1b898d52942c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:56.360198 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-597d808b-3221-4be9-93f8-1b898d52942c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:56.366108 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-597d808b-3221-4be9-93f8-1b898d52942c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:56.366558 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-597d808b-3221-4be9-93f8-1b898d52942c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:56.367354 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-597d808b-3221-4be9-93f8-1b898d52942c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:56.367797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-597d808b-3221-4be9-93f8-1b898d52942c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:56.396892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-597d808b-3221-4be9-93f8-1b898d52942c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041610 May 10 21:14:56.397376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 443/924] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:56 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:56.820451 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-de502bb1-318c-4721-8601-ef9f42c99be9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:56.822170 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-de502bb1-318c-4721-8601-ef9f42c99be9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:56.828775 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-de502bb1-318c-4721-8601-ef9f42c99be9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:56.829223 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-de502bb1-318c-4721-8601-ef9f42c99be9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:56.829981 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-de502bb1-318c-4721-8601-ef9f42c99be9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:56.830419 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-de502bb1-318c-4721-8601-ef9f42c99be9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:56.859483 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-de502bb1-318c-4721-8601-ef9f42c99be9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043291 May 10 21:14:56.860036 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 482/925] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:56 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:57.107054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bf9299ce-4cb3-475d-b5a0-9248f5b62548 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:57.108060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bf9299ce-4cb3-475d-b5a0-9248f5b62548 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:57.114389 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf9299ce-4cb3-475d-b5a0-9248f5b62548 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:57.114837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf9299ce-4cb3-475d-b5a0-9248f5b62548 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:57.115638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf9299ce-4cb3-475d-b5a0-9248f5b62548 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:57.116072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf9299ce-4cb3-475d-b5a0-9248f5b62548 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:57.145317 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bf9299ce-4cb3-475d-b5a0-9248f5b62548 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042837 May 10 21:14:57.145870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 444/926] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:57 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:57.407771 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-5102fb13-939a-48f2-a091-802e8dff719c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:57.408625 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5102fb13-939a-48f2-a091-802e8dff719c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:57.414499 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5102fb13-939a-48f2-a091-802e8dff719c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:57.414954 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5102fb13-939a-48f2-a091-802e8dff719c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:57.415820 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5102fb13-939a-48f2-a091-802e8dff719c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:57.416265 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5102fb13-939a-48f2-a091-802e8dff719c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:57.445262 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-5102fb13-939a-48f2-a091-802e8dff719c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041490 May 10 21:14:57.449079 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 483/927] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:57 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:57.871754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e3058faa-2190-4934-b9f8-9d60beba112a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:57.872685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e3058faa-2190-4934-b9f8-9d60beba112a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:57.878931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e3058faa-2190-4934-b9f8-9d60beba112a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:57.879404 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e3058faa-2190-4934-b9f8-9d60beba112a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:57.880172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e3058faa-2190-4934-b9f8-9d60beba112a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:57.880601 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e3058faa-2190-4934-b9f8-9d60beba112a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:57.910798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e3058faa-2190-4934-b9f8-9d60beba112a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043619 May 10 21:14:57.911484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 445/928] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:57 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:58.156864 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-1b19e515-78e3-4222-a394-3ea51d136674 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:58.157713 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-1b19e515-78e3-4222-a394-3ea51d136674 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:58.164108 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1b19e515-78e3-4222-a394-3ea51d136674 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:58.164560 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1b19e515-78e3-4222-a394-3ea51d136674 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:58.166384 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1b19e515-78e3-4222-a394-3ea51d136674 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:58.166832 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1b19e515-78e3-4222-a394-3ea51d136674 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:58.201563 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-1b19e515-78e3-4222-a394-3ea51d136674 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048656 May 10 21:14:58.202122 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 484/929] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:58 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:58.457850 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-beb7b1f9-6bd3-4133-8374-4c636f782a89 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:58.458720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-beb7b1f9-6bd3-4133-8374-4c636f782a89 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:58.465770 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-beb7b1f9-6bd3-4133-8374-4c636f782a89 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:58.466215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-beb7b1f9-6bd3-4133-8374-4c636f782a89 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:58.466970 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-beb7b1f9-6bd3-4133-8374-4c636f782a89 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:58.467437 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-beb7b1f9-6bd3-4133-8374-4c636f782a89 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:58.495453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-beb7b1f9-6bd3-4133-8374-4c636f782a89 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041504 May 10 21:14:58.496090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 446/930] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:58 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:58.922829 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c086319a-bf39-4e81-aa3d-687244854752 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:58.925451 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c086319a-bf39-4e81-aa3d-687244854752 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:58.929752 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c086319a-bf39-4e81-aa3d-687244854752 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:58.930238 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c086319a-bf39-4e81-aa3d-687244854752 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:58.931737 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c086319a-bf39-4e81-aa3d-687244854752 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:58.932189 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c086319a-bf39-4e81-aa3d-687244854752 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:58.962829 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c086319a-bf39-4e81-aa3d-687244854752 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043375 May 10 21:14:58.963589 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 485/931] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:58 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:14:59.214440 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bfc923e2-d8d3-44d0-9f41-c50b6a78968b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:59.215408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bfc923e2-d8d3-44d0-9f41-c50b6a78968b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:59.221321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfc923e2-d8d3-44d0-9f41-c50b6a78968b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:59.221772 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfc923e2-d8d3-44d0-9f41-c50b6a78968b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:59.222546 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfc923e2-d8d3-44d0-9f41-c50b6a78968b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:59.222988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfc923e2-d8d3-44d0-9f41-c50b6a78968b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:59.251449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bfc923e2-d8d3-44d0-9f41-c50b6a78968b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041817 May 10 21:14:59.252013 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 447/932] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:59 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:59.506948 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-8518a430-cd0a-4674-b86f-a26a12b23e19 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:59.507925 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-8518a430-cd0a-4674-b86f-a26a12b23e19 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:59.514860 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8518a430-cd0a-4674-b86f-a26a12b23e19 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:59.515342 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8518a430-cd0a-4674-b86f-a26a12b23e19 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:59.516100 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8518a430-cd0a-4674-b86f-a26a12b23e19 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:59.516534 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8518a430-cd0a-4674-b86f-a26a12b23e19 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:59.544328 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-8518a430-cd0a-4674-b86f-a26a12b23e19 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041281 May 10 21:14:59.544875 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 486/933] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:14:59 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:14:59.974619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-93dbf8f5-b87f-4175-9879-25a2b4dd4992 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:14:59.975586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-93dbf8f5-b87f-4175-9879-25a2b4dd4992 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:14:59.982605 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-93dbf8f5-b87f-4175-9879-25a2b4dd4992 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:59.983059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-93dbf8f5-b87f-4175-9879-25a2b4dd4992 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:14:59.983862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-93dbf8f5-b87f-4175-9879-25a2b4dd4992 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:14:59.984304 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-93dbf8f5-b87f-4175-9879-25a2b4dd4992 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:00.014010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-93dbf8f5-b87f-4175-9879-25a2b4dd4992 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043355 May 10 21:15:00.014574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 448/934] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:14:59 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:00.263181 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6fb022ab-5c78-4dce-87b1-93fb91d38bce tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:00.264120 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6fb022ab-5c78-4dce-87b1-93fb91d38bce tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:00.270051 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6fb022ab-5c78-4dce-87b1-93fb91d38bce tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:00.270501 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6fb022ab-5c78-4dce-87b1-93fb91d38bce tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:00.271298 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6fb022ab-5c78-4dce-87b1-93fb91d38bce tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:00.271739 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6fb022ab-5c78-4dce-87b1-93fb91d38bce tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:00.300723 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6fb022ab-5c78-4dce-87b1-93fb91d38bce tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041716 May 10 21:15:00.301272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 487/935] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:00 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:00.555855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-21991d7a-1dc6-45d7-b60f-07e04d1c9621 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:00.556757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-21991d7a-1dc6-45d7-b60f-07e04d1c9621 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:00.562766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21991d7a-1dc6-45d7-b60f-07e04d1c9621 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:00.563253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21991d7a-1dc6-45d7-b60f-07e04d1c9621 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:00.564019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21991d7a-1dc6-45d7-b60f-07e04d1c9621 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:00.564452 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21991d7a-1dc6-45d7-b60f-07e04d1c9621 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:00.594381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-21991d7a-1dc6-45d7-b60f-07e04d1c9621 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042541 May 10 21:15:00.594940 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 449/936] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:00 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:01.025986 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a5cbaf41-635e-4697-9d83-0db8a48bc5a7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:01.026910 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a5cbaf41-635e-4697-9d83-0db8a48bc5a7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:01.033299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a5cbaf41-635e-4697-9d83-0db8a48bc5a7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:01.033752 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a5cbaf41-635e-4697-9d83-0db8a48bc5a7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:01.034519 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a5cbaf41-635e-4697-9d83-0db8a48bc5a7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:01.034962 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a5cbaf41-635e-4697-9d83-0db8a48bc5a7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:01.064530 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a5cbaf41-635e-4697-9d83-0db8a48bc5a7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042672 May 10 21:15:01.065100 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 488/937] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:01 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:01.312962 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cb4118a0-5fc0-464c-a58e-fd4f602bba58 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:01.313806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cb4118a0-5fc0-464c-a58e-fd4f602bba58 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:01.320457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb4118a0-5fc0-464c-a58e-fd4f602bba58 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:01.320910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb4118a0-5fc0-464c-a58e-fd4f602bba58 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:01.322561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb4118a0-5fc0-464c-a58e-fd4f602bba58 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:01.323071 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb4118a0-5fc0-464c-a58e-fd4f602bba58 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:01.351500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cb4118a0-5fc0-464c-a58e-fd4f602bba58 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042543 May 10 21:15:01.352058 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 450/938] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:01 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:01.606429 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9bc71bba-6b23-4f7d-be1c-c5fc175f46ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:01.607379 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-9bc71bba-6b23-4f7d-be1c-c5fc175f46ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:01.613631 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9bc71bba-6b23-4f7d-be1c-c5fc175f46ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:01.614121 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9bc71bba-6b23-4f7d-be1c-c5fc175f46ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:01.614903 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9bc71bba-6b23-4f7d-be1c-c5fc175f46ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:01.615405 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9bc71bba-6b23-4f7d-be1c-c5fc175f46ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:01.644359 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9bc71bba-6b23-4f7d-be1c-c5fc175f46ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042516 May 10 21:15:01.644918 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 489/939] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:01 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:02.076911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c4f39e20-ae6c-4d86-8997-68931277d95e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:02.077830 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c4f39e20-ae6c-4d86-8997-68931277d95e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:02.083803 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4f39e20-ae6c-4d86-8997-68931277d95e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:02.084250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4f39e20-ae6c-4d86-8997-68931277d95e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:02.085010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4f39e20-ae6c-4d86-8997-68931277d95e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:02.085503 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4f39e20-ae6c-4d86-8997-68931277d95e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:02.115707 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c4f39e20-ae6c-4d86-8997-68931277d95e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042601 May 10 21:15:02.116263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 451/940] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:02 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:02.363554 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-4bd50a60-8312-487c-92b8-40242ab79e77 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:02.364486 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-4bd50a60-8312-487c-92b8-40242ab79e77 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:02.370913 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4bd50a60-8312-487c-92b8-40242ab79e77 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:02.371387 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4bd50a60-8312-487c-92b8-40242ab79e77 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:02.372147 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4bd50a60-8312-487c-92b8-40242ab79e77 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:02.372578 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4bd50a60-8312-487c-92b8-40242ab79e77 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:02.402400 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-4bd50a60-8312-487c-92b8-40242ab79e77 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042783 May 10 21:15:02.402952 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 490/941] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:02 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:02.656211 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b6294923-4e40-4bf1-831d-eeef9b965d23 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:02.657115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b6294923-4e40-4bf1-831d-eeef9b965d23 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:02.663540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b6294923-4e40-4bf1-831d-eeef9b965d23 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:02.663994 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b6294923-4e40-4bf1-831d-eeef9b965d23 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:02.664777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b6294923-4e40-4bf1-831d-eeef9b965d23 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:02.665439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b6294923-4e40-4bf1-831d-eeef9b965d23 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:02.694170 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b6294923-4e40-4bf1-831d-eeef9b965d23 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042048 May 10 21:15:02.694720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 452/942] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:02 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:03.127766 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e63e0dd4-6203-4b20-84e4-fccc66d386e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:03.128675 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e63e0dd4-6203-4b20-84e4-fccc66d386e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:03.134678 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e63e0dd4-6203-4b20-84e4-fccc66d386e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:03.135201 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e63e0dd4-6203-4b20-84e4-fccc66d386e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:03.135931 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e63e0dd4-6203-4b20-84e4-fccc66d386e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:03.136371 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e63e0dd4-6203-4b20-84e4-fccc66d386e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:03.164472 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e63e0dd4-6203-4b20-84e4-fccc66d386e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040705 May 10 21:15:03.165611 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 491/943] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:03 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:03.413666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-30b467ce-78fe-4b08-8ab4-a03a8f5e6b7e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:03.414614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-30b467ce-78fe-4b08-8ab4-a03a8f5e6b7e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:03.421174 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-30b467ce-78fe-4b08-8ab4-a03a8f5e6b7e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:03.421617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-30b467ce-78fe-4b08-8ab4-a03a8f5e6b7e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:03.422369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-30b467ce-78fe-4b08-8ab4-a03a8f5e6b7e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:03.422802 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-30b467ce-78fe-4b08-8ab4-a03a8f5e6b7e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:03.451775 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-30b467ce-78fe-4b08-8ab4-a03a8f5e6b7e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042086 May 10 21:15:03.452335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 453/944] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:03 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:03.706383 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f7156611-2aa5-4784-b007-ad6f289d3eba tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:03.707270 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f7156611-2aa5-4784-b007-ad6f289d3eba tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:03.713862 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f7156611-2aa5-4784-b007-ad6f289d3eba tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:03.714401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f7156611-2aa5-4784-b007-ad6f289d3eba tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:03.715197 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f7156611-2aa5-4784-b007-ad6f289d3eba tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:03.715648 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f7156611-2aa5-4784-b007-ad6f289d3eba tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:03.746934 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f7156611-2aa5-4784-b007-ad6f289d3eba tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044549 May 10 21:15:03.747508 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 492/945] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:03 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:04.176927 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-07f5bfad-affb-42ab-aee8-fb7227ca4836 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:04.177840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-07f5bfad-affb-42ab-aee8-fb7227ca4836 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:04.184479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07f5bfad-affb-42ab-aee8-fb7227ca4836 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:04.184923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07f5bfad-affb-42ab-aee8-fb7227ca4836 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:04.185688 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07f5bfad-affb-42ab-aee8-fb7227ca4836 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:04.186116 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07f5bfad-affb-42ab-aee8-fb7227ca4836 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:04.214386 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-07f5bfad-affb-42ab-aee8-fb7227ca4836 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041552 May 10 21:15:04.214924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 454/946] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:04 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:04.463368 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-182c5a87-75f6-4bc2-9456-c98d70c0923c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:04.464328 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-182c5a87-75f6-4bc2-9456-c98d70c0923c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:04.471148 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-182c5a87-75f6-4bc2-9456-c98d70c0923c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:04.471613 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-182c5a87-75f6-4bc2-9456-c98d70c0923c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:04.472380 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-182c5a87-75f6-4bc2-9456-c98d70c0923c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:04.472814 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-182c5a87-75f6-4bc2-9456-c98d70c0923c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:04.503901 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-182c5a87-75f6-4bc2-9456-c98d70c0923c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044418 May 10 21:15:04.504655 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 493/947] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:04 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:04.758453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-64574882-6f0e-4e56-b92a-2df80c820208 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:04.759325 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-64574882-6f0e-4e56-b92a-2df80c820208 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:04.765729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-64574882-6f0e-4e56-b92a-2df80c820208 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:04.766173 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-64574882-6f0e-4e56-b92a-2df80c820208 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:04.766929 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-64574882-6f0e-4e56-b92a-2df80c820208 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:04.767412 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-64574882-6f0e-4e56-b92a-2df80c820208 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:04.796248 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-64574882-6f0e-4e56-b92a-2df80c820208 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041788 May 10 21:15:04.796796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 455/948] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:04 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:15:05.225979 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c9c6c209-ecad-4220-bed5-a99f56c07da4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:05.226934 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c9c6c209-ecad-4220-bed5-a99f56c07da4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:05.233451 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c9c6c209-ecad-4220-bed5-a99f56c07da4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:05.233904 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c9c6c209-ecad-4220-bed5-a99f56c07da4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:05.234679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c9c6c209-ecad-4220-bed5-a99f56c07da4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:05.235742 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c9c6c209-ecad-4220-bed5-a99f56c07da4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:05.264819 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c9c6c209-ecad-4220-bed5-a99f56c07da4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042809 May 10 21:15:05.265370 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 494/949] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:05 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:05.515691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a8377278-2fcf-4a9d-bd26-d5ffea3d50de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:05.516575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a8377278-2fcf-4a9d-bd26-d5ffea3d50de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:05.522878 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a8377278-2fcf-4a9d-bd26-d5ffea3d50de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:05.523365 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a8377278-2fcf-4a9d-bd26-d5ffea3d50de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:05.524125 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a8377278-2fcf-4a9d-bd26-d5ffea3d50de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:05.524553 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a8377278-2fcf-4a9d-bd26-d5ffea3d50de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:05.553403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a8377278-2fcf-4a9d-bd26-d5ffea3d50de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041654 May 10 21:15:05.554242 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 456/950] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:05 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:05.807857 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-bf4c7dbc-cd23-40ee-9c68-78f926684cc0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:05.808792 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-bf4c7dbc-cd23-40ee-9c68-78f926684cc0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:05.814887 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bf4c7dbc-cd23-40ee-9c68-78f926684cc0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:05.815375 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bf4c7dbc-cd23-40ee-9c68-78f926684cc0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:05.816150 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bf4c7dbc-cd23-40ee-9c68-78f926684cc0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:05.816853 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bf4c7dbc-cd23-40ee-9c68-78f926684cc0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:05.846194 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-bf4c7dbc-cd23-40ee-9c68-78f926684cc0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042435 May 10 21:15:05.846752 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 495/951] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:05 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:06.275825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-52724dd8-f49e-4242-b8f7-98674938532f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:06.276785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-52724dd8-f49e-4242-b8f7-98674938532f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:06.283289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52724dd8-f49e-4242-b8f7-98674938532f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:06.283747 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52724dd8-f49e-4242-b8f7-98674938532f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:06.284518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52724dd8-f49e-4242-b8f7-98674938532f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:06.284960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52724dd8-f49e-4242-b8f7-98674938532f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:06.313413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-52724dd8-f49e-4242-b8f7-98674938532f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041680 May 10 21:15:06.313983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 457/952] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:06 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:06.565527 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-298ce353-b45b-466e-9855-eb61cbe71485 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:06.566384 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-298ce353-b45b-466e-9855-eb61cbe71485 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:06.573024 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-298ce353-b45b-466e-9855-eb61cbe71485 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:06.573480 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-298ce353-b45b-466e-9855-eb61cbe71485 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:06.574279 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-298ce353-b45b-466e-9855-eb61cbe71485 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:06.574882 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-298ce353-b45b-466e-9855-eb61cbe71485 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:06.603797 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-298ce353-b45b-466e-9855-eb61cbe71485 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041317 May 10 21:15:06.607252 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 496/953] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:06 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:15:06.858117 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0261e284-a98f-4bd0-9faa-53085a58b008 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:06.859076 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0261e284-a98f-4bd0-9faa-53085a58b008 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:06.865413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0261e284-a98f-4bd0-9faa-53085a58b008 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:06.865859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0261e284-a98f-4bd0-9faa-53085a58b008 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:06.866626 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0261e284-a98f-4bd0-9faa-53085a58b008 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:06.867064 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0261e284-a98f-4bd0-9faa-53085a58b008 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:06.895821 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0261e284-a98f-4bd0-9faa-53085a58b008 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042240 May 10 21:15:06.896368 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 458/954] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:06 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:07.326207 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-621f7fc5-f582-4c94-ad56-7a34e08a4966 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:07.327041 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-621f7fc5-f582-4c94-ad56-7a34e08a4966 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:07.333023 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-621f7fc5-f582-4c94-ad56-7a34e08a4966 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:07.333466 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-621f7fc5-f582-4c94-ad56-7a34e08a4966 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:07.334224 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-621f7fc5-f582-4c94-ad56-7a34e08a4966 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:07.334660 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-621f7fc5-f582-4c94-ad56-7a34e08a4966 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:07.363288 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-621f7fc5-f582-4c94-ad56-7a34e08a4966 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041900 May 10 21:15:07.363833 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 497/955] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:07 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:07.614652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7a26e95a-ffde-4e4e-bf8a-063d78172a15 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:07.615649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7a26e95a-ffde-4e4e-bf8a-063d78172a15 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:07.622225 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7a26e95a-ffde-4e4e-bf8a-063d78172a15 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:07.622668 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7a26e95a-ffde-4e4e-bf8a-063d78172a15 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:07.623470 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7a26e95a-ffde-4e4e-bf8a-063d78172a15 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:07.623908 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7a26e95a-ffde-4e4e-bf8a-063d78172a15 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:07.652338 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7a26e95a-ffde-4e4e-bf8a-063d78172a15 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041667 May 10 21:15:07.652938 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 459/956] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:07 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:07.908577 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-127ffc9c-2588-4e1d-8ffc-db500363b638 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:07.909437 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-127ffc9c-2588-4e1d-8ffc-db500363b638 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:07.915796 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-127ffc9c-2588-4e1d-8ffc-db500363b638 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:07.916239 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-127ffc9c-2588-4e1d-8ffc-db500363b638 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:07.917004 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-127ffc9c-2588-4e1d-8ffc-db500363b638 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:07.917443 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-127ffc9c-2588-4e1d-8ffc-db500363b638 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:07.946246 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-127ffc9c-2588-4e1d-8ffc-db500363b638 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041702 May 10 21:15:07.946789 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 498/957] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:07 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:08.375772 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e69f274b-2468-474e-9e5b-f45401c642d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:08.376721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e69f274b-2468-474e-9e5b-f45401c642d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:08.383017 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e69f274b-2468-474e-9e5b-f45401c642d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:08.383493 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e69f274b-2468-474e-9e5b-f45401c642d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:08.384249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e69f274b-2468-474e-9e5b-f45401c642d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:08.384680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e69f274b-2468-474e-9e5b-f45401c642d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:08.413329 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e69f274b-2468-474e-9e5b-f45401c642d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042262 May 10 21:15:08.413871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 460/958] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:08 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:08.663941 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e8284267-38c3-4a90-b07c-06af25c498b6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:08.664873 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e8284267-38c3-4a90-b07c-06af25c498b6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:08.671107 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e8284267-38c3-4a90-b07c-06af25c498b6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:08.671579 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e8284267-38c3-4a90-b07c-06af25c498b6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:08.672340 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e8284267-38c3-4a90-b07c-06af25c498b6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:08.672775 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e8284267-38c3-4a90-b07c-06af25c498b6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:08.702534 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e8284267-38c3-4a90-b07c-06af25c498b6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042522 May 10 21:15:08.703141 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 499/959] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:08 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:08.958238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f6de5466-40e0-4551-a539-e1e0aa4295f0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:08.959094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f6de5466-40e0-4551-a539-e1e0aa4295f0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:08.965003 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6de5466-40e0-4551-a539-e1e0aa4295f0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:08.965527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6de5466-40e0-4551-a539-e1e0aa4295f0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:08.966293 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6de5466-40e0-4551-a539-e1e0aa4295f0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:08.966726 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6de5466-40e0-4551-a539-e1e0aa4295f0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:08.994693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f6de5466-40e0-4551-a539-e1e0aa4295f0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040486 May 10 21:15:08.995249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 461/960] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:08 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:09.425784 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6a85faa6-5d23-4b8e-a015-c48282ff6af7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:09.426736 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6a85faa6-5d23-4b8e-a015-c48282ff6af7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:09.433314 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6a85faa6-5d23-4b8e-a015-c48282ff6af7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:09.434277 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6a85faa6-5d23-4b8e-a015-c48282ff6af7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:09.434879 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6a85faa6-5d23-4b8e-a015-c48282ff6af7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:09.435353 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6a85faa6-5d23-4b8e-a015-c48282ff6af7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:09.463241 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6a85faa6-5d23-4b8e-a015-c48282ff6af7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041552 May 10 21:15:09.463787 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 500/961] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:09 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:09.714124 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-44450c88-bd4d-4a67-8d07-14b8f7ef7e32 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:09.715247 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-44450c88-bd4d-4a67-8d07-14b8f7ef7e32 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:09.721614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44450c88-bd4d-4a67-8d07-14b8f7ef7e32 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:09.722063 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44450c88-bd4d-4a67-8d07-14b8f7ef7e32 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:09.722823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44450c88-bd4d-4a67-8d07-14b8f7ef7e32 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:09.723288 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44450c88-bd4d-4a67-8d07-14b8f7ef7e32 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:09.752756 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-44450c88-bd4d-4a67-8d07-14b8f7ef7e32 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042635 May 10 21:15:09.756312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 462/962] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:09 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:10.006668 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-684595b9-24a2-4ee0-ae2d-140ba00a02c4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:10.007595 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-684595b9-24a2-4ee0-ae2d-140ba00a02c4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:10.013520 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-684595b9-24a2-4ee0-ae2d-140ba00a02c4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:10.013964 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-684595b9-24a2-4ee0-ae2d-140ba00a02c4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:10.014718 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-684595b9-24a2-4ee0-ae2d-140ba00a02c4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:10.015175 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-684595b9-24a2-4ee0-ae2d-140ba00a02c4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:10.044120 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-684595b9-24a2-4ee0-ae2d-140ba00a02c4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040786 May 10 21:15:10.044555 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 501/963] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:10 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:10.475863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9bb98dd7-d061-435c-be88-e19ba719534c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:10.476931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9bb98dd7-d061-435c-be88-e19ba719534c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:10.482898 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9bb98dd7-d061-435c-be88-e19ba719534c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:10.483460 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9bb98dd7-d061-435c-be88-e19ba719534c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:10.484305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9bb98dd7-d061-435c-be88-e19ba719534c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:10.484813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9bb98dd7-d061-435c-be88-e19ba719534c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:10.520943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9bb98dd7-d061-435c-be88-e19ba719534c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049199 May 10 21:15:10.521526 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 463/964] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:10 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:10.765325 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-ff047ed4-cd82-432a-bab1-6c1f6e5ffbe1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:10.766275 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-ff047ed4-cd82-432a-bab1-6c1f6e5ffbe1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:10.772690 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ff047ed4-cd82-432a-bab1-6c1f6e5ffbe1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:10.773133 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ff047ed4-cd82-432a-bab1-6c1f6e5ffbe1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:10.773900 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ff047ed4-cd82-432a-bab1-6c1f6e5ffbe1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:10.774340 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ff047ed4-cd82-432a-bab1-6c1f6e5ffbe1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:10.804117 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-ff047ed4-cd82-432a-bab1-6c1f6e5ffbe1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043723 May 10 21:15:10.805056 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 502/965] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:10 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:11.055234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-453c9e9b-5232-446b-bcd0-675a9417d4ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:11.056188 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-453c9e9b-5232-446b-bcd0-675a9417d4ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:11.063508 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-453c9e9b-5232-446b-bcd0-675a9417d4ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:11.063958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-453c9e9b-5232-446b-bcd0-675a9417d4ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:11.064727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-453c9e9b-5232-446b-bcd0-675a9417d4ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:11.065163 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-453c9e9b-5232-446b-bcd0-675a9417d4ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:11.093747 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-453c9e9b-5232-446b-bcd0-675a9417d4ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042516 May 10 21:15:11.094305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 464/966] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:11 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:11.533041 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e7e00fd4-5051-47f9-9482-2be487cbbc1f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:11.533960 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e7e00fd4-5051-47f9-9482-2be487cbbc1f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:11.539888 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e7e00fd4-5051-47f9-9482-2be487cbbc1f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:11.540335 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e7e00fd4-5051-47f9-9482-2be487cbbc1f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:11.541095 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e7e00fd4-5051-47f9-9482-2be487cbbc1f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:11.541533 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e7e00fd4-5051-47f9-9482-2be487cbbc1f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:11.570203 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e7e00fd4-5051-47f9-9482-2be487cbbc1f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041148 May 10 21:15:11.570745 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 503/967] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:11 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:11.816449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-507dfc01-9c8c-44b3-9d74-9158af747ea7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:11.817607 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-507dfc01-9c8c-44b3-9d74-9158af747ea7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:11.825658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-507dfc01-9c8c-44b3-9d74-9158af747ea7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:11.826103 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-507dfc01-9c8c-44b3-9d74-9158af747ea7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:11.826975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-507dfc01-9c8c-44b3-9d74-9158af747ea7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:11.827454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-507dfc01-9c8c-44b3-9d74-9158af747ea7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:11.860437 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-507dfc01-9c8c-44b3-9d74-9158af747ea7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047929 May 10 21:15:11.861502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 465/968] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:11 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:12.105064 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6512cfce-8189-4295-b586-54b1a4490e50 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:12.106804 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6512cfce-8189-4295-b586-54b1a4490e50 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:12.113060 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6512cfce-8189-4295-b586-54b1a4490e50 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:12.113517 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6512cfce-8189-4295-b586-54b1a4490e50 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:12.114285 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6512cfce-8189-4295-b586-54b1a4490e50 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:12.114726 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6512cfce-8189-4295-b586-54b1a4490e50 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:12.143232 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6512cfce-8189-4295-b586-54b1a4490e50 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041985 May 10 21:15:12.143790 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 504/969] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:12 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:12.581615 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-06e2684b-f931-4c61-b78d-b74526b6e14c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:12.582442 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-06e2684b-f931-4c61-b78d-b74526b6e14c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:12.588677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-06e2684b-f931-4c61-b78d-b74526b6e14c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:12.589121 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-06e2684b-f931-4c61-b78d-b74526b6e14c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:12.589883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-06e2684b-f931-4c61-b78d-b74526b6e14c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:12.590908 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-06e2684b-f931-4c61-b78d-b74526b6e14c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:12.619426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-06e2684b-f931-4c61-b78d-b74526b6e14c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041786 May 10 21:15:12.619974 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 466/970] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:12 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:12.873275 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-534d962d-4066-4469-954b-381229aace46 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:12.874209 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-534d962d-4066-4469-954b-381229aace46 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:12.880271 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-534d962d-4066-4469-954b-381229aace46 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:12.880726 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-534d962d-4066-4469-954b-381229aace46 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:12.881498 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-534d962d-4066-4469-954b-381229aace46 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:12.881942 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-534d962d-4066-4469-954b-381229aace46 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:12.911025 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-534d962d-4066-4469-954b-381229aace46 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042335 May 10 21:15:12.911621 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 505/971] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:12 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:13.154598 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e7da131f-8b56-4a1b-b984-df9f80f43b61 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:13.155600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e7da131f-8b56-4a1b-b984-df9f80f43b61 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:13.161521 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e7da131f-8b56-4a1b-b984-df9f80f43b61 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:13.161962 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e7da131f-8b56-4a1b-b984-df9f80f43b61 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:13.162718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e7da131f-8b56-4a1b-b984-df9f80f43b61 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:13.163175 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e7da131f-8b56-4a1b-b984-df9f80f43b61 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:13.192146 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e7da131f-8b56-4a1b-b984-df9f80f43b61 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042036 May 10 21:15:13.192693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 467/972] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:13 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:13.631236 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-3baf18b9-5c74-4f80-8c8c-a0f4de9f9bb1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:13.632173 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-3baf18b9-5c74-4f80-8c8c-a0f4de9f9bb1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:13.639248 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3baf18b9-5c74-4f80-8c8c-a0f4de9f9bb1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:13.639708 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3baf18b9-5c74-4f80-8c8c-a0f4de9f9bb1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:13.640481 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3baf18b9-5c74-4f80-8c8c-a0f4de9f9bb1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:13.640933 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3baf18b9-5c74-4f80-8c8c-a0f4de9f9bb1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:13.669720 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-3baf18b9-5c74-4f80-8c8c-a0f4de9f9bb1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042504 May 10 21:15:13.670272 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 506/973] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:13 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:13.922202 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-afea0eb1-de6a-47e6-a0e8-8812128bec4f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:13.923041 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-afea0eb1-de6a-47e6-a0e8-8812128bec4f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:13.929108 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-afea0eb1-de6a-47e6-a0e8-8812128bec4f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:13.929550 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-afea0eb1-de6a-47e6-a0e8-8812128bec4f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:13.930304 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-afea0eb1-de6a-47e6-a0e8-8812128bec4f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:13.930740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-afea0eb1-de6a-47e6-a0e8-8812128bec4f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:13.960498 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-afea0eb1-de6a-47e6-a0e8-8812128bec4f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042477 May 10 21:15:13.961046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 468/974] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:13 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:14.204084 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-20b78b5e-34a6-45de-a47e-cfbd00069f32 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:14.204933 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-20b78b5e-34a6-45de-a47e-cfbd00069f32 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:14.210862 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-20b78b5e-34a6-45de-a47e-cfbd00069f32 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:14.211348 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-20b78b5e-34a6-45de-a47e-cfbd00069f32 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:14.212115 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-20b78b5e-34a6-45de-a47e-cfbd00069f32 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:14.212555 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-20b78b5e-34a6-45de-a47e-cfbd00069f32 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:14.241305 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-20b78b5e-34a6-45de-a47e-cfbd00069f32 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041519 May 10 21:15:14.241854 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 507/975] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:14 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:14.681399 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-765077c7-03f9-4741-b7a7-ed589f89e89f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:14.682311 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-765077c7-03f9-4741-b7a7-ed589f89e89f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:14.688360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-765077c7-03f9-4741-b7a7-ed589f89e89f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:14.688809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-765077c7-03f9-4741-b7a7-ed589f89e89f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:14.689571 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-765077c7-03f9-4741-b7a7-ed589f89e89f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:14.690006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-765077c7-03f9-4741-b7a7-ed589f89e89f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:14.718235 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-765077c7-03f9-4741-b7a7-ed589f89e89f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040811 May 10 21:15:14.718782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 469/976] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:14 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:14.972238 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-ba1b0bac-a6e3-43b5-888d-552a823621e6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:14.973085 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-ba1b0bac-a6e3-43b5-888d-552a823621e6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:14.979647 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ba1b0bac-a6e3-43b5-888d-552a823621e6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:14.980101 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ba1b0bac-a6e3-43b5-888d-552a823621e6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:14.981551 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ba1b0bac-a6e3-43b5-888d-552a823621e6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:14.982028 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ba1b0bac-a6e3-43b5-888d-552a823621e6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:15.011031 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-ba1b0bac-a6e3-43b5-888d-552a823621e6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042868 May 10 21:15:15.011614 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 508/977] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:14 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:15.253006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-134cc712-406a-496b-b97a-e01db57ce5b4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:15.253856 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-134cc712-406a-496b-b97a-e01db57ce5b4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:15.260185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-134cc712-406a-496b-b97a-e01db57ce5b4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:15.260631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-134cc712-406a-496b-b97a-e01db57ce5b4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:15.261388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-134cc712-406a-496b-b97a-e01db57ce5b4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:15.261950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-134cc712-406a-496b-b97a-e01db57ce5b4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:15.289810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-134cc712-406a-496b-b97a-e01db57ce5b4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040817 May 10 21:15:15.290344 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 470/978] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:15 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:15.730083 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-5880e300-0016-4a39-8155-600dc9f79963 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:15.731211 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5880e300-0016-4a39-8155-600dc9f79963 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:15.737240 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5880e300-0016-4a39-8155-600dc9f79963 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:15.737687 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5880e300-0016-4a39-8155-600dc9f79963 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:15.738449 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5880e300-0016-4a39-8155-600dc9f79963 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:15.738885 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5880e300-0016-4a39-8155-600dc9f79963 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:15.767607 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-5880e300-0016-4a39-8155-600dc9f79963 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041444 May 10 21:15:15.768146 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 509/979] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:15 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:16.022029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e0260cfb-8fec-4aca-ace5-0389563f9bac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:16.022889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e0260cfb-8fec-4aca-ace5-0389563f9bac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:16.028854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e0260cfb-8fec-4aca-ace5-0389563f9bac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:16.032433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e0260cfb-8fec-4aca-ace5-0389563f9bac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:16.032433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e0260cfb-8fec-4aca-ace5-0389563f9bac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:16.032433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e0260cfb-8fec-4aca-ace5-0389563f9bac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:16.059965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e0260cfb-8fec-4aca-ace5-0389563f9bac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041211 May 10 21:15:16.060552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 471/980] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:16 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:16.301916 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-1a8a1655-9ebd-415f-81d7-727ba04af3a4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:16.302792 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-1a8a1655-9ebd-415f-81d7-727ba04af3a4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:16.309294 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1a8a1655-9ebd-415f-81d7-727ba04af3a4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:16.309768 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1a8a1655-9ebd-415f-81d7-727ba04af3a4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:16.310546 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1a8a1655-9ebd-415f-81d7-727ba04af3a4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:16.310991 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1a8a1655-9ebd-415f-81d7-727ba04af3a4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:16.339972 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-1a8a1655-9ebd-415f-81d7-727ba04af3a4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042070 May 10 21:15:16.341228 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 510/981] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:16 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:16.780004 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-19cb6955-9bf0-487f-8f75-7dda7f41a326 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:16.780932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-19cb6955-9bf0-487f-8f75-7dda7f41a326 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:16.787255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-19cb6955-9bf0-487f-8f75-7dda7f41a326 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:16.787704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-19cb6955-9bf0-487f-8f75-7dda7f41a326 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:16.788466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-19cb6955-9bf0-487f-8f75-7dda7f41a326 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:16.788900 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-19cb6955-9bf0-487f-8f75-7dda7f41a326 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:16.817869 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-19cb6955-9bf0-487f-8f75-7dda7f41a326 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042604 May 10 21:15:16.818407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 472/982] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:16 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:17.072022 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f561112c-d54e-4d74-90b7-27f012eadb15 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:17.072890 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f561112c-d54e-4d74-90b7-27f012eadb15 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:17.079566 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f561112c-d54e-4d74-90b7-27f012eadb15 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:17.080014 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f561112c-d54e-4d74-90b7-27f012eadb15 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:17.080781 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f561112c-d54e-4d74-90b7-27f012eadb15 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:17.081217 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f561112c-d54e-4d74-90b7-27f012eadb15 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:17.109416 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f561112c-d54e-4d74-90b7-27f012eadb15 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041429 May 10 21:15:17.109950 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 511/983] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:17 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:17.352340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-988a683d-5962-4849-b8b6-d828cafe471f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:17.353263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-988a683d-5962-4849-b8b6-d828cafe471f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:17.359443 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-988a683d-5962-4849-b8b6-d828cafe471f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:17.359898 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-988a683d-5962-4849-b8b6-d828cafe471f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:17.360663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-988a683d-5962-4849-b8b6-d828cafe471f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:17.361105 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-988a683d-5962-4849-b8b6-d828cafe471f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:17.390715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-988a683d-5962-4849-b8b6-d828cafe471f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042393 May 10 21:15:17.391290 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 473/984] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:17 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:17.831190 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f6907c91-af52-4b1e-b62b-954479299813 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:17.832113 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f6907c91-af52-4b1e-b62b-954479299813 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:17.838393 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f6907c91-af52-4b1e-b62b-954479299813 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:17.838839 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f6907c91-af52-4b1e-b62b-954479299813 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:17.839633 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f6907c91-af52-4b1e-b62b-954479299813 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:17.840068 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f6907c91-af52-4b1e-b62b-954479299813 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:17.868566 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f6907c91-af52-4b1e-b62b-954479299813 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042303 May 10 21:15:17.869040 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 512/985] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:17 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:18.120879 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-704d53e2-4e44-4bc3-a848-77ea6e7bc3b6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:18.122293 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-704d53e2-4e44-4bc3-a848-77ea6e7bc3b6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:18.128832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-704d53e2-4e44-4bc3-a848-77ea6e7bc3b6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:18.129306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-704d53e2-4e44-4bc3-a848-77ea6e7bc3b6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:18.130080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-704d53e2-4e44-4bc3-a848-77ea6e7bc3b6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:18.130528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-704d53e2-4e44-4bc3-a848-77ea6e7bc3b6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:18.160127 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-704d53e2-4e44-4bc3-a848-77ea6e7bc3b6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043559 May 10 21:15:18.160887 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 474/986] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:18 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:15:18.402146 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-368ef91a-7857-4c85-9025-28ede0f94f58 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:18.403710 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-368ef91a-7857-4c85-9025-28ede0f94f58 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:18.409616 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-368ef91a-7857-4c85-9025-28ede0f94f58 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:18.410057 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-368ef91a-7857-4c85-9025-28ede0f94f58 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:18.410813 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-368ef91a-7857-4c85-9025-28ede0f94f58 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:18.411273 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-368ef91a-7857-4c85-9025-28ede0f94f58 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:18.440264 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-368ef91a-7857-4c85-9025-28ede0f94f58 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042138 May 10 21:15:18.440805 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 513/987] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:18 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:18.716506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d598bfb2-82db-4634-9f77-1aa420781207 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:15:18.716982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d598bfb2-82db-4634-9f77-1aa420781207 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:18.722858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d598bfb2-82db-4634-9f77-1aa420781207 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:18.723340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d598bfb2-82db-4634-9f77-1aa420781207 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:18.724102 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d598bfb2-82db-4634-9f77-1aa420781207 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:18.724565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d598bfb2-82db-4634-9f77-1aa420781207 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:18.746132 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.objects.instance [None req-d598bfb2-82db-4634-9f77-1aa420781207 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lazy-loading 'flavor' on Instance uuid d4c7c73d-54f3-4695-87bc-4c9d22d5652f {{(pid=117714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:15:18.880389 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e5f721e6-605e-4200-973c-33b0a6b8c201 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:18.881317 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e5f721e6-605e-4200-973c-33b0a6b8c201 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:18.888172 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e5f721e6-605e-4200-973c-33b0a6b8c201 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:18.888774 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e5f721e6-605e-4200-973c-33b0a6b8c201 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:18.889657 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e5f721e6-605e-4200-973c-33b0a6b8c201 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:18.890089 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e5f721e6-605e-4200-973c-33b0a6b8c201 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:18.923566 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e5f721e6-605e-4200-973c-33b0a6b8c201 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047086 May 10 21:15:18.924125 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 514/988] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:18 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:15:19.032908 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d598bfb2-82db-4634-9f77-1aa420781207 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "POST /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f/action" status: 202 len: 0 microversion: 2.1 time: 0.320620 May 10 21:15:19.033443 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 475/989] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 21:15:18 2022] POST /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:15:19.045637 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a7e1af24-1695-4947-9c63-c469a7ebf9da tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:19.046974 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a7e1af24-1695-4947-9c63-c469a7ebf9da tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:19.054883 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a7e1af24-1695-4947-9c63-c469a7ebf9da tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:19.055364 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a7e1af24-1695-4947-9c63-c469a7ebf9da tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:19.056138 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a7e1af24-1695-4947-9c63-c469a7ebf9da tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:19.056575 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a7e1af24-1695-4947-9c63-c469a7ebf9da tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:19.173191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-38d44d40-2fd8-407f-919a-625de25de22c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:19.174232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-38d44d40-2fd8-407f-919a-625de25de22c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:19.180308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38d44d40-2fd8-407f-919a-625de25de22c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:19.180753 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38d44d40-2fd8-407f-919a-625de25de22c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:19.181516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38d44d40-2fd8-407f-919a-625de25de22c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:19.181947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38d44d40-2fd8-407f-919a-625de25de22c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:19.190707 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-a7e1af24-1695-4947-9c63-c469a7ebf9da tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:19.198479 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a7e1af24-1695-4947-9c63-c469a7ebf9da tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.160389 May 10 21:15:19.199049 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 515/990] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:19 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:19.211715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-38d44d40-2fd8-407f-919a-625de25de22c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043938 May 10 21:15:19.212271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 476/991] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:19 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:15:19.452501 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9dba51b6-a4db-42c5-92e0-0c9b4859f36f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:19.453483 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-9dba51b6-a4db-42c5-92e0-0c9b4859f36f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:19.459529 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9dba51b6-a4db-42c5-92e0-0c9b4859f36f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:19.459971 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9dba51b6-a4db-42c5-92e0-0c9b4859f36f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:19.460732 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9dba51b6-a4db-42c5-92e0-0c9b4859f36f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:19.461173 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9dba51b6-a4db-42c5-92e0-0c9b4859f36f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:19.489720 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9dba51b6-a4db-42c5-92e0-0c9b4859f36f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041719 May 10 21:15:19.490247 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 516/992] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:19 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:19.936041 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4ece5656-b6ac-4930-92a6-060f83fa704c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:19.936960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4ece5656-b6ac-4930-92a6-060f83fa704c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:19.943328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4ece5656-b6ac-4930-92a6-060f83fa704c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:19.943784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4ece5656-b6ac-4930-92a6-060f83fa704c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:19.944544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4ece5656-b6ac-4930-92a6-060f83fa704c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:19.944984 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4ece5656-b6ac-4930-92a6-060f83fa704c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:19.974072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4ece5656-b6ac-4930-92a6-060f83fa704c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042771 May 10 21:15:19.974618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 477/993] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:19 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:20.217004 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-2bd484f1-98da-45ca-a347-1452c317232c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:20.217576 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-2bd484f1-98da-45ca-a347-1452c317232c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:20.223641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5926f681-4e95-4ba8-a773-f2fb41464f2f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:20.224147 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2bd484f1-98da-45ca-a347-1452c317232c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:20.224378 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2bd484f1-98da-45ca-a347-1452c317232c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:20.224556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5926f681-4e95-4ba8-a773-f2fb41464f2f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:20.225145 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2bd484f1-98da-45ca-a347-1452c317232c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:20.225576 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2bd484f1-98da-45ca-a347-1452c317232c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:20.231949 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5926f681-4e95-4ba8-a773-f2fb41464f2f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:20.232475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5926f681-4e95-4ba8-a773-f2fb41464f2f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:20.233252 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5926f681-4e95-4ba8-a773-f2fb41464f2f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:20.233726 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5926f681-4e95-4ba8-a773-f2fb41464f2f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:20.264595 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5926f681-4e95-4ba8-a773-f2fb41464f2f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044732 May 10 21:15:20.266258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 478/994] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:20 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:15:20.367200 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-2bd484f1-98da-45ca-a347-1452c317232c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:20.376354 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-2bd484f1-98da-45ca-a347-1452c317232c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.163476 May 10 21:15:20.376937 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 517/995] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:20 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:20.500433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-170dde51-0e79-412a-9275-bc65fc8eec18 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:20.501312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-170dde51-0e79-412a-9275-bc65fc8eec18 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:20.507251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-170dde51-0e79-412a-9275-bc65fc8eec18 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:20.507699 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-170dde51-0e79-412a-9275-bc65fc8eec18 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:20.508485 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-170dde51-0e79-412a-9275-bc65fc8eec18 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:20.508922 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-170dde51-0e79-412a-9275-bc65fc8eec18 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:20.537439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-170dde51-0e79-412a-9275-bc65fc8eec18 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040962 May 10 21:15:20.537995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 479/996] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:20 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:20.985907 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-5fe399cf-2b76-4837-b569-4fc2cf330834 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:20.986831 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5fe399cf-2b76-4837-b569-4fc2cf330834 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:20.992891 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5fe399cf-2b76-4837-b569-4fc2cf330834 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:20.993347 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5fe399cf-2b76-4837-b569-4fc2cf330834 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:20.994113 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5fe399cf-2b76-4837-b569-4fc2cf330834 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:20.994554 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5fe399cf-2b76-4837-b569-4fc2cf330834 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:21.023104 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-5fe399cf-2b76-4837-b569-4fc2cf330834 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041223 May 10 21:15:21.023679 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 518/997] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:20 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:21.278939 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4e1d29cb-e763-4044-871f-fb6f1a210207 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:21.279823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4e1d29cb-e763-4044-871f-fb6f1a210207 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:21.286256 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4e1d29cb-e763-4044-871f-fb6f1a210207 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:21.286715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4e1d29cb-e763-4044-871f-fb6f1a210207 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:21.287513 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4e1d29cb-e763-4044-871f-fb6f1a210207 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:21.287957 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4e1d29cb-e763-4044-871f-fb6f1a210207 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:21.317958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4e1d29cb-e763-4044-871f-fb6f1a210207 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043872 May 10 21:15:21.318525 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 480/998] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:21 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:21.393662 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-110ee089-78ae-42f3-82e7-da3391342fc8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:21.394279 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-110ee089-78ae-42f3-82e7-da3391342fc8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:21.400560 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-110ee089-78ae-42f3-82e7-da3391342fc8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:21.401014 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-110ee089-78ae-42f3-82e7-da3391342fc8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:21.401783 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-110ee089-78ae-42f3-82e7-da3391342fc8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:21.402225 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-110ee089-78ae-42f3-82e7-da3391342fc8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:21.530261 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-110ee089-78ae-42f3-82e7-da3391342fc8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:21.537608 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-110ee089-78ae-42f3-82e7-da3391342fc8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.147816 May 10 21:15:21.538182 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 519/999] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:21 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:21.548997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f2ebe391-7fd6-4b01-9c4a-069b5dd64497 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:21.549931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f2ebe391-7fd6-4b01-9c4a-069b5dd64497 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:21.555860 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2ebe391-7fd6-4b01-9c4a-069b5dd64497 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:21.556321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2ebe391-7fd6-4b01-9c4a-069b5dd64497 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:21.557096 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2ebe391-7fd6-4b01-9c4a-069b5dd64497 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:21.557541 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2ebe391-7fd6-4b01-9c4a-069b5dd64497 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:21.586827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f2ebe391-7fd6-4b01-9c4a-069b5dd64497 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041710 May 10 21:15:21.587439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 481/1000] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:21 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:22.034897 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-51ba64c7-1591-4eba-95b9-a451ab6f3bf3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:22.035874 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-51ba64c7-1591-4eba-95b9-a451ab6f3bf3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:22.041754 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-51ba64c7-1591-4eba-95b9-a451ab6f3bf3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:22.042198 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-51ba64c7-1591-4eba-95b9-a451ab6f3bf3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:22.042961 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-51ba64c7-1591-4eba-95b9-a451ab6f3bf3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:22.044022 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-51ba64c7-1591-4eba-95b9-a451ab6f3bf3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:22.071814 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-51ba64c7-1591-4eba-95b9-a451ab6f3bf3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040895 May 10 21:15:22.072355 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 520/1001] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:22 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:22.330441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a1e982b1-77ea-4f3b-9afd-59af39d4745f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:22.331340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a1e982b1-77ea-4f3b-9afd-59af39d4745f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:22.337670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a1e982b1-77ea-4f3b-9afd-59af39d4745f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:22.338117 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a1e982b1-77ea-4f3b-9afd-59af39d4745f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:22.338922 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a1e982b1-77ea-4f3b-9afd-59af39d4745f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:22.339452 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a1e982b1-77ea-4f3b-9afd-59af39d4745f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:22.369081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a1e982b1-77ea-4f3b-9afd-59af39d4745f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042629 May 10 21:15:22.369771 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 482/1002] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:22 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:22.554855 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-5989daa9-5c8a-416f-b58d-51122ab5816b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:22.555531 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5989daa9-5c8a-416f-b58d-51122ab5816b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:22.561925 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5989daa9-5c8a-416f-b58d-51122ab5816b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:22.562382 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5989daa9-5c8a-416f-b58d-51122ab5816b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:22.563201 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5989daa9-5c8a-416f-b58d-51122ab5816b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:22.563655 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5989daa9-5c8a-416f-b58d-51122ab5816b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:22.599256 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ae971175-de6b-4dcf-92a4-b66451b1494f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:22.600185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ae971175-de6b-4dcf-92a4-b66451b1494f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:22.608970 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae971175-de6b-4dcf-92a4-b66451b1494f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:22.608970 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae971175-de6b-4dcf-92a4-b66451b1494f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:22.609883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae971175-de6b-4dcf-92a4-b66451b1494f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:22.610331 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae971175-de6b-4dcf-92a4-b66451b1494f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:22.640705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ae971175-de6b-4dcf-92a4-b66451b1494f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045476 May 10 21:15:22.641272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 483/1003] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:22 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:15:22.697279 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-5989daa9-5c8a-416f-b58d-51122ab5816b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:22.704781 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-5989daa9-5c8a-416f-b58d-51122ab5816b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.153854 May 10 21:15:22.705343 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 521/1004] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:22 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:23.082866 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0b800ff1-d186-4b1f-aed5-5434893b16cd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:23.083756 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0b800ff1-d186-4b1f-aed5-5434893b16cd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:23.089858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0b800ff1-d186-4b1f-aed5-5434893b16cd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:23.090985 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0b800ff1-d186-4b1f-aed5-5434893b16cd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:23.091785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0b800ff1-d186-4b1f-aed5-5434893b16cd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:23.092224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0b800ff1-d186-4b1f-aed5-5434893b16cd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:23.120070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0b800ff1-d186-4b1f-aed5-5434893b16cd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041258 May 10 21:15:23.120612 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 484/1005] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:23 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:23.380855 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c0f578b6-b877-4ca0-8c1b-50a66f6abf5b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:23.381786 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c0f578b6-b877-4ca0-8c1b-50a66f6abf5b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:23.388685 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c0f578b6-b877-4ca0-8c1b-50a66f6abf5b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:23.389131 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c0f578b6-b877-4ca0-8c1b-50a66f6abf5b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:23.389895 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c0f578b6-b877-4ca0-8c1b-50a66f6abf5b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:23.390329 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c0f578b6-b877-4ca0-8c1b-50a66f6abf5b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:23.424081 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c0f578b6-b877-4ca0-8c1b-50a66f6abf5b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047114 May 10 21:15:23.438353 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 522/1006] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:23 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:23.652215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-59c518a6-fcaa-4b83-b01b-64c30a0e11ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:23.653746 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-59c518a6-fcaa-4b83-b01b-64c30a0e11ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:23.660106 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-59c518a6-fcaa-4b83-b01b-64c30a0e11ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:23.660558 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-59c518a6-fcaa-4b83-b01b-64c30a0e11ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:23.661321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-59c518a6-fcaa-4b83-b01b-64c30a0e11ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:23.661757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-59c518a6-fcaa-4b83-b01b-64c30a0e11ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:23.692050 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-59c518a6-fcaa-4b83-b01b-64c30a0e11ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043597 May 10 21:15:23.692606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 485/1007] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:23 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:23.721998 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6a885e51-5d2a-49f7-8ac3-53be382b624e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:23.722625 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6a885e51-5d2a-49f7-8ac3-53be382b624e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:23.728916 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6a885e51-5d2a-49f7-8ac3-53be382b624e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:23.729364 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6a885e51-5d2a-49f7-8ac3-53be382b624e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:23.730126 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6a885e51-5d2a-49f7-8ac3-53be382b624e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:23.730564 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6a885e51-5d2a-49f7-8ac3-53be382b624e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:23.858000 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-6a885e51-5d2a-49f7-8ac3-53be382b624e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:23.865618 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6a885e51-5d2a-49f7-8ac3-53be382b624e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.147508 May 10 21:15:23.866181 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 523/1008] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:23 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:24.131740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1c8489e1-9a49-437d-9316-44f742a2da3f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:24.132668 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1c8489e1-9a49-437d-9316-44f742a2da3f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:24.139216 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1c8489e1-9a49-437d-9316-44f742a2da3f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:24.139672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1c8489e1-9a49-437d-9316-44f742a2da3f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:24.140444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1c8489e1-9a49-437d-9316-44f742a2da3f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:24.140887 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1c8489e1-9a49-437d-9316-44f742a2da3f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:24.170536 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1c8489e1-9a49-437d-9316-44f742a2da3f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042796 May 10 21:15:24.171088 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 486/1009] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:24 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:24.446223 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-59428ed2-7617-4a6f-8988-0ccaab1a346a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:24.447215 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-59428ed2-7617-4a6f-8988-0ccaab1a346a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:24.453291 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-59428ed2-7617-4a6f-8988-0ccaab1a346a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:24.453743 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-59428ed2-7617-4a6f-8988-0ccaab1a346a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:24.454508 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-59428ed2-7617-4a6f-8988-0ccaab1a346a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:24.455203 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-59428ed2-7617-4a6f-8988-0ccaab1a346a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:24.484928 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-59428ed2-7617-4a6f-8988-0ccaab1a346a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042876 May 10 21:15:24.485494 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 524/1010] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:24 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:24.704369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6f5c3375-39ae-41c6-898e-ebe6ad4cbcd5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:24.705234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6f5c3375-39ae-41c6-898e-ebe6ad4cbcd5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:24.711611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6f5c3375-39ae-41c6-898e-ebe6ad4cbcd5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:24.712130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6f5c3375-39ae-41c6-898e-ebe6ad4cbcd5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:24.712901 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6f5c3375-39ae-41c6-898e-ebe6ad4cbcd5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:24.713339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6f5c3375-39ae-41c6-898e-ebe6ad4cbcd5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:24.743163 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6f5c3375-39ae-41c6-898e-ebe6ad4cbcd5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043483 May 10 21:15:24.743716 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 487/1011] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:24 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:24.883682 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-12f475fa-7398-47cc-8807-bffb967534a8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:24.884305 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-12f475fa-7398-47cc-8807-bffb967534a8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:24.891395 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-12f475fa-7398-47cc-8807-bffb967534a8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:24.894888 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-12f475fa-7398-47cc-8807-bffb967534a8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:24.894888 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-12f475fa-7398-47cc-8807-bffb967534a8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:24.894888 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-12f475fa-7398-47cc-8807-bffb967534a8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:25.027010 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-12f475fa-7398-47cc-8807-bffb967534a8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:25.034320 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-12f475fa-7398-47cc-8807-bffb967534a8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.154551 May 10 21:15:25.034888 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 525/1012] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:24 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:25.182112 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f65dbca7-7c1c-4b8a-8427-fb637e6b79a9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:25.183027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f65dbca7-7c1c-4b8a-8427-fb637e6b79a9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:25.189023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f65dbca7-7c1c-4b8a-8427-fb637e6b79a9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:25.189466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f65dbca7-7c1c-4b8a-8427-fb637e6b79a9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:25.190219 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f65dbca7-7c1c-4b8a-8427-fb637e6b79a9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:25.190652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f65dbca7-7c1c-4b8a-8427-fb637e6b79a9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:25.219259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f65dbca7-7c1c-4b8a-8427-fb637e6b79a9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041139 May 10 21:15:25.219803 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 488/1013] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:25 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:25.496176 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-edac55dc-062d-4ab1-b548-df2d5470f63f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:25.497274 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-edac55dc-062d-4ab1-b548-df2d5470f63f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:25.503171 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-edac55dc-062d-4ab1-b548-df2d5470f63f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:25.503624 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-edac55dc-062d-4ab1-b548-df2d5470f63f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:25.504382 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-edac55dc-062d-4ab1-b548-df2d5470f63f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:25.505325 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-edac55dc-062d-4ab1-b548-df2d5470f63f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:25.534666 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-edac55dc-062d-4ab1-b548-df2d5470f63f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042323 May 10 21:15:25.535249 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 526/1014] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:25 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:25.754462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6fa756aa-0641-432a-966e-5ff0958646ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:25.755342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6fa756aa-0641-432a-966e-5ff0958646ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:25.761618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6fa756aa-0641-432a-966e-5ff0958646ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:25.762571 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6fa756aa-0641-432a-966e-5ff0958646ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:25.763387 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6fa756aa-0641-432a-966e-5ff0958646ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:25.763828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6fa756aa-0641-432a-966e-5ff0958646ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:25.956705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6fa756aa-0641-432a-966e-5ff0958646ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.206186 May 10 21:15:25.957259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 489/1015] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:25 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:26.051439 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-5e486247-44d3-4880-9c11-ac61c6dc3a3a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:26.052014 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5e486247-44d3-4880-9c11-ac61c6dc3a3a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:26.058342 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5e486247-44d3-4880-9c11-ac61c6dc3a3a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:26.059461 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5e486247-44d3-4880-9c11-ac61c6dc3a3a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:26.060352 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5e486247-44d3-4880-9c11-ac61c6dc3a3a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:26.060796 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5e486247-44d3-4880-9c11-ac61c6dc3a3a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:26.191247 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-5e486247-44d3-4880-9c11-ac61c6dc3a3a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:26.198863 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-5e486247-44d3-4880-9c11-ac61c6dc3a3a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151417 May 10 21:15:26.199576 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 527/1016] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:26 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:26.230269 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-52ee815b-3457-4e87-bcd5-65846c064b4f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:26.232303 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-52ee815b-3457-4e87-bcd5-65846c064b4f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:26.238098 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52ee815b-3457-4e87-bcd5-65846c064b4f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:26.238544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52ee815b-3457-4e87-bcd5-65846c064b4f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:26.239338 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52ee815b-3457-4e87-bcd5-65846c064b4f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:26.239777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52ee815b-3457-4e87-bcd5-65846c064b4f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:26.269437 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-52ee815b-3457-4e87-bcd5-65846c064b4f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043193 May 10 21:15:26.269993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 490/1017] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:26 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:26.546278 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-3fb2617e-41b1-4aa1-8fbb-0191ef1cec81 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:26.547275 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-3fb2617e-41b1-4aa1-8fbb-0191ef1cec81 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:26.553133 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3fb2617e-41b1-4aa1-8fbb-0191ef1cec81 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:26.553621 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3fb2617e-41b1-4aa1-8fbb-0191ef1cec81 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:26.554379 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3fb2617e-41b1-4aa1-8fbb-0191ef1cec81 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:26.554819 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3fb2617e-41b1-4aa1-8fbb-0191ef1cec81 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:26.584613 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-3fb2617e-41b1-4aa1-8fbb-0191ef1cec81 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042416 May 10 21:15:26.585175 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 528/1018] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:26 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:26.968990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-76e786a4-0a9c-4947-ba8b-a511e9ce1b31 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:26.969906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-76e786a4-0a9c-4947-ba8b-a511e9ce1b31 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:26.976379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76e786a4-0a9c-4947-ba8b-a511e9ce1b31 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:26.976823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76e786a4-0a9c-4947-ba8b-a511e9ce1b31 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:26.977581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76e786a4-0a9c-4947-ba8b-a511e9ce1b31 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:26.978017 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76e786a4-0a9c-4947-ba8b-a511e9ce1b31 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:27.005630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-76e786a4-0a9c-4947-ba8b-a511e9ce1b31 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041281 May 10 21:15:27.006172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 491/1019] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:26 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:27.216350 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c76ebb4d-f45d-4027-a071-e0a7097d329a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:27.216957 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c76ebb4d-f45d-4027-a071-e0a7097d329a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:27.223308 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c76ebb4d-f45d-4027-a071-e0a7097d329a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:27.223693 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c76ebb4d-f45d-4027-a071-e0a7097d329a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:27.224446 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c76ebb4d-f45d-4027-a071-e0a7097d329a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:27.224878 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c76ebb4d-f45d-4027-a071-e0a7097d329a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:27.282067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c4cdf19e-45f5-4e39-94d7-277eb099affb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:27.283023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c4cdf19e-45f5-4e39-94d7-277eb099affb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:27.288738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4cdf19e-45f5-4e39-94d7-277eb099affb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:27.289183 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4cdf19e-45f5-4e39-94d7-277eb099affb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:27.289953 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4cdf19e-45f5-4e39-94d7-277eb099affb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:27.290387 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4cdf19e-45f5-4e39-94d7-277eb099affb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:27.320095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c4cdf19e-45f5-4e39-94d7-277eb099affb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042529 May 10 21:15:27.320652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 492/1020] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:27 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:15:27.355277 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-c76ebb4d-f45d-4027-a071-e0a7097d329a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:27.363259 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c76ebb4d-f45d-4027-a071-e0a7097d329a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151357 May 10 21:15:27.363822 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 529/1021] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:27 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:27.596469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-10dea93b-ed60-446a-9d39-8997a0727dfa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:27.597391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-10dea93b-ed60-446a-9d39-8997a0727dfa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:27.603600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-10dea93b-ed60-446a-9d39-8997a0727dfa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:27.604061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-10dea93b-ed60-446a-9d39-8997a0727dfa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:27.604840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-10dea93b-ed60-446a-9d39-8997a0727dfa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:27.605280 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-10dea93b-ed60-446a-9d39-8997a0727dfa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:27.634707 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-10dea93b-ed60-446a-9d39-8997a0727dfa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042114 May 10 21:15:27.635282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 493/1022] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:27 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:27.720389 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d31f27f8-5c0f-426b-bc87-b1b2e6d2d779 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:27.720892 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d31f27f8-5c0f-426b-bc87-b1b2e6d2d779 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 92b6d664-37d6-422f-a52a-0ffec8a44389] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:27.726880 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d31f27f8-5c0f-426b-bc87-b1b2e6d2d779 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:27.727369 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d31f27f8-5c0f-426b-bc87-b1b2e6d2d779 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:27.728138 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d31f27f8-5c0f-426b-bc87-b1b2e6d2d779 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:27.728580 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d31f27f8-5c0f-426b-bc87-b1b2e6d2d779 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:27.750667 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d31f27f8-5c0f-426b-bc87-b1b2e6d2d779 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389/ips" status: 200 len: 145 microversion: 2.1 time: 0.034150 May 10 21:15:27.751247 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 530/1023] 10.222.0.49 () {58 vars in 1247 bytes} [Tue May 10 21:15:27 2022] GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389/ips => generated 145 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:28.017932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-34c16eb7-2830-4beb-b31e-9c12d278582b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:28.018854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-34c16eb7-2830-4beb-b31e-9c12d278582b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:28.025153 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-34c16eb7-2830-4beb-b31e-9c12d278582b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:28.025598 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-34c16eb7-2830-4beb-b31e-9c12d278582b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:28.026425 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-34c16eb7-2830-4beb-b31e-9c12d278582b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:28.026857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-34c16eb7-2830-4beb-b31e-9c12d278582b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:28.055105 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-34c16eb7-2830-4beb-b31e-9c12d278582b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041160 May 10 21:15:28.055660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 494/1024] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:28 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:28.331870 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f32da2a8-e4fb-47b9-a227-11ced4f27dcd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:28.332831 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f32da2a8-e4fb-47b9-a227-11ced4f27dcd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:28.339384 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f32da2a8-e4fb-47b9-a227-11ced4f27dcd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:28.339845 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f32da2a8-e4fb-47b9-a227-11ced4f27dcd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:28.341210 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f32da2a8-e4fb-47b9-a227-11ced4f27dcd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:28.341660 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f32da2a8-e4fb-47b9-a227-11ced4f27dcd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:28.370525 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f32da2a8-e4fb-47b9-a227-11ced4f27dcd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042753 May 10 21:15:28.371096 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 531/1025] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:28 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:28.380370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0c5dc86d-e342-4521-b49f-0097eaee5128 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:28.380982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0c5dc86d-e342-4521-b49f-0097eaee5128 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:28.387592 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c5dc86d-e342-4521-b49f-0097eaee5128 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:28.388047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c5dc86d-e342-4521-b49f-0097eaee5128 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:28.388803 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c5dc86d-e342-4521-b49f-0097eaee5128 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:28.389347 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c5dc86d-e342-4521-b49f-0097eaee5128 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:28.524126 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0c5dc86d-e342-4521-b49f-0097eaee5128 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:28.532965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0c5dc86d-e342-4521-b49f-0097eaee5128 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.156660 May 10 21:15:28.533562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 495/1026] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:28 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:28.646607 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-4e76de57-8fff-467d-a5dc-e92b657b436e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:28.647568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-4e76de57-8fff-467d-a5dc-e92b657b436e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:28.654394 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4e76de57-8fff-467d-a5dc-e92b657b436e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:28.655326 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4e76de57-8fff-467d-a5dc-e92b657b436e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:28.655641 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4e76de57-8fff-467d-a5dc-e92b657b436e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:28.656082 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4e76de57-8fff-467d-a5dc-e92b657b436e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:28.686115 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-4e76de57-8fff-467d-a5dc-e92b657b436e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043396 May 10 21:15:28.686694 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 532/1027] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:28 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:29.067432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-03695ff2-d445-4545-8e8f-2b9f6db030b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:29.068351 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-03695ff2-d445-4545-8e8f-2b9f6db030b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:29.075144 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03695ff2-d445-4545-8e8f-2b9f6db030b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:29.075600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03695ff2-d445-4545-8e8f-2b9f6db030b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:29.076367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03695ff2-d445-4545-8e8f-2b9f6db030b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:29.076805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03695ff2-d445-4545-8e8f-2b9f6db030b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:29.105257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-03695ff2-d445-4545-8e8f-2b9f6db030b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042115 May 10 21:15:29.105862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 496/1028] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:29 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:29.381980 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-0c45d547-7266-44e5-a674-b7d7fb6c989f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:29.383169 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-0c45d547-7266-44e5-a674-b7d7fb6c989f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:29.390907 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0c45d547-7266-44e5-a674-b7d7fb6c989f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:29.391394 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0c45d547-7266-44e5-a674-b7d7fb6c989f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:29.392171 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0c45d547-7266-44e5-a674-b7d7fb6c989f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:29.392612 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0c45d547-7266-44e5-a674-b7d7fb6c989f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:29.422533 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-0c45d547-7266-44e5-a674-b7d7fb6c989f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044507 May 10 21:15:29.423112 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 533/1029] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:29 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:29.550823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-29a0c9ab-209d-4935-8c10-107cdcd16702 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:29.551556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-29a0c9ab-209d-4935-8c10-107cdcd16702 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:29.557387 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-29a0c9ab-209d-4935-8c10-107cdcd16702 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:29.557842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-29a0c9ab-209d-4935-8c10-107cdcd16702 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:29.558739 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-29a0c9ab-209d-4935-8c10-107cdcd16702 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:29.559847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-29a0c9ab-209d-4935-8c10-107cdcd16702 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:29.697911 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c4b7ade8-f6de-457a-8b8b-c763ec8adaf8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:29.698851 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c4b7ade8-f6de-457a-8b8b-c763ec8adaf8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:29.706396 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c4b7ade8-f6de-457a-8b8b-c763ec8adaf8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:29.706396 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c4b7ade8-f6de-457a-8b8b-c763ec8adaf8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:29.707180 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c4b7ade8-f6de-457a-8b8b-c763ec8adaf8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:29.707629 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c4b7ade8-f6de-457a-8b8b-c763ec8adaf8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:29.740382 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c4b7ade8-f6de-457a-8b8b-c763ec8adaf8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046323 May 10 21:15:29.740966 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 534/1030] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:29 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:15:29.775601 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-29a0c9ab-209d-4935-8c10-107cdcd16702 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:29.783983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-29a0c9ab-209d-4935-8c10-107cdcd16702 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.237065 May 10 21:15:29.784548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 497/1031] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:29 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:30.116855 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c7a3be5b-c00e-4d3b-89d7-537b1b463e1c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:30.117726 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c7a3be5b-c00e-4d3b-89d7-537b1b463e1c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:30.125077 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c7a3be5b-c00e-4d3b-89d7-537b1b463e1c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:30.128683 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c7a3be5b-c00e-4d3b-89d7-537b1b463e1c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:30.128683 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c7a3be5b-c00e-4d3b-89d7-537b1b463e1c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:30.128683 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c7a3be5b-c00e-4d3b-89d7-537b1b463e1c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:30.157671 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c7a3be5b-c00e-4d3b-89d7-537b1b463e1c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044798 May 10 21:15:30.158422 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 535/1032] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:30 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:30.433690 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e4630f05-ff1d-4abf-ae9b-d9905d3cfb05 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:30.435253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e4630f05-ff1d-4abf-ae9b-d9905d3cfb05 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:30.441483 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4630f05-ff1d-4abf-ae9b-d9905d3cfb05 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:30.442173 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4630f05-ff1d-4abf-ae9b-d9905d3cfb05 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:30.442939 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4630f05-ff1d-4abf-ae9b-d9905d3cfb05 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:30.443400 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4630f05-ff1d-4abf-ae9b-d9905d3cfb05 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:30.471780 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e4630f05-ff1d-4abf-ae9b-d9905d3cfb05 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042162 May 10 21:15:30.472319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 498/1033] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:30 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:30.752180 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-cac69cf4-6b3b-43ce-9edf-625ee63d1ae0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:30.753035 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-cac69cf4-6b3b-43ce-9edf-625ee63d1ae0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:30.759342 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cac69cf4-6b3b-43ce-9edf-625ee63d1ae0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:30.759789 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cac69cf4-6b3b-43ce-9edf-625ee63d1ae0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:30.760544 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cac69cf4-6b3b-43ce-9edf-625ee63d1ae0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:30.760978 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cac69cf4-6b3b-43ce-9edf-625ee63d1ae0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:30.791286 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-cac69cf4-6b3b-43ce-9edf-625ee63d1ae0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043124 May 10 21:15:30.791847 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 536/1034] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:30 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:30.806362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-31b22909-6a4b-4d39-8fb2-85b5ee505116 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:30.806362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-31b22909-6a4b-4d39-8fb2-85b5ee505116 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:30.808112 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-31b22909-6a4b-4d39-8fb2-85b5ee505116 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:30.808557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-31b22909-6a4b-4d39-8fb2-85b5ee505116 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:30.809981 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-31b22909-6a4b-4d39-8fb2-85b5ee505116 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:30.810414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-31b22909-6a4b-4d39-8fb2-85b5ee505116 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:30.938811 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-31b22909-6a4b-4d39-8fb2-85b5ee505116 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:30.946479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-31b22909-6a4b-4d39-8fb2-85b5ee505116 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.148713 May 10 21:15:30.947059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 499/1035] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:30 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:31.170139 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6e8b9782-5eef-48b5-8c99-a87e10b8529a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:31.171069 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6e8b9782-5eef-48b5-8c99-a87e10b8529a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:31.177027 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6e8b9782-5eef-48b5-8c99-a87e10b8529a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:31.177478 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6e8b9782-5eef-48b5-8c99-a87e10b8529a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:31.178239 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6e8b9782-5eef-48b5-8c99-a87e10b8529a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:31.178680 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6e8b9782-5eef-48b5-8c99-a87e10b8529a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:31.207027 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6e8b9782-5eef-48b5-8c99-a87e10b8529a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041576 May 10 21:15:31.207606 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 537/1036] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:31 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:31.483696 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4cc4b396-f12a-458e-86d9-7d2c300223f8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:31.484627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4cc4b396-f12a-458e-86d9-7d2c300223f8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:31.490882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4cc4b396-f12a-458e-86d9-7d2c300223f8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:31.491460 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4cc4b396-f12a-458e-86d9-7d2c300223f8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:31.492180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4cc4b396-f12a-458e-86d9-7d2c300223f8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:31.492562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4cc4b396-f12a-458e-86d9-7d2c300223f8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:31.524995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4cc4b396-f12a-458e-86d9-7d2c300223f8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045462 May 10 21:15:31.525547 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 500/1037] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:31 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:31.803480 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-ae42fb53-71e8-4344-9a4f-d42b4299fccc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:31.804333 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-ae42fb53-71e8-4344-9a4f-d42b4299fccc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:31.810692 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ae42fb53-71e8-4344-9a4f-d42b4299fccc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:31.811149 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ae42fb53-71e8-4344-9a4f-d42b4299fccc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:31.811951 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ae42fb53-71e8-4344-9a4f-d42b4299fccc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:31.812368 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ae42fb53-71e8-4344-9a4f-d42b4299fccc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:31.842593 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-ae42fb53-71e8-4344-9a4f-d42b4299fccc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043177 May 10 21:15:31.843239 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 538/1038] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:31 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:31.964683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e27417fe-6e64-4dd8-87a9-f3dbcd0d36b3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:31.966186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e27417fe-6e64-4dd8-87a9-f3dbcd0d36b3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:31.972270 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e27417fe-6e64-4dd8-87a9-f3dbcd0d36b3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:31.972721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e27417fe-6e64-4dd8-87a9-f3dbcd0d36b3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:31.973477 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e27417fe-6e64-4dd8-87a9-f3dbcd0d36b3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:31.973910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e27417fe-6e64-4dd8-87a9-f3dbcd0d36b3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:32.105281 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e27417fe-6e64-4dd8-87a9-f3dbcd0d36b3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:32.113140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e27417fe-6e64-4dd8-87a9-f3dbcd0d36b3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.152437 May 10 21:15:32.113692 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 501/1039] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:31 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:32.217870 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-aa69da79-8253-43ed-ab6e-cd0d02d756c7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:32.218810 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-aa69da79-8253-43ed-ab6e-cd0d02d756c7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:32.224892 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-aa69da79-8253-43ed-ab6e-cd0d02d756c7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:32.225348 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-aa69da79-8253-43ed-ab6e-cd0d02d756c7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:32.226122 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-aa69da79-8253-43ed-ab6e-cd0d02d756c7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:32.226565 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-aa69da79-8253-43ed-ab6e-cd0d02d756c7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:32.256291 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-aa69da79-8253-43ed-ab6e-cd0d02d756c7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042524 May 10 21:15:32.256849 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 539/1040] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:32 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:32.537540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5e54936e-f97b-4657-ace0-bb6ff50ea195 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:32.538491 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5e54936e-f97b-4657-ace0-bb6ff50ea195 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:32.545775 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5e54936e-f97b-4657-ace0-bb6ff50ea195 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:32.546216 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5e54936e-f97b-4657-ace0-bb6ff50ea195 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:32.546983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5e54936e-f97b-4657-ace0-bb6ff50ea195 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:32.547448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5e54936e-f97b-4657-ace0-bb6ff50ea195 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:32.575886 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5e54936e-f97b-4657-ace0-bb6ff50ea195 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042253 May 10 21:15:32.576432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 502/1041] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:32 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:32.853967 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d4a42115-777a-49f3-ac34-6ca657591762 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:32.854898 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d4a42115-777a-49f3-ac34-6ca657591762 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:32.861812 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d4a42115-777a-49f3-ac34-6ca657591762 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:32.862263 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d4a42115-777a-49f3-ac34-6ca657591762 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:32.863024 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d4a42115-777a-49f3-ac34-6ca657591762 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:32.863492 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d4a42115-777a-49f3-ac34-6ca657591762 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:32.892623 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d4a42115-777a-49f3-ac34-6ca657591762 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042606 May 10 21:15:32.893210 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 540/1042] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:32 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:33.131496 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6ba70de1-65eb-406a-b5be-3224dcf3802d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:33.132023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6ba70de1-65eb-406a-b5be-3224dcf3802d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:33.138741 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6ba70de1-65eb-406a-b5be-3224dcf3802d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:33.139223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6ba70de1-65eb-406a-b5be-3224dcf3802d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:33.139988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6ba70de1-65eb-406a-b5be-3224dcf3802d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:33.140415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6ba70de1-65eb-406a-b5be-3224dcf3802d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:33.267376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6ba70de1-65eb-406a-b5be-3224dcf3802d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:33.267892 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-ec246ff0-5991-455d-b598-2da2d171e025 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:33.268822 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-ec246ff0-5991-455d-b598-2da2d171e025 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:33.274622 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ec246ff0-5991-455d-b598-2da2d171e025 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:33.274858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6ba70de1-65eb-406a-b5be-3224dcf3802d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.147235 May 10 21:15:33.275086 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ec246ff0-5991-455d-b598-2da2d171e025 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:33.275453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 503/1043] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:33 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:33.275879 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ec246ff0-5991-455d-b598-2da2d171e025 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:33.276318 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ec246ff0-5991-455d-b598-2da2d171e025 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:33.305731 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-ec246ff0-5991-455d-b598-2da2d171e025 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041821 May 10 21:15:33.306313 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 541/1044] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:33 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:15:33.549691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-c70debc5-8f00-48f0-8a7e-08d9efa027bc req-12908211-0359-4eb2-9585-a09e994323d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4c7c73d-54f3-4695-87bc-4c9d22d5652f", "name": "network-vif-unplugged", "status": "completed", "tag": "b751e302-b05a-4d37-b886-85ba68540b75"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:15:33.558096 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-c70debc5-8f00-48f0-8a7e-08d9efa027bc req-12908211-0359-4eb2-9585-a09e994323d0 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:33.558648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-c70debc5-8f00-48f0-8a7e-08d9efa027bc req-12908211-0359-4eb2-9585-a09e994323d0 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:33.570658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-c70debc5-8f00-48f0-8a7e-08d9efa027bc req-12908211-0359-4eb2-9585-a09e994323d0 service nova] Creating event network-vif-unplugged:b751e302-b05a-4d37-b886-85ba68540b75 for instance d4c7c73d-54f3-4695-87bc-4c9d22d5652f on hv-cinder-82880 May 10 21:15:33.576042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-c70debc5-8f00-48f0-8a7e-08d9efa027bc req-12908211-0359-4eb2-9585-a09e994323d0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030093 May 10 21:15:33.576675 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 504/1045] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:33.587684 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-ad25039b-0c0f-4b5e-949b-835062f92a43 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:33.588641 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-ad25039b-0c0f-4b5e-949b-835062f92a43 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:33.594634 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ad25039b-0c0f-4b5e-949b-835062f92a43 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:33.595078 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ad25039b-0c0f-4b5e-949b-835062f92a43 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:33.599289 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ad25039b-0c0f-4b5e-949b-835062f92a43 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:33.599289 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ad25039b-0c0f-4b5e-949b-835062f92a43 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:33.627241 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-ad25039b-0c0f-4b5e-949b-835062f92a43 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043554 May 10 21:15:33.627807 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 542/1046] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:33 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:33.908561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-aebfca34-29a8-4e53-84d5-be5fbb31b064 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:33.909581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-aebfca34-29a8-4e53-84d5-be5fbb31b064 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:33.915823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aebfca34-29a8-4e53-84d5-be5fbb31b064 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:33.916306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aebfca34-29a8-4e53-84d5-be5fbb31b064 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:33.921562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aebfca34-29a8-4e53-84d5-be5fbb31b064 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:33.921562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aebfca34-29a8-4e53-84d5-be5fbb31b064 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:33.948060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-aebfca34-29a8-4e53-84d5-be5fbb31b064 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043778 May 10 21:15:33.948605 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 505/1047] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:33 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:34.292992 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-22f3fff6-6949-4642-9149-12a23e40a956 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:34.293776 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-22f3fff6-6949-4642-9149-12a23e40a956 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:34.299824 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-22f3fff6-6949-4642-9149-12a23e40a956 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:34.300270 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-22f3fff6-6949-4642-9149-12a23e40a956 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:34.301030 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-22f3fff6-6949-4642-9149-12a23e40a956 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:34.301470 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-22f3fff6-6949-4642-9149-12a23e40a956 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:34.318060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9b9ac888-d8ec-4ec3-9e82-c3114e2c36a8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:34.319072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9b9ac888-d8ec-4ec3-9e82-c3114e2c36a8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:34.325449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9b9ac888-d8ec-4ec3-9e82-c3114e2c36a8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:34.325912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9b9ac888-d8ec-4ec3-9e82-c3114e2c36a8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:34.326688 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9b9ac888-d8ec-4ec3-9e82-c3114e2c36a8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:34.327185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9b9ac888-d8ec-4ec3-9e82-c3114e2c36a8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:34.357171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9b9ac888-d8ec-4ec3-9e82-c3114e2c36a8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043116 May 10 21:15:34.357738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 506/1048] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:34 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:15:34.431940 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-22f3fff6-6949-4642-9149-12a23e40a956 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:34.439706 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-22f3fff6-6949-4642-9149-12a23e40a956 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.150730 May 10 21:15:34.440277 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 543/1049] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:34 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:34.638779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e86ee15f-98f2-4aff-947b-eed3e38263c2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:34.639743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e86ee15f-98f2-4aff-947b-eed3e38263c2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:34.646162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e86ee15f-98f2-4aff-947b-eed3e38263c2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:34.646613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e86ee15f-98f2-4aff-947b-eed3e38263c2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:34.647419 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e86ee15f-98f2-4aff-947b-eed3e38263c2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:34.647863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e86ee15f-98f2-4aff-947b-eed3e38263c2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:34.677679 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e86ee15f-98f2-4aff-947b-eed3e38263c2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043674 May 10 21:15:34.678226 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 507/1050] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:34 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:34.959980 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-85e17453-3a0b-44b2-8203-856cd168c079 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:34.960830 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-85e17453-3a0b-44b2-8203-856cd168c079 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:34.967375 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-85e17453-3a0b-44b2-8203-856cd168c079 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:34.967822 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-85e17453-3a0b-44b2-8203-856cd168c079 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:34.968584 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-85e17453-3a0b-44b2-8203-856cd168c079 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:34.969018 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-85e17453-3a0b-44b2-8203-856cd168c079 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:34.998219 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-85e17453-3a0b-44b2-8203-856cd168c079 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042451 May 10 21:15:35.000707 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 544/1051] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:34 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:35.368772 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c4aff2ed-2f6e-4e05-a1b4-27a785074798 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:35.369693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c4aff2ed-2f6e-4e05-a1b4-27a785074798 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:35.376227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4aff2ed-2f6e-4e05-a1b4-27a785074798 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:35.376674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4aff2ed-2f6e-4e05-a1b4-27a785074798 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:35.377430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4aff2ed-2f6e-4e05-a1b4-27a785074798 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:35.377862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4aff2ed-2f6e-4e05-a1b4-27a785074798 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:35.405867 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c4aff2ed-2f6e-4e05-a1b4-27a785074798 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041092 May 10 21:15:35.406399 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 508/1052] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:35 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:35.457620 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-794a74dc-49c5-49a1-bb1d-de4b8b3c471e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:35.458232 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-794a74dc-49c5-49a1-bb1d-de4b8b3c471e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:35.464539 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-794a74dc-49c5-49a1-bb1d-de4b8b3c471e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:35.465044 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-794a74dc-49c5-49a1-bb1d-de4b8b3c471e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:35.465972 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-794a74dc-49c5-49a1-bb1d-de4b8b3c471e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:35.466412 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-794a74dc-49c5-49a1-bb1d-de4b8b3c471e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:35.591786 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-794a74dc-49c5-49a1-bb1d-de4b8b3c471e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:35.600264 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-794a74dc-49c5-49a1-bb1d-de4b8b3c471e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.146417 May 10 21:15:35.601319 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 545/1053] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:35 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:35.689404 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dc53a396-2e5a-44ac-8d11-75e222bec6a3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:35.690256 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dc53a396-2e5a-44ac-8d11-75e222bec6a3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:35.696884 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dc53a396-2e5a-44ac-8d11-75e222bec6a3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:35.697326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dc53a396-2e5a-44ac-8d11-75e222bec6a3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:35.698086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dc53a396-2e5a-44ac-8d11-75e222bec6a3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:35.698523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dc53a396-2e5a-44ac-8d11-75e222bec6a3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:35.726891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dc53a396-2e5a-44ac-8d11-75e222bec6a3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041497 May 10 21:15:35.727463 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 509/1054] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:35 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:36.010110 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-037200c0-60ef-4ff8-ad9f-ac8c7440aa17 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:36.010959 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-037200c0-60ef-4ff8-ad9f-ac8c7440aa17 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:36.017449 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-037200c0-60ef-4ff8-ad9f-ac8c7440aa17 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:36.017900 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-037200c0-60ef-4ff8-ad9f-ac8c7440aa17 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:36.018698 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-037200c0-60ef-4ff8-ad9f-ac8c7440aa17 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:36.019156 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-037200c0-60ef-4ff8-ad9f-ac8c7440aa17 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:36.048598 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-037200c0-60ef-4ff8-ad9f-ac8c7440aa17 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042654 May 10 21:15:36.049165 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 546/1055] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:36 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:36.417551 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b8812656-2964-4f5e-bf33-b3f15443d615 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:36.419112 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b8812656-2964-4f5e-bf33-b3f15443d615 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:36.425071 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b8812656-2964-4f5e-bf33-b3f15443d615 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:36.425514 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b8812656-2964-4f5e-bf33-b3f15443d615 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:36.426272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b8812656-2964-4f5e-bf33-b3f15443d615 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:36.426705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b8812656-2964-4f5e-bf33-b3f15443d615 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:36.455311 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b8812656-2964-4f5e-bf33-b3f15443d615 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041826 May 10 21:15:36.455853 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 510/1056] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:36 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:36.618339 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-22499a80-8561-4a97-83da-56dd82f06ff6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:36.618954 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-22499a80-8561-4a97-83da-56dd82f06ff6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:36.625296 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-22499a80-8561-4a97-83da-56dd82f06ff6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:36.625743 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-22499a80-8561-4a97-83da-56dd82f06ff6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:36.626503 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-22499a80-8561-4a97-83da-56dd82f06ff6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:36.626934 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-22499a80-8561-4a97-83da-56dd82f06ff6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:36.738711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a171cdb3-fc57-4047-916e-7c451c2e6c1e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:36.739740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a171cdb3-fc57-4047-916e-7c451c2e6c1e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:36.746196 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a171cdb3-fc57-4047-916e-7c451c2e6c1e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:36.747398 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a171cdb3-fc57-4047-916e-7c451c2e6c1e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:36.748292 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a171cdb3-fc57-4047-916e-7c451c2e6c1e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:36.748749 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a171cdb3-fc57-4047-916e-7c451c2e6c1e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:36.757246 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-22499a80-8561-4a97-83da-56dd82f06ff6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:36.764652 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-22499a80-8561-4a97-83da-56dd82f06ff6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.150121 May 10 21:15:36.765231 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 547/1057] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:36 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:36.778209 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a171cdb3-fc57-4047-916e-7c451c2e6c1e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043384 May 10 21:15:36.778767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 511/1058] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:36 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:15:37.060486 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-2ce947fd-a3d3-413f-bec8-6bc8c5b724fd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:37.061340 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-2ce947fd-a3d3-413f-bec8-6bc8c5b724fd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:37.067610 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2ce947fd-a3d3-413f-bec8-6bc8c5b724fd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:37.068064 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2ce947fd-a3d3-413f-bec8-6bc8c5b724fd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:37.068842 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2ce947fd-a3d3-413f-bec8-6bc8c5b724fd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:37.069284 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2ce947fd-a3d3-413f-bec8-6bc8c5b724fd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:37.097652 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-2ce947fd-a3d3-413f-bec8-6bc8c5b724fd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041464 May 10 21:15:37.098204 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 548/1059] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:37 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:37.467638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-03ca1fe0-3cef-4881-978f-20e5b4bca1ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:37.468600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-03ca1fe0-3cef-4881-978f-20e5b4bca1ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:37.474574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03ca1fe0-3cef-4881-978f-20e5b4bca1ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:37.475035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03ca1fe0-3cef-4881-978f-20e5b4bca1ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:37.475837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03ca1fe0-3cef-4881-978f-20e5b4bca1ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:37.476280 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03ca1fe0-3cef-4881-978f-20e5b4bca1ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:37.504729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-03ca1fe0-3cef-4881-978f-20e5b4bca1ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041778 May 10 21:15:37.505266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 512/1060] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:37 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:37.782233 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e15b7f6a-6fd1-4c60-a150-5204e6a6bb7d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:37.782913 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e15b7f6a-6fd1-4c60-a150-5204e6a6bb7d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:37.789147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c940b0a9-303c-4538-b7ba-1ae6cfe32a2a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:37.789577 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e15b7f6a-6fd1-4c60-a150-5204e6a6bb7d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:37.789881 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e15b7f6a-6fd1-4c60-a150-5204e6a6bb7d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:37.790103 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c940b0a9-303c-4538-b7ba-1ae6cfe32a2a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:37.790644 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e15b7f6a-6fd1-4c60-a150-5204e6a6bb7d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:37.791081 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e15b7f6a-6fd1-4c60-a150-5204e6a6bb7d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:37.797270 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c940b0a9-303c-4538-b7ba-1ae6cfe32a2a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:37.797725 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c940b0a9-303c-4538-b7ba-1ae6cfe32a2a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:37.798532 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c940b0a9-303c-4538-b7ba-1ae6cfe32a2a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:37.798970 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c940b0a9-303c-4538-b7ba-1ae6cfe32a2a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:37.827557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c940b0a9-303c-4538-b7ba-1ae6cfe32a2a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042254 May 10 21:15:37.828123 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 513/1061] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:37 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:15:37.920775 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-e15b7f6a-6fd1-4c60-a150-5204e6a6bb7d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:37.928083 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e15b7f6a-6fd1-4c60-a150-5204e6a6bb7d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.149730 May 10 21:15:37.932409 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 549/1062] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:37 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:38.109283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9dae99d8-50f4-4731-aa91-5e604e3c8b0a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:38.110200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9dae99d8-50f4-4731-aa91-5e604e3c8b0a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:38.116170 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9dae99d8-50f4-4731-aa91-5e604e3c8b0a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:38.116622 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9dae99d8-50f4-4731-aa91-5e604e3c8b0a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:38.117379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9dae99d8-50f4-4731-aa91-5e604e3c8b0a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:38.117815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9dae99d8-50f4-4731-aa91-5e604e3c8b0a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:38.145935 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9dae99d8-50f4-4731-aa91-5e604e3c8b0a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040735 May 10 21:15:38.146482 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 514/1063] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:38 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:38.517444 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6547a8ff-decf-488a-b139-2e02e24d55d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:38.518300 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6547a8ff-decf-488a-b139-2e02e24d55d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:38.524234 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6547a8ff-decf-488a-b139-2e02e24d55d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:38.524909 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6547a8ff-decf-488a-b139-2e02e24d55d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:38.525674 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6547a8ff-decf-488a-b139-2e02e24d55d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:38.526108 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6547a8ff-decf-488a-b139-2e02e24d55d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:38.554837 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6547a8ff-decf-488a-b139-2e02e24d55d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041444 May 10 21:15:38.555408 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 550/1064] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:38 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:38.839094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0541f88f-dc6e-4ece-9529-9885754964a4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:38.840655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0541f88f-dc6e-4ece-9529-9885754964a4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:38.846998 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0541f88f-dc6e-4ece-9529-9885754964a4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:38.847483 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0541f88f-dc6e-4ece-9529-9885754964a4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:38.848253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0541f88f-dc6e-4ece-9529-9885754964a4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:38.848693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0541f88f-dc6e-4ece-9529-9885754964a4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:38.876579 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0541f88f-dc6e-4ece-9529-9885754964a4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041402 May 10 21:15:38.877126 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 515/1065] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:38 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:38.947113 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-76c44c1c-961f-4796-8e91-1a955a4445cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:38.947744 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-76c44c1c-961f-4796-8e91-1a955a4445cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:38.954694 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-76c44c1c-961f-4796-8e91-1a955a4445cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:38.955183 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-76c44c1c-961f-4796-8e91-1a955a4445cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:38.955951 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-76c44c1c-961f-4796-8e91-1a955a4445cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:38.956387 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-76c44c1c-961f-4796-8e91-1a955a4445cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:39.083778 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-76c44c1c-961f-4796-8e91-1a955a4445cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:39.092401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-76c44c1c-961f-4796-8e91-1a955a4445cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.149029 May 10 21:15:39.092908 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 551/1066] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:38 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:39.157791 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a91be2ce-7ec8-47a2-b502-4fbdca5d1651 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:39.158744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a91be2ce-7ec8-47a2-b502-4fbdca5d1651 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:39.164758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a91be2ce-7ec8-47a2-b502-4fbdca5d1651 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:39.165209 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a91be2ce-7ec8-47a2-b502-4fbdca5d1651 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:39.165981 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a91be2ce-7ec8-47a2-b502-4fbdca5d1651 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:39.166421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a91be2ce-7ec8-47a2-b502-4fbdca5d1651 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:39.194981 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a91be2ce-7ec8-47a2-b502-4fbdca5d1651 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041101 May 10 21:15:39.195561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 516/1067] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:39 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:39.566432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-8e7e53a7-6232-447c-af51-05ff1258eaf8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:39.567589 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-8e7e53a7-6232-447c-af51-05ff1258eaf8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:39.573547 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8e7e53a7-6232-447c-af51-05ff1258eaf8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:39.574006 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8e7e53a7-6232-447c-af51-05ff1258eaf8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:39.575441 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8e7e53a7-6232-447c-af51-05ff1258eaf8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:39.575879 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8e7e53a7-6232-447c-af51-05ff1258eaf8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:39.605596 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-8e7e53a7-6232-447c-af51-05ff1258eaf8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043173 May 10 21:15:39.606664 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 552/1068] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:39 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:39.889007 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-78386132-f423-45b9-8129-2538a7b6b000 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:39.889926 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-78386132-f423-45b9-8129-2538a7b6b000 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:39.896282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-78386132-f423-45b9-8129-2538a7b6b000 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:39.896731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-78386132-f423-45b9-8129-2538a7b6b000 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:39.897496 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-78386132-f423-45b9-8129-2538a7b6b000 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:39.897933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-78386132-f423-45b9-8129-2538a7b6b000 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:39.926684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-78386132-f423-45b9-8129-2538a7b6b000 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042272 May 10 21:15:39.927311 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 517/1069] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:39 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:15:40.110056 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-84730be6-d321-4ef9-ac7f-d0ecd21f2364 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:40.110666 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-84730be6-d321-4ef9-ac7f-d0ecd21f2364 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:40.117032 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-84730be6-d321-4ef9-ac7f-d0ecd21f2364 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:40.117473 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-84730be6-d321-4ef9-ac7f-d0ecd21f2364 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:40.118227 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-84730be6-d321-4ef9-ac7f-d0ecd21f2364 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:40.118659 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-84730be6-d321-4ef9-ac7f-d0ecd21f2364 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:40.205862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c3c82f9b-41e9-4b79-bfd7-09d2eff7e293 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:40.206789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c3c82f9b-41e9-4b79-bfd7-09d2eff7e293 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:40.212955 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c3c82f9b-41e9-4b79-bfd7-09d2eff7e293 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:40.213429 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c3c82f9b-41e9-4b79-bfd7-09d2eff7e293 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:40.214197 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c3c82f9b-41e9-4b79-bfd7-09d2eff7e293 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:40.214640 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c3c82f9b-41e9-4b79-bfd7-09d2eff7e293 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:40.243953 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c3c82f9b-41e9-4b79-bfd7-09d2eff7e293 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041935 May 10 21:15:40.244515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 518/1070] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:40 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:15:40.250641 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-84730be6-d321-4ef9-ac7f-d0ecd21f2364 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:40.257987 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-84730be6-d321-4ef9-ac7f-d0ecd21f2364 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.152467 May 10 21:15:40.258769 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 553/1071] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:40 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:40.617963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0895265a-d3fd-498b-8ae2-d2518083a5c7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:40.618893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0895265a-d3fd-498b-8ae2-d2518083a5c7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:40.625473 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0895265a-d3fd-498b-8ae2-d2518083a5c7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:40.625924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0895265a-d3fd-498b-8ae2-d2518083a5c7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:40.626691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0895265a-d3fd-498b-8ae2-d2518083a5c7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:40.627150 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0895265a-d3fd-498b-8ae2-d2518083a5c7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:40.656766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0895265a-d3fd-498b-8ae2-d2518083a5c7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042816 May 10 21:15:40.657311 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 519/1072] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:40 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:40.938721 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9c896d96-d499-425c-9d01-976d513ca13f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:40.939758 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-9c896d96-d499-425c-9d01-976d513ca13f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:40.945911 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9c896d96-d499-425c-9d01-976d513ca13f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:40.947239 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9c896d96-d499-425c-9d01-976d513ca13f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:40.947239 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9c896d96-d499-425c-9d01-976d513ca13f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:40.947647 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9c896d96-d499-425c-9d01-976d513ca13f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:40.981388 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9c896d96-d499-425c-9d01-976d513ca13f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046810 May 10 21:15:40.982633 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 554/1073] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:40 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:41.255796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f82648d1-fc5e-4375-969c-04294ec597a8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:41.256635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f82648d1-fc5e-4375-969c-04294ec597a8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:41.263690 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f82648d1-fc5e-4375-969c-04294ec597a8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:41.264145 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f82648d1-fc5e-4375-969c-04294ec597a8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:41.264913 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f82648d1-fc5e-4375-969c-04294ec597a8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:41.265353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f82648d1-fc5e-4375-969c-04294ec597a8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:41.276411 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e3aaa4e7-5a92-4d9d-aecb-5d91ef7839b5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:41.277018 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e3aaa4e7-5a92-4d9d-aecb-5d91ef7839b5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:41.283827 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e3aaa4e7-5a92-4d9d-aecb-5d91ef7839b5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:41.284280 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e3aaa4e7-5a92-4d9d-aecb-5d91ef7839b5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:41.285046 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e3aaa4e7-5a92-4d9d-aecb-5d91ef7839b5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:41.285479 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e3aaa4e7-5a92-4d9d-aecb-5d91ef7839b5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:41.295329 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f82648d1-fc5e-4375-969c-04294ec597a8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043540 May 10 21:15:41.295890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 520/1074] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:41 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:41.412286 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-e3aaa4e7-5a92-4d9d-aecb-5d91ef7839b5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:41.419930 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e3aaa4e7-5a92-4d9d-aecb-5d91ef7839b5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.147269 May 10 21:15:41.420509 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 555/1075] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:41 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:15:41.668312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a6f8501a-910d-4247-865a-f42fb63028ff tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:41.669997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a6f8501a-910d-4247-865a-f42fb63028ff tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:41.675938 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a6f8501a-910d-4247-865a-f42fb63028ff tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:41.676387 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a6f8501a-910d-4247-865a-f42fb63028ff tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:41.677152 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a6f8501a-910d-4247-865a-f42fb63028ff tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:41.677586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a6f8501a-910d-4247-865a-f42fb63028ff tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:41.705984 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a6f8501a-910d-4247-865a-f42fb63028ff tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041675 May 10 21:15:41.706517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 521/1076] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:41 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:41.994009 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-4db3af05-09f4-4ee1-ad78-12948b9e1125 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:41.994864 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-4db3af05-09f4-4ee1-ad78-12948b9e1125 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:42.000947 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4db3af05-09f4-4ee1-ad78-12948b9e1125 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:42.001396 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4db3af05-09f4-4ee1-ad78-12948b9e1125 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:42.002165 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4db3af05-09f4-4ee1-ad78-12948b9e1125 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:42.002702 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4db3af05-09f4-4ee1-ad78-12948b9e1125 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:42.032512 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-4db3af05-09f4-4ee1-ad78-12948b9e1125 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042604 May 10 21:15:42.033054 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 556/1077] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:41 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:42.306833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-021c5545-67cd-495b-b36a-e8c18dd27d10 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:42.307780 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-021c5545-67cd-495b-b36a-e8c18dd27d10 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:42.314186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-021c5545-67cd-495b-b36a-e8c18dd27d10 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:42.319032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-021c5545-67cd-495b-b36a-e8c18dd27d10 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:42.319032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-021c5545-67cd-495b-b36a-e8c18dd27d10 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:42.319032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-021c5545-67cd-495b-b36a-e8c18dd27d10 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:42.344544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-021c5545-67cd-495b-b36a-e8c18dd27d10 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041649 May 10 21:15:42.345087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 522/1078] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:42 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:42.437005 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a5c23757-f300-4caf-b6ab-857e87fb8873 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:42.437628 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a5c23757-f300-4caf-b6ab-857e87fb8873 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:42.444277 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a5c23757-f300-4caf-b6ab-857e87fb8873 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:42.444729 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a5c23757-f300-4caf-b6ab-857e87fb8873 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:42.445497 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a5c23757-f300-4caf-b6ab-857e87fb8873 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:42.445939 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a5c23757-f300-4caf-b6ab-857e87fb8873 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:42.577550 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-a5c23757-f300-4caf-b6ab-857e87fb8873 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:42.584867 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a5c23757-f300-4caf-b6ab-857e87fb8873 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151786 May 10 21:15:42.585430 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 557/1079] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:42 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:42.718617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b7e84e7e-bac6-4ac7-bcd9-bddc8e58e657 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:42.719584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b7e84e7e-bac6-4ac7-bcd9-bddc8e58e657 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:42.725594 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b7e84e7e-bac6-4ac7-bcd9-bddc8e58e657 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:42.726052 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b7e84e7e-bac6-4ac7-bcd9-bddc8e58e657 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:42.726821 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b7e84e7e-bac6-4ac7-bcd9-bddc8e58e657 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:42.727291 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b7e84e7e-bac6-4ac7-bcd9-bddc8e58e657 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:42.755761 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b7e84e7e-bac6-4ac7-bcd9-bddc8e58e657 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042243 May 10 21:15:42.756298 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 523/1080] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:42 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:43.045063 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-fd268ef7-1b12-4eb0-804d-9cc6f0922dfd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:43.045983 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-fd268ef7-1b12-4eb0-804d-9cc6f0922dfd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:43.051949 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fd268ef7-1b12-4eb0-804d-9cc6f0922dfd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:43.052377 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fd268ef7-1b12-4eb0-804d-9cc6f0922dfd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:43.053132 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fd268ef7-1b12-4eb0-804d-9cc6f0922dfd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:43.053568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fd268ef7-1b12-4eb0-804d-9cc6f0922dfd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:43.081689 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-fd268ef7-1b12-4eb0-804d-9cc6f0922dfd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041453 May 10 21:15:43.082229 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 558/1081] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:43 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:43.356379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ee3df0b6-1c66-4748-85de-e5d0d0c994a6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:43.357870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ee3df0b6-1c66-4748-85de-e5d0d0c994a6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:43.364203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee3df0b6-1c66-4748-85de-e5d0d0c994a6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:43.364655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee3df0b6-1c66-4748-85de-e5d0d0c994a6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:43.365401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee3df0b6-1c66-4748-85de-e5d0d0c994a6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:43.365831 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee3df0b6-1c66-4748-85de-e5d0d0c994a6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:43.394066 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ee3df0b6-1c66-4748-85de-e5d0d0c994a6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041654 May 10 21:15:43.394605 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 524/1082] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:43 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:43.603203 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-b74279b2-e62b-4e44-a049-74676812d406 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:43.603891 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-b74279b2-e62b-4e44-a049-74676812d406 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:43.611632 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b74279b2-e62b-4e44-a049-74676812d406 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:43.612087 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b74279b2-e62b-4e44-a049-74676812d406 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:43.612862 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b74279b2-e62b-4e44-a049-74676812d406 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:43.613299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b74279b2-e62b-4e44-a049-74676812d406 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:43.739351 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-b74279b2-e62b-4e44-a049-74676812d406 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:43.746699 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-b74279b2-e62b-4e44-a049-74676812d406 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.147384 May 10 21:15:43.747396 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 559/1083] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:43 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:43.766527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b13e1030-1c20-4d09-a3ca-656e806aead5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:43.767472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b13e1030-1c20-4d09-a3ca-656e806aead5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:43.773339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b13e1030-1c20-4d09-a3ca-656e806aead5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:43.773769 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b13e1030-1c20-4d09-a3ca-656e806aead5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:43.774522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b13e1030-1c20-4d09-a3ca-656e806aead5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:43.774955 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b13e1030-1c20-4d09-a3ca-656e806aead5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:43.804475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b13e1030-1c20-4d09-a3ca-656e806aead5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042133 May 10 21:15:43.805066 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 525/1084] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:43 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:44.094119 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-93cba0e7-f608-4af9-be85-2a26fa43f871 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:44.095057 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-93cba0e7-f608-4af9-be85-2a26fa43f871 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:44.101093 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-93cba0e7-f608-4af9-be85-2a26fa43f871 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:44.101546 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-93cba0e7-f608-4af9-be85-2a26fa43f871 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:44.102314 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-93cba0e7-f608-4af9-be85-2a26fa43f871 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:44.102756 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-93cba0e7-f608-4af9-be85-2a26fa43f871 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:44.131385 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-93cba0e7-f608-4af9-be85-2a26fa43f871 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041977 May 10 21:15:44.131939 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 560/1085] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:44 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:44.405755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-51ce5ee9-83b3-467d-91ad-5b6ac7d7b6d9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:44.406647 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-51ce5ee9-83b3-467d-91ad-5b6ac7d7b6d9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:44.413017 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51ce5ee9-83b3-467d-91ad-5b6ac7d7b6d9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:44.413472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51ce5ee9-83b3-467d-91ad-5b6ac7d7b6d9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:44.414259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51ce5ee9-83b3-467d-91ad-5b6ac7d7b6d9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:44.414704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51ce5ee9-83b3-467d-91ad-5b6ac7d7b6d9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:44.444266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-51ce5ee9-83b3-467d-91ad-5b6ac7d7b6d9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042627 May 10 21:15:44.444829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 526/1086] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:44 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:44.764630 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-7589e25f-9e6f-4b2d-9429-174689ad268d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:44.765166 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-7589e25f-9e6f-4b2d-9429-174689ad268d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:44.771559 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7589e25f-9e6f-4b2d-9429-174689ad268d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:44.772007 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7589e25f-9e6f-4b2d-9429-174689ad268d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:44.772766 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7589e25f-9e6f-4b2d-9429-174689ad268d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:44.773202 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7589e25f-9e6f-4b2d-9429-174689ad268d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:44.816067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3892593e-4031-409d-a419-eea4e1891343 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:44.816983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3892593e-4031-409d-a419-eea4e1891343 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:44.823528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3892593e-4031-409d-a419-eea4e1891343 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:44.823973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3892593e-4031-409d-a419-eea4e1891343 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:44.824736 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3892593e-4031-409d-a419-eea4e1891343 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:44.825802 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3892593e-4031-409d-a419-eea4e1891343 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:44.855208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3892593e-4031-409d-a419-eea4e1891343 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043107 May 10 21:15:44.855762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 527/1087] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:44 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:15:44.906192 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-7589e25f-9e6f-4b2d-9429-174689ad268d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:44.913961 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-7589e25f-9e6f-4b2d-9429-174689ad268d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.153865 May 10 21:15:44.914533 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 561/1088] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:44 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:45.142408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0a89ae9d-107a-49b0-899b-ada83c5b20da tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:45.143408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0a89ae9d-107a-49b0-899b-ada83c5b20da tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:45.149516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0a89ae9d-107a-49b0-899b-ada83c5b20da tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:45.149972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0a89ae9d-107a-49b0-899b-ada83c5b20da tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:45.150741 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0a89ae9d-107a-49b0-899b-ada83c5b20da tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:45.151211 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0a89ae9d-107a-49b0-899b-ada83c5b20da tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:45.180291 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0a89ae9d-107a-49b0-899b-ada83c5b20da tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041881 May 10 21:15:45.180839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 528/1089] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:45 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:45.455656 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-fcd4aa34-dfc3-45f8-bf54-cb82e82386d0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:45.456533 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-fcd4aa34-dfc3-45f8-bf54-cb82e82386d0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:45.462386 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fcd4aa34-dfc3-45f8-bf54-cb82e82386d0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:45.462829 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fcd4aa34-dfc3-45f8-bf54-cb82e82386d0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:45.463608 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fcd4aa34-dfc3-45f8-bf54-cb82e82386d0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:45.464045 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fcd4aa34-dfc3-45f8-bf54-cb82e82386d0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:45.494521 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-fcd4aa34-dfc3-45f8-bf54-cb82e82386d0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042827 May 10 21:15:45.495079 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 562/1090] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:45 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:45.867303 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-21772f13-e8d0-4908-873d-865e6aa90750 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:45.868225 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-21772f13-e8d0-4908-873d-865e6aa90750 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:45.875410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21772f13-e8d0-4908-873d-865e6aa90750 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:45.875859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21772f13-e8d0-4908-873d-865e6aa90750 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:45.876622 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21772f13-e8d0-4908-873d-865e6aa90750 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:45.877058 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21772f13-e8d0-4908-873d-865e6aa90750 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:45.905863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-21772f13-e8d0-4908-873d-865e6aa90750 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042537 May 10 21:15:45.906439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 529/1091] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:45 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:45.931952 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-8e5dcdd8-82e5-48eb-8629-c014e82bb708 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:45.933276 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-8e5dcdd8-82e5-48eb-8629-c014e82bb708 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:45.940107 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8e5dcdd8-82e5-48eb-8629-c014e82bb708 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:45.940557 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8e5dcdd8-82e5-48eb-8629-c014e82bb708 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:45.941330 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8e5dcdd8-82e5-48eb-8629-c014e82bb708 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:45.941769 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8e5dcdd8-82e5-48eb-8629-c014e82bb708 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:46.073016 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-8e5dcdd8-82e5-48eb-8629-c014e82bb708 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:46.080909 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-8e5dcdd8-82e5-48eb-8629-c014e82bb708 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.152846 May 10 21:15:46.081476 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 563/1092] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:45 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:46.192074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-160f16a5-fd92-4da2-8bad-89b6b138d8f8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:46.193157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-160f16a5-fd92-4da2-8bad-89b6b138d8f8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:46.199096 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-160f16a5-fd92-4da2-8bad-89b6b138d8f8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:46.199570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-160f16a5-fd92-4da2-8bad-89b6b138d8f8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:46.200360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-160f16a5-fd92-4da2-8bad-89b6b138d8f8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:46.200789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-160f16a5-fd92-4da2-8bad-89b6b138d8f8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:46.228605 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-160f16a5-fd92-4da2-8bad-89b6b138d8f8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040630 May 10 21:15:46.229146 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 530/1093] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:46 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:46.505918 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-2dbda3ca-a3f1-405e-8b69-d4daf945889a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:46.506777 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-2dbda3ca-a3f1-405e-8b69-d4daf945889a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:46.513270 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2dbda3ca-a3f1-405e-8b69-d4daf945889a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:46.513863 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2dbda3ca-a3f1-405e-8b69-d4daf945889a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:46.514631 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2dbda3ca-a3f1-405e-8b69-d4daf945889a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:46.515070 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2dbda3ca-a3f1-405e-8b69-d4daf945889a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:46.543289 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-2dbda3ca-a3f1-405e-8b69-d4daf945889a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041365 May 10 21:15:46.543830 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 564/1094] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:46 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:46.917683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-aec72665-5570-420a-9ef2-e8d9d1990359 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:46.918627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-aec72665-5570-420a-9ef2-e8d9d1990359 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:46.925866 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aec72665-5570-420a-9ef2-e8d9d1990359 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:46.926311 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aec72665-5570-420a-9ef2-e8d9d1990359 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:46.927105 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aec72665-5570-420a-9ef2-e8d9d1990359 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:46.927561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aec72665-5570-420a-9ef2-e8d9d1990359 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:46.957402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-aec72665-5570-420a-9ef2-e8d9d1990359 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043752 May 10 21:15:46.957938 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 531/1095] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:46 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:47.098036 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e5d179f2-ada7-4725-adf0-e8e1d4aae142 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:47.098651 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e5d179f2-ada7-4725-adf0-e8e1d4aae142 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:47.104917 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e5d179f2-ada7-4725-adf0-e8e1d4aae142 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:47.105371 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e5d179f2-ada7-4725-adf0-e8e1d4aae142 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:47.106132 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e5d179f2-ada7-4725-adf0-e8e1d4aae142 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:47.106666 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e5d179f2-ada7-4725-adf0-e8e1d4aae142 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:47.232544 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-e5d179f2-ada7-4725-adf0-e8e1d4aae142 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:47.239998 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e5d179f2-ada7-4725-adf0-e8e1d4aae142 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.145757 May 10 21:15:47.240565 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 565/1096] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:47 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:47.240844 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-733fbf61-0da0-4a51-8384-ce020bba6369 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:47.241827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-733fbf61-0da0-4a51-8384-ce020bba6369 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:47.247627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-733fbf61-0da0-4a51-8384-ce020bba6369 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:47.248071 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-733fbf61-0da0-4a51-8384-ce020bba6369 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:47.248831 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-733fbf61-0da0-4a51-8384-ce020bba6369 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:47.249263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-733fbf61-0da0-4a51-8384-ce020bba6369 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:47.277175 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-733fbf61-0da0-4a51-8384-ce020bba6369 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040218 May 10 21:15:47.277712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 532/1097] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:47 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:15:47.554886 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-53d57d03-c55d-409d-9a70-5cb8e63f8537 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:47.555769 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-53d57d03-c55d-409d-9a70-5cb8e63f8537 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:47.562335 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-53d57d03-c55d-409d-9a70-5cb8e63f8537 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:47.562787 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-53d57d03-c55d-409d-9a70-5cb8e63f8537 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:47.563578 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-53d57d03-c55d-409d-9a70-5cb8e63f8537 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:47.564013 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-53d57d03-c55d-409d-9a70-5cb8e63f8537 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:47.592884 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-53d57d03-c55d-409d-9a70-5cb8e63f8537 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042081 May 10 21:15:47.593437 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 566/1098] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:47 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:47.968644 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-861f6289-5bfb-464c-8804-60e998d1ed0e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:47.969559 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-861f6289-5bfb-464c-8804-60e998d1ed0e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:47.975988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-861f6289-5bfb-464c-8804-60e998d1ed0e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:47.978168 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-861f6289-5bfb-464c-8804-60e998d1ed0e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:47.978168 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-861f6289-5bfb-464c-8804-60e998d1ed0e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:47.978168 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-861f6289-5bfb-464c-8804-60e998d1ed0e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:48.006145 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-861f6289-5bfb-464c-8804-60e998d1ed0e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042069 May 10 21:15:48.006682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 533/1099] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:47 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:48.257667 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-0f111d66-edfc-4609-a25c-9b42ac8b3cee tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:48.258230 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-0f111d66-edfc-4609-a25c-9b42ac8b3cee tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:48.266396 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0f111d66-edfc-4609-a25c-9b42ac8b3cee tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:48.267259 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0f111d66-edfc-4609-a25c-9b42ac8b3cee tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:48.268110 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0f111d66-edfc-4609-a25c-9b42ac8b3cee tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:48.268557 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0f111d66-edfc-4609-a25c-9b42ac8b3cee tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:48.288832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c4f9dcfd-b546-4ed7-9b4e-b3613a73ae70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:48.289755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c4f9dcfd-b546-4ed7-9b4e-b3613a73ae70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:48.296510 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4f9dcfd-b546-4ed7-9b4e-b3613a73ae70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:48.296959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4f9dcfd-b546-4ed7-9b4e-b3613a73ae70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:48.297730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4f9dcfd-b546-4ed7-9b4e-b3613a73ae70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:48.298168 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4f9dcfd-b546-4ed7-9b4e-b3613a73ae70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:48.328201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c4f9dcfd-b546-4ed7-9b4e-b3613a73ae70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043238 May 10 21:15:48.328763 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 534/1100] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:48 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:15:48.400809 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-0f111d66-edfc-4609-a25c-9b42ac8b3cee tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:48.409038 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-0f111d66-edfc-4609-a25c-9b42ac8b3cee tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.155326 May 10 21:15:48.409691 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 567/1101] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:48 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:48.604462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-50e40b1e-3257-4608-80a1-461f7d4d314a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:48.605388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-50e40b1e-3257-4608-80a1-461f7d4d314a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:48.611902 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50e40b1e-3257-4608-80a1-461f7d4d314a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:48.612356 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50e40b1e-3257-4608-80a1-461f7d4d314a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:48.613125 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50e40b1e-3257-4608-80a1-461f7d4d314a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:48.613565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50e40b1e-3257-4608-80a1-461f7d4d314a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:48.642506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-50e40b1e-3257-4608-80a1-461f7d4d314a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042051 May 10 21:15:48.643047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 535/1102] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:48 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:49.017866 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-742196db-4a49-4886-a73e-675f2cfef3c7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:49.018748 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-742196db-4a49-4886-a73e-675f2cfef3c7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:49.024761 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-742196db-4a49-4886-a73e-675f2cfef3c7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:49.025218 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-742196db-4a49-4886-a73e-675f2cfef3c7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:49.025996 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-742196db-4a49-4886-a73e-675f2cfef3c7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:49.026442 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-742196db-4a49-4886-a73e-675f2cfef3c7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:49.055555 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-742196db-4a49-4886-a73e-675f2cfef3c7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041748 May 10 21:15:49.056306 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 568/1103] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:49 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:49.340191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6665704f-2bb6-400e-8a98-d282c43d0557 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:49.341688 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6665704f-2bb6-400e-8a98-d282c43d0557 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:49.348210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6665704f-2bb6-400e-8a98-d282c43d0557 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:49.348670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6665704f-2bb6-400e-8a98-d282c43d0557 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:49.349471 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6665704f-2bb6-400e-8a98-d282c43d0557 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:49.349915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6665704f-2bb6-400e-8a98-d282c43d0557 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:49.378923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6665704f-2bb6-400e-8a98-d282c43d0557 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042674 May 10 21:15:49.379511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 536/1104] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:49 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:49.429932 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-7938a7cb-6cd6-4988-98d8-1100b70f6df0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:49.430541 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-7938a7cb-6cd6-4988-98d8-1100b70f6df0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:49.436902 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7938a7cb-6cd6-4988-98d8-1100b70f6df0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:49.437443 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7938a7cb-6cd6-4988-98d8-1100b70f6df0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:49.438205 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7938a7cb-6cd6-4988-98d8-1100b70f6df0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:49.438637 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7938a7cb-6cd6-4988-98d8-1100b70f6df0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:49.565758 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-7938a7cb-6cd6-4988-98d8-1100b70f6df0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:49.573358 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-7938a7cb-6cd6-4988-98d8-1100b70f6df0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.147249 May 10 21:15:49.574895 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 569/1105] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:49 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:49.654701 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-86c3b129-9a9c-46d3-a217-676e1a9105c8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:49.655683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-86c3b129-9a9c-46d3-a217-676e1a9105c8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:49.661685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-86c3b129-9a9c-46d3-a217-676e1a9105c8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:49.662126 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-86c3b129-9a9c-46d3-a217-676e1a9105c8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:49.662895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-86c3b129-9a9c-46d3-a217-676e1a9105c8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:49.663362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-86c3b129-9a9c-46d3-a217-676e1a9105c8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:49.691549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-86c3b129-9a9c-46d3-a217-676e1a9105c8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041516 May 10 21:15:49.692092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 537/1106] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:49 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:50.067214 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-b228fba2-0a85-4bef-91bf-3a5ff6f79519 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:50.068322 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-b228fba2-0a85-4bef-91bf-3a5ff6f79519 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:50.074261 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b228fba2-0a85-4bef-91bf-3a5ff6f79519 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:50.074716 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b228fba2-0a85-4bef-91bf-3a5ff6f79519 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:50.075559 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b228fba2-0a85-4bef-91bf-3a5ff6f79519 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:50.076085 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b228fba2-0a85-4bef-91bf-3a5ff6f79519 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:50.108870 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-b228fba2-0a85-4bef-91bf-3a5ff6f79519 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045839 May 10 21:15:50.109425 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 570/1107] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:50 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:50.390476 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ddcc495b-dd9c-43bd-b635-5545b1ecd0f0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:50.391423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ddcc495b-dd9c-43bd-b635-5545b1ecd0f0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:50.397806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ddcc495b-dd9c-43bd-b635-5545b1ecd0f0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:50.398253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ddcc495b-dd9c-43bd-b635-5545b1ecd0f0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:50.399019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ddcc495b-dd9c-43bd-b635-5545b1ecd0f0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:50.399477 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ddcc495b-dd9c-43bd-b635-5545b1ecd0f0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:50.428895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ddcc495b-dd9c-43bd-b635-5545b1ecd0f0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042836 May 10 21:15:50.429487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 538/1108] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:50 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:50.592759 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-affbf5fc-387f-421f-a302-7c2e019bf9ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:50.593304 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-affbf5fc-387f-421f-a302-7c2e019bf9ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:50.601471 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-affbf5fc-387f-421f-a302-7c2e019bf9ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:50.601927 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-affbf5fc-387f-421f-a302-7c2e019bf9ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:50.602746 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-affbf5fc-387f-421f-a302-7c2e019bf9ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:50.603222 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-affbf5fc-387f-421f-a302-7c2e019bf9ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:50.702799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-91b6339e-39db-448f-86c4-9c7082e9b99b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:50.703770 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-91b6339e-39db-448f-86c4-9c7082e9b99b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:50.709627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91b6339e-39db-448f-86c4-9c7082e9b99b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:50.710165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91b6339e-39db-448f-86c4-9c7082e9b99b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:50.710948 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91b6339e-39db-448f-86c4-9c7082e9b99b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:50.711425 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91b6339e-39db-448f-86c4-9c7082e9b99b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:50.741702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-91b6339e-39db-448f-86c4-9c7082e9b99b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042932 May 10 21:15:50.742289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 539/1109] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:50 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:15:50.975050 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-affbf5fc-387f-421f-a302-7c2e019bf9ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:50.983466 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-affbf5fc-387f-421f-a302-7c2e019bf9ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.396580 May 10 21:15:50.984031 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 571/1110] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:50 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:51.120344 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4801f59f-8072-4d2a-a6f4-596f64206e39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:51.121273 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4801f59f-8072-4d2a-a6f4-596f64206e39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:51.127320 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4801f59f-8072-4d2a-a6f4-596f64206e39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:51.127767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4801f59f-8072-4d2a-a6f4-596f64206e39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:51.128523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4801f59f-8072-4d2a-a6f4-596f64206e39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:51.128955 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4801f59f-8072-4d2a-a6f4-596f64206e39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:51.157720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4801f59f-8072-4d2a-a6f4-596f64206e39 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041278 May 10 21:15:51.158280 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 540/1111] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:51 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:51.440780 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9c8648f2-1869-44f7-80f1-8942866f6817 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:51.441704 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-9c8648f2-1869-44f7-80f1-8942866f6817 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:51.447960 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9c8648f2-1869-44f7-80f1-8942866f6817 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:51.448402 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9c8648f2-1869-44f7-80f1-8942866f6817 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:51.449159 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9c8648f2-1869-44f7-80f1-8942866f6817 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:51.449591 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9c8648f2-1869-44f7-80f1-8942866f6817 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:51.477798 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9c8648f2-1869-44f7-80f1-8942866f6817 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040992 May 10 21:15:51.478340 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 572/1112] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:51 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:51.753990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0f2104c7-8732-493d-bb7a-970d252c513e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:51.754865 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0f2104c7-8732-493d-bb7a-970d252c513e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:51.761221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f2104c7-8732-493d-bb7a-970d252c513e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:51.761668 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f2104c7-8732-493d-bb7a-970d252c513e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:51.762431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f2104c7-8732-493d-bb7a-970d252c513e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:51.763707 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f2104c7-8732-493d-bb7a-970d252c513e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:51.791959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0f2104c7-8732-493d-bb7a-970d252c513e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042024 May 10 21:15:51.792499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 541/1113] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:51 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:52.003450 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-dc17f11f-13bb-4413-b25b-bf62bacc0fa5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:52.004118 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-dc17f11f-13bb-4413-b25b-bf62bacc0fa5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:52.010481 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-dc17f11f-13bb-4413-b25b-bf62bacc0fa5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:52.010937 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-dc17f11f-13bb-4413-b25b-bf62bacc0fa5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:52.011728 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-dc17f11f-13bb-4413-b25b-bf62bacc0fa5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:52.012175 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-dc17f11f-13bb-4413-b25b-bf62bacc0fa5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:52.140947 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-dc17f11f-13bb-4413-b25b-bf62bacc0fa5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:52.148357 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-dc17f11f-13bb-4413-b25b-bf62bacc0fa5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.148814 May 10 21:15:52.148921 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 573/1114] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:51 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:52.169655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4047161a-d11c-47d3-8750-da6d7ae11765 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:52.170579 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4047161a-d11c-47d3-8750-da6d7ae11765 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:52.176413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4047161a-d11c-47d3-8750-da6d7ae11765 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:52.176860 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4047161a-d11c-47d3-8750-da6d7ae11765 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:52.177623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4047161a-d11c-47d3-8750-da6d7ae11765 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:52.178061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4047161a-d11c-47d3-8750-da6d7ae11765 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:52.206429 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4047161a-d11c-47d3-8750-da6d7ae11765 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041283 May 10 21:15:52.206970 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 542/1115] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:52 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:52.490184 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-89459e17-5aa5-416b-9b73-3bcdbe763d7d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:52.491169 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-89459e17-5aa5-416b-9b73-3bcdbe763d7d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:52.497077 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-89459e17-5aa5-416b-9b73-3bcdbe763d7d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:52.497595 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-89459e17-5aa5-416b-9b73-3bcdbe763d7d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:52.498370 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-89459e17-5aa5-416b-9b73-3bcdbe763d7d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:52.498857 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-89459e17-5aa5-416b-9b73-3bcdbe763d7d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:52.527882 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-89459e17-5aa5-416b-9b73-3bcdbe763d7d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041592 May 10 21:15:52.529082 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 574/1116] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:52 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:52.803787 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f4892828-be58-45df-b37e-6c46f192ed24 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:52.804629 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f4892828-be58-45df-b37e-6c46f192ed24 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:52.811020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4892828-be58-45df-b37e-6c46f192ed24 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:52.811493 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4892828-be58-45df-b37e-6c46f192ed24 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:52.812250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4892828-be58-45df-b37e-6c46f192ed24 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:52.812685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4892828-be58-45df-b37e-6c46f192ed24 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:52.840677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f4892828-be58-45df-b37e-6c46f192ed24 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040985 May 10 21:15:52.841946 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 543/1117] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:52 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:53.167975 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d8c0e830-e58f-46c4-9b6d-e13774ca0454 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:53.168586 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d8c0e830-e58f-46c4-9b6d-e13774ca0454 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:53.175537 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d8c0e830-e58f-46c4-9b6d-e13774ca0454 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:53.175984 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d8c0e830-e58f-46c4-9b6d-e13774ca0454 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:53.176793 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d8c0e830-e58f-46c4-9b6d-e13774ca0454 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:53.177209 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d8c0e830-e58f-46c4-9b6d-e13774ca0454 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:53.218969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-34617525-3c97-411b-b9b8-831e2e1ec74b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:53.220027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-34617525-3c97-411b-b9b8-831e2e1ec74b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:53.225783 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-34617525-3c97-411b-b9b8-831e2e1ec74b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:53.226233 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-34617525-3c97-411b-b9b8-831e2e1ec74b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:53.227010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-34617525-3c97-411b-b9b8-831e2e1ec74b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:53.227469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-34617525-3c97-411b-b9b8-831e2e1ec74b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:53.256676 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-34617525-3c97-411b-b9b8-831e2e1ec74b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042781 May 10 21:15:53.257236 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 544/1118] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:53 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:15:53.306840 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-d8c0e830-e58f-46c4-9b6d-e13774ca0454 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:53.314403 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d8c0e830-e58f-46c4-9b6d-e13774ca0454 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.150459 May 10 21:15:53.314969 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 575/1119] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:53 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:53.540894 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-36ab7237-90fe-40c9-92dc-526d49796b33 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:53.541728 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-36ab7237-90fe-40c9-92dc-526d49796b33 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:53.548268 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-36ab7237-90fe-40c9-92dc-526d49796b33 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:53.548716 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-36ab7237-90fe-40c9-92dc-526d49796b33 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:53.549475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-36ab7237-90fe-40c9-92dc-526d49796b33 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:53.549907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-36ab7237-90fe-40c9-92dc-526d49796b33 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:53.580050 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-36ab7237-90fe-40c9-92dc-526d49796b33 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043305 May 10 21:15:53.580595 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 545/1120] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:53 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:53.853169 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-259cb4ec-ce35-4926-a9b0-9a8ad975406c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:53.854101 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-259cb4ec-ce35-4926-a9b0-9a8ad975406c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:53.860236 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-259cb4ec-ce35-4926-a9b0-9a8ad975406c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:53.860687 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-259cb4ec-ce35-4926-a9b0-9a8ad975406c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:53.861452 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-259cb4ec-ce35-4926-a9b0-9a8ad975406c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:53.861893 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-259cb4ec-ce35-4926-a9b0-9a8ad975406c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:53.891592 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-259cb4ec-ce35-4926-a9b0-9a8ad975406c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042358 May 10 21:15:53.892156 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 576/1121] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:53 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:54.268216 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-71586994-6bf2-47f0-8fe6-6dc868e4caef tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:54.269167 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-71586994-6bf2-47f0-8fe6-6dc868e4caef tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:54.275505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71586994-6bf2-47f0-8fe6-6dc868e4caef tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:54.275950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71586994-6bf2-47f0-8fe6-6dc868e4caef tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:54.276712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71586994-6bf2-47f0-8fe6-6dc868e4caef tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:54.277148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71586994-6bf2-47f0-8fe6-6dc868e4caef tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:54.306557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-71586994-6bf2-47f0-8fe6-6dc868e4caef tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042304 May 10 21:15:54.307098 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 546/1122] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:54 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:54.331551 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d2757df8-4a1b-40b6-9fe9-bd37ad8fe540 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:54.332164 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d2757df8-4a1b-40b6-9fe9-bd37ad8fe540 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:54.338310 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d2757df8-4a1b-40b6-9fe9-bd37ad8fe540 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:54.338753 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d2757df8-4a1b-40b6-9fe9-bd37ad8fe540 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:54.339551 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d2757df8-4a1b-40b6-9fe9-bd37ad8fe540 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:54.339983 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d2757df8-4a1b-40b6-9fe9-bd37ad8fe540 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:54.467703 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-d2757df8-4a1b-40b6-9fe9-bd37ad8fe540 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:54.474986 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d2757df8-4a1b-40b6-9fe9-bd37ad8fe540 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.147241 May 10 21:15:54.475575 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 577/1123] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:54 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:54.592260 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6a2920f2-642c-4c99-b1aa-96df72ab2021 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:54.593181 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6a2920f2-642c-4c99-b1aa-96df72ab2021 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:54.599538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a2920f2-642c-4c99-b1aa-96df72ab2021 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:54.599988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a2920f2-642c-4c99-b1aa-96df72ab2021 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:54.600796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a2920f2-642c-4c99-b1aa-96df72ab2021 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:54.601287 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a2920f2-642c-4c99-b1aa-96df72ab2021 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:54.630718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6a2920f2-642c-4c99-b1aa-96df72ab2021 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043012 May 10 21:15:54.631295 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 547/1124] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:54 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:54.903106 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-97b6a702-4a7d-44d0-a495-19607c4929ed tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:54.904045 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-97b6a702-4a7d-44d0-a495-19607c4929ed tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:54.909853 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-97b6a702-4a7d-44d0-a495-19607c4929ed tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:54.910294 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-97b6a702-4a7d-44d0-a495-19607c4929ed tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:54.911048 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-97b6a702-4a7d-44d0-a495-19607c4929ed tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:54.911511 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-97b6a702-4a7d-44d0-a495-19607c4929ed tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:54.942125 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-97b6a702-4a7d-44d0-a495-19607c4929ed tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043013 May 10 21:15:54.943058 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 578/1125] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:54 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:55.318570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-82f9cc87-ac22-4d35-968e-bec5cd9b76a3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:55.319427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-82f9cc87-ac22-4d35-968e-bec5cd9b76a3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:55.326383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-82f9cc87-ac22-4d35-968e-bec5cd9b76a3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:55.326829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-82f9cc87-ac22-4d35-968e-bec5cd9b76a3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:55.327617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-82f9cc87-ac22-4d35-968e-bec5cd9b76a3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:55.328049 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-82f9cc87-ac22-4d35-968e-bec5cd9b76a3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:55.356461 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-82f9cc87-ac22-4d35-968e-bec5cd9b76a3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042018 May 10 21:15:55.357225 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 548/1126] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:55 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:55.493265 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-5677b111-abeb-4fe3-9242-f1f26f85ee4b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:55.493933 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5677b111-abeb-4fe3-9242-f1f26f85ee4b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:55.500400 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5677b111-abeb-4fe3-9242-f1f26f85ee4b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:55.500850 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5677b111-abeb-4fe3-9242-f1f26f85ee4b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:55.501611 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5677b111-abeb-4fe3-9242-f1f26f85ee4b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:55.502047 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5677b111-abeb-4fe3-9242-f1f26f85ee4b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:55.640815 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-5677b111-abeb-4fe3-9242-f1f26f85ee4b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:55.642412 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5b6ddd74-85f6-48f9-9491-a3de3d420696 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:55.643552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5b6ddd74-85f6-48f9-9491-a3de3d420696 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:55.648300 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-5677b111-abeb-4fe3-9242-f1f26f85ee4b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.158861 May 10 21:15:55.648867 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 579/1127] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:55 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:55.649305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b6ddd74-85f6-48f9-9491-a3de3d420696 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:55.649761 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b6ddd74-85f6-48f9-9491-a3de3d420696 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:55.650538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b6ddd74-85f6-48f9-9491-a3de3d420696 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:55.650982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b6ddd74-85f6-48f9-9491-a3de3d420696 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:55.680297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5b6ddd74-85f6-48f9-9491-a3de3d420696 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042230 May 10 21:15:55.680838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 549/1128] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:55 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:15:55.953581 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-0d1d474c-8110-410e-b8cf-613a8a56eb47 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:55.954515 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-0d1d474c-8110-410e-b8cf-613a8a56eb47 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:55.960478 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0d1d474c-8110-410e-b8cf-613a8a56eb47 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:55.960933 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0d1d474c-8110-410e-b8cf-613a8a56eb47 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:55.961697 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0d1d474c-8110-410e-b8cf-613a8a56eb47 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:55.962139 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0d1d474c-8110-410e-b8cf-613a8a56eb47 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:55.991211 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-0d1d474c-8110-410e-b8cf-613a8a56eb47 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041753 May 10 21:15:55.991778 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 580/1129] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:55 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:56.368121 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4bdca00f-a25d-44c7-9846-0e6a6dee5f51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:56.369074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4bdca00f-a25d-44c7-9846-0e6a6dee5f51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:56.375927 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4bdca00f-a25d-44c7-9846-0e6a6dee5f51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:56.376378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4bdca00f-a25d-44c7-9846-0e6a6dee5f51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:56.377143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4bdca00f-a25d-44c7-9846-0e6a6dee5f51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:56.377581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4bdca00f-a25d-44c7-9846-0e6a6dee5f51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:56.406348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4bdca00f-a25d-44c7-9846-0e6a6dee5f51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042200 May 10 21:15:56.406895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 550/1130] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:56 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:56.665739 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-0b84910c-fc2b-405c-803f-60ed8ca8faba tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:56.666358 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-0b84910c-fc2b-405c-803f-60ed8ca8faba tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:56.673741 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0b84910c-fc2b-405c-803f-60ed8ca8faba tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:56.674191 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0b84910c-fc2b-405c-803f-60ed8ca8faba tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:56.674956 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0b84910c-fc2b-405c-803f-60ed8ca8faba tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:56.675425 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0b84910c-fc2b-405c-803f-60ed8ca8faba tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:56.691893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d7b22741-35f6-484d-b82c-9c18bab91db2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:56.693061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d7b22741-35f6-484d-b82c-9c18bab91db2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:56.698715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d7b22741-35f6-484d-b82c-9c18bab91db2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:56.699191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d7b22741-35f6-484d-b82c-9c18bab91db2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:56.699951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d7b22741-35f6-484d-b82c-9c18bab91db2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:56.700519 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d7b22741-35f6-484d-b82c-9c18bab91db2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:56.729489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d7b22741-35f6-484d-b82c-9c18bab91db2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041432 May 10 21:15:56.730028 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 551/1131] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:56 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:56.807996 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-0b84910c-fc2b-405c-803f-60ed8ca8faba tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:56.815412 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-0b84910c-fc2b-405c-803f-60ed8ca8faba tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.153470 May 10 21:15:56.815980 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 581/1132] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:56 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:57.003348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-306eea10-53c8-4e95-a5ff-748e7c5a597c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:57.004198 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-306eea10-53c8-4e95-a5ff-748e7c5a597c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:57.010093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-306eea10-53c8-4e95-a5ff-748e7c5a597c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:57.010540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-306eea10-53c8-4e95-a5ff-748e7c5a597c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:57.011326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-306eea10-53c8-4e95-a5ff-748e7c5a597c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:57.011766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-306eea10-53c8-4e95-a5ff-748e7c5a597c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:57.039428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-306eea10-53c8-4e95-a5ff-748e7c5a597c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040101 May 10 21:15:57.039965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 552/1133] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:56 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:57.417945 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-00fa9a94-ecb2-41b1-9f39-4f5f59c1346a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:57.419849 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-00fa9a94-ecb2-41b1-9f39-4f5f59c1346a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:57.425459 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-00fa9a94-ecb2-41b1-9f39-4f5f59c1346a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:57.426235 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-00fa9a94-ecb2-41b1-9f39-4f5f59c1346a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:57.426659 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-00fa9a94-ecb2-41b1-9f39-4f5f59c1346a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:57.427099 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-00fa9a94-ecb2-41b1-9f39-4f5f59c1346a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:57.455358 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-00fa9a94-ecb2-41b1-9f39-4f5f59c1346a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041322 May 10 21:15:57.455909 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 582/1134] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:57 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:57.742117 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c935c535-b856-4f13-a034-9af72704f914 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:57.743030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c935c535-b856-4f13-a034-9af72704f914 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:57.749487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c935c535-b856-4f13-a034-9af72704f914 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:57.749930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c935c535-b856-4f13-a034-9af72704f914 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:57.750686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c935c535-b856-4f13-a034-9af72704f914 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:57.751146 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c935c535-b856-4f13-a034-9af72704f914 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:57.780163 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c935c535-b856-4f13-a034-9af72704f914 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042079 May 10 21:15:57.780712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 553/1135] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:57 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:57.833240 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d941cc51-e0a2-44da-9e55-a825a38839ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:57.833859 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d941cc51-e0a2-44da-9e55-a825a38839ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:57.840165 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d941cc51-e0a2-44da-9e55-a825a38839ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:57.840745 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d941cc51-e0a2-44da-9e55-a825a38839ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:57.842165 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d941cc51-e0a2-44da-9e55-a825a38839ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:57.842609 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d941cc51-e0a2-44da-9e55-a825a38839ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:57.970815 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-d941cc51-e0a2-44da-9e55-a825a38839ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:57.978194 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d941cc51-e0a2-44da-9e55-a825a38839ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.148862 May 10 21:15:57.978759 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 583/1136] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:57 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:58.049880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f178144d-dcd4-494d-a8b4-18bc0650e2f2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:58.050804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f178144d-dcd4-494d-a8b4-18bc0650e2f2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:58.056674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f178144d-dcd4-494d-a8b4-18bc0650e2f2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:58.057124 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f178144d-dcd4-494d-a8b4-18bc0650e2f2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:58.057888 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f178144d-dcd4-494d-a8b4-18bc0650e2f2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:58.058326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f178144d-dcd4-494d-a8b4-18bc0650e2f2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:58.088170 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f178144d-dcd4-494d-a8b4-18bc0650e2f2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042187 May 10 21:15:58.088712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 554/1137] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:58 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:58.467417 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9e1cbf1e-d9ac-4b81-a407-843526a1895d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:58.468347 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-9e1cbf1e-d9ac-4b81-a407-843526a1895d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:58.474430 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9e1cbf1e-d9ac-4b81-a407-843526a1895d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:58.474879 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9e1cbf1e-d9ac-4b81-a407-843526a1895d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:58.475678 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9e1cbf1e-d9ac-4b81-a407-843526a1895d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:58.476116 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9e1cbf1e-d9ac-4b81-a407-843526a1895d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:58.503942 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9e1cbf1e-d9ac-4b81-a407-843526a1895d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041147 May 10 21:15:58.504486 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 584/1138] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:58 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:58.791407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-72e768f9-39a4-40fd-8398-6c24b48b647c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:58.792328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-72e768f9-39a4-40fd-8398-6c24b48b647c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:58.799339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-72e768f9-39a4-40fd-8398-6c24b48b647c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:58.799784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-72e768f9-39a4-40fd-8398-6c24b48b647c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:58.800549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-72e768f9-39a4-40fd-8398-6c24b48b647c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:58.800979 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-72e768f9-39a4-40fd-8398-6c24b48b647c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:58.830366 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-72e768f9-39a4-40fd-8398-6c24b48b647c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042924 May 10 21:15:58.831000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 555/1139] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:58 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:15:58.995892 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-051eba94-a21b-48d6-9a9a-3e996fc04ac3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:58.996420 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-051eba94-a21b-48d6-9a9a-3e996fc04ac3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:59.003007 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-051eba94-a21b-48d6-9a9a-3e996fc04ac3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:59.003487 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-051eba94-a21b-48d6-9a9a-3e996fc04ac3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:59.004243 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-051eba94-a21b-48d6-9a9a-3e996fc04ac3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:59.004678 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-051eba94-a21b-48d6-9a9a-3e996fc04ac3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:59.100188 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-38004c1f-2d5f-4b90-b7b4-503ab3252529 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:59.101201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-38004c1f-2d5f-4b90-b7b4-503ab3252529 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:59.107261 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38004c1f-2d5f-4b90-b7b4-503ab3252529 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:59.107781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38004c1f-2d5f-4b90-b7b4-503ab3252529 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:59.108625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38004c1f-2d5f-4b90-b7b4-503ab3252529 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:59.109120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38004c1f-2d5f-4b90-b7b4-503ab3252529 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:59.138171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-38004c1f-2d5f-4b90-b7b4-503ab3252529 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041316 May 10 21:15:59.139079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 556/1140] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:59 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:15:59.139643 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-051eba94-a21b-48d6-9a9a-3e996fc04ac3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:15:59.146976 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-051eba94-a21b-48d6-9a9a-3e996fc04ac3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.155002 May 10 21:15:59.147563 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 585/1141] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:15:58 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:15:59.525286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bfc23bb3-5e15-4805-b781-e05a87e1a5b7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:59.526223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bfc23bb3-5e15-4805-b781-e05a87e1a5b7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:59.532222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfc23bb3-5e15-4805-b781-e05a87e1a5b7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:59.539960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfc23bb3-5e15-4805-b781-e05a87e1a5b7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:59.539960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfc23bb3-5e15-4805-b781-e05a87e1a5b7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:59.539960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfc23bb3-5e15-4805-b781-e05a87e1a5b7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:59.562540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bfc23bb3-5e15-4805-b781-e05a87e1a5b7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041430 May 10 21:15:59.563075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 557/1142] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:15:59 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:15:59.842812 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6e0ec600-b3b8-4ded-9ee6-8e609c573147 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:15:59.843867 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6e0ec600-b3b8-4ded-9ee6-8e609c573147 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:15:59.849844 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6e0ec600-b3b8-4ded-9ee6-8e609c573147 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:59.850397 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6e0ec600-b3b8-4ded-9ee6-8e609c573147 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:59.851186 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6e0ec600-b3b8-4ded-9ee6-8e609c573147 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:15:59.851629 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6e0ec600-b3b8-4ded-9ee6-8e609c573147 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:15:59.882923 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6e0ec600-b3b8-4ded-9ee6-8e609c573147 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044436 May 10 21:15:59.886906 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 586/1143] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:15:59 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:00.150364 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fc6ec9e4-0862-4143-9b48-513e458ade58 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:00.151312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fc6ec9e4-0862-4143-9b48-513e458ade58 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:00.158294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fc6ec9e4-0862-4143-9b48-513e458ade58 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:00.158754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fc6ec9e4-0862-4143-9b48-513e458ade58 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:00.159723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fc6ec9e4-0862-4143-9b48-513e458ade58 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:00.160204 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fc6ec9e4-0862-4143-9b48-513e458ade58 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:00.165857 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-5d669a6b-cfd5-4146-b63f-a7e14bb21d31 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:00.166489 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5d669a6b-cfd5-4146-b63f-a7e14bb21d31 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:00.173841 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5d669a6b-cfd5-4146-b63f-a7e14bb21d31 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:00.174300 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5d669a6b-cfd5-4146-b63f-a7e14bb21d31 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:00.175081 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5d669a6b-cfd5-4146-b63f-a7e14bb21d31 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:00.175564 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5d669a6b-cfd5-4146-b63f-a7e14bb21d31 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:00.192029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fc6ec9e4-0862-4143-9b48-513e458ade58 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045709 May 10 21:16:00.193087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 558/1144] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:00 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:00.463686 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-5d669a6b-cfd5-4146-b63f-a7e14bb21d31 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:00.471496 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-5d669a6b-cfd5-4146-b63f-a7e14bb21d31 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.310894 May 10 21:16:00.472051 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 587/1145] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:00 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:16:00.574368 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-946f22ab-8dd3-4419-a501-1f54754c1514 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:00.576283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-946f22ab-8dd3-4419-a501-1f54754c1514 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:00.582421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-946f22ab-8dd3-4419-a501-1f54754c1514 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:00.582886 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-946f22ab-8dd3-4419-a501-1f54754c1514 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:00.583666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-946f22ab-8dd3-4419-a501-1f54754c1514 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:00.584099 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-946f22ab-8dd3-4419-a501-1f54754c1514 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:00.613138 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-946f22ab-8dd3-4419-a501-1f54754c1514 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042830 May 10 21:16:00.613685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 559/1146] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:00 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:00.895150 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9070e8d2-2565-4ad3-9a5f-f7e3ee83ebf0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:00.901688 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-9070e8d2-2565-4ad3-9a5f-f7e3ee83ebf0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:00.902092 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9070e8d2-2565-4ad3-9a5f-f7e3ee83ebf0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:00.902545 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9070e8d2-2565-4ad3-9a5f-f7e3ee83ebf0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:00.903924 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9070e8d2-2565-4ad3-9a5f-f7e3ee83ebf0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:00.904370 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9070e8d2-2565-4ad3-9a5f-f7e3ee83ebf0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:00.933269 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9070e8d2-2565-4ad3-9a5f-f7e3ee83ebf0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042060 May 10 21:16:00.933800 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 588/1147] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:00 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:01.204728 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f8058934-c997-4e92-8a0c-09c40a700901 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:01.205564 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f8058934-c997-4e92-8a0c-09c40a700901 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:01.211838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f8058934-c997-4e92-8a0c-09c40a700901 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:01.212283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f8058934-c997-4e92-8a0c-09c40a700901 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:01.213040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f8058934-c997-4e92-8a0c-09c40a700901 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:01.213472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f8058934-c997-4e92-8a0c-09c40a700901 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:01.241775 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f8058934-c997-4e92-8a0c-09c40a700901 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041801 May 10 21:16:01.242992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 560/1148] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:01 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:01.490066 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-5ead92ac-3113-426a-b867-2cbeded7c41c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:01.490631 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5ead92ac-3113-426a-b867-2cbeded7c41c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:01.497545 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5ead92ac-3113-426a-b867-2cbeded7c41c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:01.498012 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5ead92ac-3113-426a-b867-2cbeded7c41c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:01.498780 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5ead92ac-3113-426a-b867-2cbeded7c41c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:01.499250 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5ead92ac-3113-426a-b867-2cbeded7c41c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:01.624781 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-5ead92ac-3113-426a-b867-2cbeded7c41c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:01.624938 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5b4900c6-74e0-4a5a-a8a7-4cee0c4f11fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:01.625827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5b4900c6-74e0-4a5a-a8a7-4cee0c4f11fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:01.631678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b4900c6-74e0-4a5a-a8a7-4cee0c4f11fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:01.632133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b4900c6-74e0-4a5a-a8a7-4cee0c4f11fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:01.632261 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-5ead92ac-3113-426a-b867-2cbeded7c41c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.146074 May 10 21:16:01.632751 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 589/1149] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:01 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:01.632902 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b4900c6-74e0-4a5a-a8a7-4cee0c4f11fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:01.633339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b4900c6-74e0-4a5a-a8a7-4cee0c4f11fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:01.662125 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5b4900c6-74e0-4a5a-a8a7-4cee0c4f11fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041363 May 10 21:16:01.662703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 561/1150] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:01 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:16:01.945260 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f6c0b02a-8d8c-436a-b723-112b42c05763 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:01.946184 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f6c0b02a-8d8c-436a-b723-112b42c05763 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:01.952762 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f6c0b02a-8d8c-436a-b723-112b42c05763 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:01.953203 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f6c0b02a-8d8c-436a-b723-112b42c05763 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:01.953964 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f6c0b02a-8d8c-436a-b723-112b42c05763 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:01.954398 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f6c0b02a-8d8c-436a-b723-112b42c05763 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:01.983054 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f6c0b02a-8d8c-436a-b723-112b42c05763 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042134 May 10 21:16:01.983613 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 590/1151] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:01 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:02.254075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2aee0eea-fcd2-4edf-82bc-9e333c67a846 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:02.254951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2aee0eea-fcd2-4edf-82bc-9e333c67a846 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:02.261266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2aee0eea-fcd2-4edf-82bc-9e333c67a846 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:02.261708 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2aee0eea-fcd2-4edf-82bc-9e333c67a846 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:02.262953 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2aee0eea-fcd2-4edf-82bc-9e333c67a846 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:02.263560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2aee0eea-fcd2-4edf-82bc-9e333c67a846 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:02.292528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2aee0eea-fcd2-4edf-82bc-9e333c67a846 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042389 May 10 21:16:02.293073 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 562/1152] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:02 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:02.649402 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-80f0e9f0-cc68-42b9-b1ce-d67c0c7dddcc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:02.650044 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-80f0e9f0-cc68-42b9-b1ce-d67c0c7dddcc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:02.656360 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-80f0e9f0-cc68-42b9-b1ce-d67c0c7dddcc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:02.656806 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-80f0e9f0-cc68-42b9-b1ce-d67c0c7dddcc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:02.657563 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-80f0e9f0-cc68-42b9-b1ce-d67c0c7dddcc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:02.657996 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-80f0e9f0-cc68-42b9-b1ce-d67c0c7dddcc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:02.673691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-07dc307c-df4d-4424-97c5-2474f71ddc62 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:02.674610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-07dc307c-df4d-4424-97c5-2474f71ddc62 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:02.680368 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07dc307c-df4d-4424-97c5-2474f71ddc62 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:02.680822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07dc307c-df4d-4424-97c5-2474f71ddc62 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:02.681588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07dc307c-df4d-4424-97c5-2474f71ddc62 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:02.682027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07dc307c-df4d-4424-97c5-2474f71ddc62 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:02.712868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-07dc307c-df4d-4424-97c5-2474f71ddc62 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043105 May 10 21:16:02.713432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 563/1153] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:02 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:02.792409 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-80f0e9f0-cc68-42b9-b1ce-d67c0c7dddcc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:02.799955 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-80f0e9f0-cc68-42b9-b1ce-d67c0c7dddcc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.154389 May 10 21:16:02.800512 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 591/1154] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:02 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:02.994024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7c0782ad-f3c1-46b5-accc-f5b5fe646611 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:02.994862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7c0782ad-f3c1-46b5-accc-f5b5fe646611 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:03.001050 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c0782ad-f3c1-46b5-accc-f5b5fe646611 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:03.001502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c0782ad-f3c1-46b5-accc-f5b5fe646611 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:03.002256 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c0782ad-f3c1-46b5-accc-f5b5fe646611 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:03.002695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c0782ad-f3c1-46b5-accc-f5b5fe646611 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:03.031393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7c0782ad-f3c1-46b5-accc-f5b5fe646611 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041401 May 10 21:16:03.031943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 564/1155] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:02 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:03.303824 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c5bd7984-1a38-4ce6-a7c3-0b59c22c5ae4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:03.304701 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c5bd7984-1a38-4ce6-a7c3-0b59c22c5ae4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:03.311057 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c5bd7984-1a38-4ce6-a7c3-0b59c22c5ae4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:03.311549 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c5bd7984-1a38-4ce6-a7c3-0b59c22c5ae4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:03.312325 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c5bd7984-1a38-4ce6-a7c3-0b59c22c5ae4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:03.312771 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c5bd7984-1a38-4ce6-a7c3-0b59c22c5ae4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:03.342524 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c5bd7984-1a38-4ce6-a7c3-0b59c22c5ae4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042724 May 10 21:16:03.343070 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 592/1156] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:03 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:03.723786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3ce1c8af-7756-43eb-9013-105eb7f7d632 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:03.724724 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3ce1c8af-7756-43eb-9013-105eb7f7d632 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:03.731285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ce1c8af-7756-43eb-9013-105eb7f7d632 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:03.731925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ce1c8af-7756-43eb-9013-105eb7f7d632 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:03.732560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ce1c8af-7756-43eb-9013-105eb7f7d632 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:03.732992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ce1c8af-7756-43eb-9013-105eb7f7d632 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:03.761551 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3ce1c8af-7756-43eb-9013-105eb7f7d632 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041754 May 10 21:16:03.762094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 565/1157] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:03 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:03.816561 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d4910b92-a769-4a5e-a1de-d40ed374345a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:03.817174 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d4910b92-a769-4a5e-a1de-d40ed374345a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:03.823697 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d4910b92-a769-4a5e-a1de-d40ed374345a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:03.824186 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d4910b92-a769-4a5e-a1de-d40ed374345a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:03.825476 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d4910b92-a769-4a5e-a1de-d40ed374345a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:03.826103 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d4910b92-a769-4a5e-a1de-d40ed374345a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:03.955575 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-d4910b92-a769-4a5e-a1de-d40ed374345a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:03.962981 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d4910b92-a769-4a5e-a1de-d40ed374345a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.150206 May 10 21:16:03.963564 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 593/1158] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:03 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:04.042839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-20478430-e22d-4b94-8390-3f6703c06fb2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:04.044343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-20478430-e22d-4b94-8390-3f6703c06fb2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:04.050271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20478430-e22d-4b94-8390-3f6703c06fb2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:04.050721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20478430-e22d-4b94-8390-3f6703c06fb2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:04.051509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20478430-e22d-4b94-8390-3f6703c06fb2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:04.051940 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20478430-e22d-4b94-8390-3f6703c06fb2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:04.080765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-20478430-e22d-4b94-8390-3f6703c06fb2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041776 May 10 21:16:04.081325 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 566/1159] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:04 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:04.354055 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-18f21dd5-83ba-4103-805c-f522cf5de7ae tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:04.354988 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-18f21dd5-83ba-4103-805c-f522cf5de7ae tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:04.361039 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-18f21dd5-83ba-4103-805c-f522cf5de7ae tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:04.361481 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-18f21dd5-83ba-4103-805c-f522cf5de7ae tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:04.362236 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-18f21dd5-83ba-4103-805c-f522cf5de7ae tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:04.362696 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-18f21dd5-83ba-4103-805c-f522cf5de7ae tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:04.392452 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-18f21dd5-83ba-4103-805c-f522cf5de7ae tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042398 May 10 21:16:04.392994 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 594/1160] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:04 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:04.773762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a77ff269-3f4c-47d1-bc5a-50c3022c5c72 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:04.774679 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a77ff269-3f4c-47d1-bc5a-50c3022c5c72 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:04.781223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a77ff269-3f4c-47d1-bc5a-50c3022c5c72 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:04.781667 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a77ff269-3f4c-47d1-bc5a-50c3022c5c72 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:04.782421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a77ff269-3f4c-47d1-bc5a-50c3022c5c72 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:04.782853 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a77ff269-3f4c-47d1-bc5a-50c3022c5c72 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:04.811444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a77ff269-3f4c-47d1-bc5a-50c3022c5c72 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041692 May 10 21:16:04.811982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 567/1161] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:04 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:04.980222 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-0c786554-54c1-4941-baf4-1e3e2ba961ac tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:04.980868 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-0c786554-54c1-4941-baf4-1e3e2ba961ac tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:04.987713 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0c786554-54c1-4941-baf4-1e3e2ba961ac tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:04.988156 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0c786554-54c1-4941-baf4-1e3e2ba961ac tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:04.988914 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0c786554-54c1-4941-baf4-1e3e2ba961ac tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:04.989349 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0c786554-54c1-4941-baf4-1e3e2ba961ac tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:05.095420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0a1ca2b9-c6aa-4b69-9577-5a03d9629d69 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:05.096385 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0a1ca2b9-c6aa-4b69-9577-5a03d9629d69 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:05.102289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0a1ca2b9-c6aa-4b69-9577-5a03d9629d69 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:05.102756 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0a1ca2b9-c6aa-4b69-9577-5a03d9629d69 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:05.103547 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0a1ca2b9-c6aa-4b69-9577-5a03d9629d69 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:05.103991 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0a1ca2b9-c6aa-4b69-9577-5a03d9629d69 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:05.124199 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.policy [None req-0c786554-54c1-4941-baf4-1e3e2ba961ac tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117713) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:05.131930 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-0c786554-54c1-4941-baf4-1e3e2ba961ac tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.155620 May 10 21:16:05.132495 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 595/1162] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:04 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:05.133847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0a1ca2b9-c6aa-4b69-9577-5a03d9629d69 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042543 May 10 21:16:05.134404 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 568/1163] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:05 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:16:05.404945 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f1d8306d-2b70-4b25-a8c8-7bf2bbfebcac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:05.405865 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f1d8306d-2b70-4b25-a8c8-7bf2bbfebcac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:05.411804 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f1d8306d-2b70-4b25-a8c8-7bf2bbfebcac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:05.412251 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f1d8306d-2b70-4b25-a8c8-7bf2bbfebcac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:05.413034 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f1d8306d-2b70-4b25-a8c8-7bf2bbfebcac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:05.413468 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f1d8306d-2b70-4b25-a8c8-7bf2bbfebcac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:05.441760 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f1d8306d-2b70-4b25-a8c8-7bf2bbfebcac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041282 May 10 21:16:05.442296 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 596/1164] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:05 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:05.823326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-332f728d-b78f-4071-9056-f977701efb67 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:05.824175 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-332f728d-b78f-4071-9056-f977701efb67 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:05.830658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-332f728d-b78f-4071-9056-f977701efb67 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:05.831108 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-332f728d-b78f-4071-9056-f977701efb67 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:05.831884 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-332f728d-b78f-4071-9056-f977701efb67 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:05.832322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-332f728d-b78f-4071-9056-f977701efb67 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:05.861699 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-332f728d-b78f-4071-9056-f977701efb67 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042419 May 10 21:16:05.862243 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 569/1165] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:05 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:06.145560 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-994d02d8-1bd2-4039-b80a-171f359c6336 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:06.146518 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-994d02d8-1bd2-4039-b80a-171f359c6336 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:06.148507 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c8520459-6608-406b-9eb1-d95cf977eab4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:06.149130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c8520459-6608-406b-9eb1-d95cf977eab4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:06.153573 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-994d02d8-1bd2-4039-b80a-171f359c6336 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:06.154034 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-994d02d8-1bd2-4039-b80a-171f359c6336 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:06.154810 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-994d02d8-1bd2-4039-b80a-171f359c6336 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:06.155279 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-994d02d8-1bd2-4039-b80a-171f359c6336 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:06.155979 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c8520459-6608-406b-9eb1-d95cf977eab4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:06.156433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c8520459-6608-406b-9eb1-d95cf977eab4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:06.157202 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c8520459-6608-406b-9eb1-d95cf977eab4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:06.157853 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c8520459-6608-406b-9eb1-d95cf977eab4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:06.184766 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-994d02d8-1bd2-4039-b80a-171f359c6336 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043090 May 10 21:16:06.185445 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 597/1166] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:06 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:06.294513 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c8520459-6608-406b-9eb1-d95cf977eab4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:06.301925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c8520459-6608-406b-9eb1-d95cf977eab4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.157213 May 10 21:16:06.302487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 570/1167] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:06 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:16:06.453782 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-b100a9e1-12c5-4430-afff-69222f19c2d3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:06.454663 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-b100a9e1-12c5-4430-afff-69222f19c2d3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:06.460550 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b100a9e1-12c5-4430-afff-69222f19c2d3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:06.460993 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b100a9e1-12c5-4430-afff-69222f19c2d3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:06.461746 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b100a9e1-12c5-4430-afff-69222f19c2d3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:06.462179 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b100a9e1-12c5-4430-afff-69222f19c2d3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:06.491455 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-b100a9e1-12c5-4430-afff-69222f19c2d3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041916 May 10 21:16:06.491983 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 598/1168] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:06 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:06.873721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-17a33a1e-d61c-4616-bd76-3eb230a8cc6c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:06.874638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-17a33a1e-d61c-4616-bd76-3eb230a8cc6c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:06.880925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17a33a1e-d61c-4616-bd76-3eb230a8cc6c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:06.881371 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17a33a1e-d61c-4616-bd76-3eb230a8cc6c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:06.882135 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17a33a1e-d61c-4616-bd76-3eb230a8cc6c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:06.882567 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17a33a1e-d61c-4616-bd76-3eb230a8cc6c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:06.912580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-17a33a1e-d61c-4616-bd76-3eb230a8cc6c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043288 May 10 21:16:06.913166 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 571/1169] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:06 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:07.197056 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-45c33a37-9e5c-4c3e-a393-dee2979a9fc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:07.197895 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-45c33a37-9e5c-4c3e-a393-dee2979a9fc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:07.204334 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-45c33a37-9e5c-4c3e-a393-dee2979a9fc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:07.204804 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-45c33a37-9e5c-4c3e-a393-dee2979a9fc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:07.205563 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-45c33a37-9e5c-4c3e-a393-dee2979a9fc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:07.205997 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-45c33a37-9e5c-4c3e-a393-dee2979a9fc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:07.234656 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-45c33a37-9e5c-4c3e-a393-dee2979a9fc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041887 May 10 21:16:07.235207 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 599/1170] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:07 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:07.319349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3fe62681-5a56-47c0-ad2c-152f5fe42c08 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:07.319968 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3fe62681-5a56-47c0-ad2c-152f5fe42c08 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:07.326622 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3fe62681-5a56-47c0-ad2c-152f5fe42c08 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:07.327070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3fe62681-5a56-47c0-ad2c-152f5fe42c08 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:07.327855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3fe62681-5a56-47c0-ad2c-152f5fe42c08 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:07.328295 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3fe62681-5a56-47c0-ad2c-152f5fe42c08 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:07.454731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3fe62681-5a56-47c0-ad2c-152f5fe42c08 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:07.462094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3fe62681-5a56-47c0-ad2c-152f5fe42c08 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.146894 May 10 21:16:07.462659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 572/1171] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:07 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:07.502649 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-31dfbc6d-77ff-4a57-8b61-6f6bdf972b33 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:07.503626 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-31dfbc6d-77ff-4a57-8b61-6f6bdf972b33 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:07.509529 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-31dfbc6d-77ff-4a57-8b61-6f6bdf972b33 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:07.509971 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-31dfbc6d-77ff-4a57-8b61-6f6bdf972b33 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:07.510727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-31dfbc6d-77ff-4a57-8b61-6f6bdf972b33 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:07.511180 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-31dfbc6d-77ff-4a57-8b61-6f6bdf972b33 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:07.539964 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-31dfbc6d-77ff-4a57-8b61-6f6bdf972b33 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041199 May 10 21:16:07.540495 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 600/1172] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:07 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:07.924950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b0458116-72c9-4c04-bf8c-2ba9370cef0c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:07.925883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b0458116-72c9-4c04-bf8c-2ba9370cef0c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:07.932687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b0458116-72c9-4c04-bf8c-2ba9370cef0c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:07.933131 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b0458116-72c9-4c04-bf8c-2ba9370cef0c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:07.933909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b0458116-72c9-4c04-bf8c-2ba9370cef0c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:07.934835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b0458116-72c9-4c04-bf8c-2ba9370cef0c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:07.967218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b0458116-72c9-4c04-bf8c-2ba9370cef0c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046142 May 10 21:16:07.967798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 573/1173] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:07 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:08.245964 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-5ca0d81b-519f-42f9-87c5-d8975d5eb255 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:08.247447 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5ca0d81b-519f-42f9-87c5-d8975d5eb255 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:08.253862 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5ca0d81b-519f-42f9-87c5-d8975d5eb255 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:08.254309 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5ca0d81b-519f-42f9-87c5-d8975d5eb255 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:08.255069 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5ca0d81b-519f-42f9-87c5-d8975d5eb255 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:08.255523 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5ca0d81b-519f-42f9-87c5-d8975d5eb255 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:08.283794 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-5ca0d81b-519f-42f9-87c5-d8975d5eb255 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041845 May 10 21:16:08.284345 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 601/1174] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:08 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:08.478946 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-20518462-0dc7-47a7-900d-1529e8dca4b0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:08.479618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-20518462-0dc7-47a7-900d-1529e8dca4b0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:08.486483 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20518462-0dc7-47a7-900d-1529e8dca4b0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:08.486952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20518462-0dc7-47a7-900d-1529e8dca4b0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:08.487753 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20518462-0dc7-47a7-900d-1529e8dca4b0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:08.488218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20518462-0dc7-47a7-900d-1529e8dca4b0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:08.551499 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e7d87923-00a0-4819-9d60-938f96df7b52 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:08.552342 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e7d87923-00a0-4819-9d60-938f96df7b52 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:08.558072 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e7d87923-00a0-4819-9d60-938f96df7b52 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:08.558514 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e7d87923-00a0-4819-9d60-938f96df7b52 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:08.559319 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e7d87923-00a0-4819-9d60-938f96df7b52 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:08.559752 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e7d87923-00a0-4819-9d60-938f96df7b52 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:08.589545 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e7d87923-00a0-4819-9d60-938f96df7b52 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042063 May 10 21:16:08.590234 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 602/1175] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:08 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:16:08.620634 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-20518462-0dc7-47a7-900d-1529e8dca4b0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:08.628186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-20518462-0dc7-47a7-900d-1529e8dca4b0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.153059 May 10 21:16:08.628755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 574/1176] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:08 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:08.978974 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-13743660-e2bd-49e4-bc22-a5a4474762d2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:08.979931 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-13743660-e2bd-49e4-bc22-a5a4474762d2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:08.985989 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-13743660-e2bd-49e4-bc22-a5a4474762d2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:08.986441 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-13743660-e2bd-49e4-bc22-a5a4474762d2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:08.987270 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-13743660-e2bd-49e4-bc22-a5a4474762d2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:08.987710 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-13743660-e2bd-49e4-bc22-a5a4474762d2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:09.016432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-13743660-e2bd-49e4-bc22-a5a4474762d2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041649 May 10 21:16:09.016973 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 603/1177] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:08 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:09.295750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6dd8990e-a2b9-4b9e-80dc-1f379e8c2e47 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:09.296587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6dd8990e-a2b9-4b9e-80dc-1f379e8c2e47 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:09.302830 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6dd8990e-a2b9-4b9e-80dc-1f379e8c2e47 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:09.303309 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6dd8990e-a2b9-4b9e-80dc-1f379e8c2e47 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:09.304066 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6dd8990e-a2b9-4b9e-80dc-1f379e8c2e47 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:09.304504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6dd8990e-a2b9-4b9e-80dc-1f379e8c2e47 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:09.334166 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6dd8990e-a2b9-4b9e-80dc-1f379e8c2e47 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042692 May 10 21:16:09.334710 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 575/1178] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:09 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:09.607684 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-dcbea017-19c6-402c-8e5c-e29637818ee6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:09.608623 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-dcbea017-19c6-402c-8e5c-e29637818ee6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:09.615027 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-dcbea017-19c6-402c-8e5c-e29637818ee6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:09.615507 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-dcbea017-19c6-402c-8e5c-e29637818ee6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:09.616282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-dcbea017-19c6-402c-8e5c-e29637818ee6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:09.616766 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-dcbea017-19c6-402c-8e5c-e29637818ee6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:09.645415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5429b99c-dc97-46a7-8345-4329ef924726 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:09.646059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5429b99c-dc97-46a7-8345-4329ef924726 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:09.646172 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-dcbea017-19c6-402c-8e5c-e29637818ee6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043317 May 10 21:16:09.646796 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 604/1179] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:09 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:09.651889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5429b99c-dc97-46a7-8345-4329ef924726 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:09.652350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5429b99c-dc97-46a7-8345-4329ef924726 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:09.653109 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5429b99c-dc97-46a7-8345-4329ef924726 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:09.654050 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5429b99c-dc97-46a7-8345-4329ef924726 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:09.780485 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5429b99c-dc97-46a7-8345-4329ef924726 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:09.787883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5429b99c-dc97-46a7-8345-4329ef924726 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.146309 May 10 21:16:09.788451 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 576/1180] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:09 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:16:10.029083 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-7786c030-169e-41d7-bf10-028fd6299575 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:10.029790 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-7786c030-169e-41d7-bf10-028fd6299575 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:10.035781 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7786c030-169e-41d7-bf10-028fd6299575 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:10.036234 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7786c030-169e-41d7-bf10-028fd6299575 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:10.037004 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7786c030-169e-41d7-bf10-028fd6299575 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:10.037444 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7786c030-169e-41d7-bf10-028fd6299575 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:10.067365 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-7786c030-169e-41d7-bf10-028fd6299575 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042845 May 10 21:16:10.068411 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 605/1181] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:10 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:10.346682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1d616e5f-0fca-4a73-9780-db148e6e0cee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:10.347635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1d616e5f-0fca-4a73-9780-db148e6e0cee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:10.353974 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d616e5f-0fca-4a73-9780-db148e6e0cee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:10.354424 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d616e5f-0fca-4a73-9780-db148e6e0cee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:10.355295 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d616e5f-0fca-4a73-9780-db148e6e0cee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:10.355736 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d616e5f-0fca-4a73-9780-db148e6e0cee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:10.384072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1d616e5f-0fca-4a73-9780-db148e6e0cee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041369 May 10 21:16:10.389346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 577/1182] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:10 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:10.657294 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a5d6ca2e-263b-43ee-81b6-fe2d3b4c0c97 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:10.658219 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a5d6ca2e-263b-43ee-81b6-fe2d3b4c0c97 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:10.664745 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a5d6ca2e-263b-43ee-81b6-fe2d3b4c0c97 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:10.665184 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a5d6ca2e-263b-43ee-81b6-fe2d3b4c0c97 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:10.665940 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a5d6ca2e-263b-43ee-81b6-fe2d3b4c0c97 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:10.666372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a5d6ca2e-263b-43ee-81b6-fe2d3b4c0c97 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:10.695309 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a5d6ca2e-263b-43ee-81b6-fe2d3b4c0c97 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041984 May 10 21:16:10.695840 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 606/1183] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:10 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:10.805535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a6c16528-6122-4abf-97b0-1b8fd2b018a0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:10.806156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a6c16528-6122-4abf-97b0-1b8fd2b018a0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:10.812739 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a6c16528-6122-4abf-97b0-1b8fd2b018a0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:10.813192 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a6c16528-6122-4abf-97b0-1b8fd2b018a0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:10.813963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a6c16528-6122-4abf-97b0-1b8fd2b018a0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:10.814407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a6c16528-6122-4abf-97b0-1b8fd2b018a0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:10.945314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a6c16528-6122-4abf-97b0-1b8fd2b018a0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:10.953477 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a6c16528-6122-4abf-97b0-1b8fd2b018a0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151763 May 10 21:16:10.954041 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 578/1184] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:10 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:11.080703 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-5d9fc219-91fb-467d-a1f4-821ea9d9f541 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:11.081618 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5d9fc219-91fb-467d-a1f4-821ea9d9f541 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:11.087725 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5d9fc219-91fb-467d-a1f4-821ea9d9f541 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:11.088174 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5d9fc219-91fb-467d-a1f4-821ea9d9f541 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:11.088947 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5d9fc219-91fb-467d-a1f4-821ea9d9f541 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:11.089386 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5d9fc219-91fb-467d-a1f4-821ea9d9f541 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:11.119380 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-5d9fc219-91fb-467d-a1f4-821ea9d9f541 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042640 May 10 21:16:11.119930 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 607/1185] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:11 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:11.396766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f2bde091-af8b-43fc-af7f-77a41b0cc148 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:11.397682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f2bde091-af8b-43fc-af7f-77a41b0cc148 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:11.404502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2bde091-af8b-43fc-af7f-77a41b0cc148 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:11.404938 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2bde091-af8b-43fc-af7f-77a41b0cc148 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:11.405693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2bde091-af8b-43fc-af7f-77a41b0cc148 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:11.406121 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2bde091-af8b-43fc-af7f-77a41b0cc148 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:11.435569 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f2bde091-af8b-43fc-af7f-77a41b0cc148 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042696 May 10 21:16:11.436114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 579/1186] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:11 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:11.707032 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-2acd96c6-c98e-417a-a465-fd68319078a2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:11.707911 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-2acd96c6-c98e-417a-a465-fd68319078a2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:11.714235 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2acd96c6-c98e-417a-a465-fd68319078a2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:11.714684 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2acd96c6-c98e-417a-a465-fd68319078a2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:11.716018 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2acd96c6-c98e-417a-a465-fd68319078a2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:11.716592 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2acd96c6-c98e-417a-a465-fd68319078a2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:11.744834 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-2acd96c6-c98e-417a-a465-fd68319078a2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041850 May 10 21:16:11.745379 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 608/1187] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:11 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:11.971807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-874aaf8e-314c-4025-97b0-7dd56631ca83 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:11.972340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-874aaf8e-314c-4025-97b0-7dd56631ca83 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:11.978341 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-874aaf8e-314c-4025-97b0-7dd56631ca83 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:11.978791 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-874aaf8e-314c-4025-97b0-7dd56631ca83 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:11.979636 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-874aaf8e-314c-4025-97b0-7dd56631ca83 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:11.980068 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-874aaf8e-314c-4025-97b0-7dd56631ca83 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:12.110542 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-874aaf8e-314c-4025-97b0-7dd56631ca83 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:12.117947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-874aaf8e-314c-4025-97b0-7dd56631ca83 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.150058 May 10 21:16:12.118502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 580/1188] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:11 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:12.131792 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e4ca5869-7ca3-404e-a563-ee33122f1c08 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:12.132749 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e4ca5869-7ca3-404e-a563-ee33122f1c08 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:12.138711 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e4ca5869-7ca3-404e-a563-ee33122f1c08 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:12.139194 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e4ca5869-7ca3-404e-a563-ee33122f1c08 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:12.139964 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e4ca5869-7ca3-404e-a563-ee33122f1c08 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:12.140402 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e4ca5869-7ca3-404e-a563-ee33122f1c08 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:12.171394 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e4ca5869-7ca3-404e-a563-ee33122f1c08 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043417 May 10 21:16:12.172349 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 609/1189] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:12 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:12.447895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ae0fa692-3ca4-447f-bee7-edcda3fe84a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:12.448820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ae0fa692-3ca4-447f-bee7-edcda3fe84a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:12.455931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae0fa692-3ca4-447f-bee7-edcda3fe84a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:12.456376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae0fa692-3ca4-447f-bee7-edcda3fe84a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:12.457142 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae0fa692-3ca4-447f-bee7-edcda3fe84a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:12.457574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae0fa692-3ca4-447f-bee7-edcda3fe84a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:12.488036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ae0fa692-3ca4-447f-bee7-edcda3fe84a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044797 May 10 21:16:12.488596 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 581/1190] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:12 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:12.759739 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-0c538fcd-6224-4ade-b00f-51dd23e28bfd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:12.761233 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-0c538fcd-6224-4ade-b00f-51dd23e28bfd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:12.769182 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0c538fcd-6224-4ade-b00f-51dd23e28bfd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:12.769632 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0c538fcd-6224-4ade-b00f-51dd23e28bfd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:12.770410 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0c538fcd-6224-4ade-b00f-51dd23e28bfd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:12.771168 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0c538fcd-6224-4ade-b00f-51dd23e28bfd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:12.803504 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-0c538fcd-6224-4ade-b00f-51dd23e28bfd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050175 May 10 21:16:12.804063 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 610/1191] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:12 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:13.135769 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-46fae892-a50a-4ec5-8488-29148399b367 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:13.136383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-46fae892-a50a-4ec5-8488-29148399b367 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:13.142834 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-46fae892-a50a-4ec5-8488-29148399b367 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:13.143328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-46fae892-a50a-4ec5-8488-29148399b367 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:13.144085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-46fae892-a50a-4ec5-8488-29148399b367 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:13.144519 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-46fae892-a50a-4ec5-8488-29148399b367 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:13.185040 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-64f4d15c-2266-46b6-ad78-73ff7a6a7828 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:13.186013 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-64f4d15c-2266-46b6-ad78-73ff7a6a7828 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:13.191991 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-64f4d15c-2266-46b6-ad78-73ff7a6a7828 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:13.192443 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-64f4d15c-2266-46b6-ad78-73ff7a6a7828 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:13.193471 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-64f4d15c-2266-46b6-ad78-73ff7a6a7828 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:13.193910 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-64f4d15c-2266-46b6-ad78-73ff7a6a7828 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:13.232828 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-64f4d15c-2266-46b6-ad78-73ff7a6a7828 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052178 May 10 21:16:13.233397 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 611/1192] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:13 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:16:13.274978 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-46fae892-a50a-4ec5-8488-29148399b367 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:13.283348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-46fae892-a50a-4ec5-8488-29148399b367 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151365 May 10 21:16:13.283910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 582/1193] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:13 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:13.500180 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-882f1764-c013-4336-8be7-3686ba0decdf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:13.501036 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-882f1764-c013-4336-8be7-3686ba0decdf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:13.506820 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-882f1764-c013-4336-8be7-3686ba0decdf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:13.507308 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-882f1764-c013-4336-8be7-3686ba0decdf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:13.508084 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-882f1764-c013-4336-8be7-3686ba0decdf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:13.508526 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-882f1764-c013-4336-8be7-3686ba0decdf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:13.538054 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-882f1764-c013-4336-8be7-3686ba0decdf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041918 May 10 21:16:13.538592 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 612/1194] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:13 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:13.816669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8a1459db-4fa9-4679-b32c-fb92cb3e78c0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:13.817518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8a1459db-4fa9-4679-b32c-fb92cb3e78c0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:13.823687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8a1459db-4fa9-4679-b32c-fb92cb3e78c0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:13.824137 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8a1459db-4fa9-4679-b32c-fb92cb3e78c0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:13.826086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8a1459db-4fa9-4679-b32c-fb92cb3e78c0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:13.826534 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8a1459db-4fa9-4679-b32c-fb92cb3e78c0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:13.855182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8a1459db-4fa9-4679-b32c-fb92cb3e78c0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042668 May 10 21:16:13.855740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 583/1195] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:13 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:14.243904 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-371044c2-6bd1-4289-b6c2-cb7f1337d8e9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:14.244824 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-371044c2-6bd1-4289-b6c2-cb7f1337d8e9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:14.251816 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-371044c2-6bd1-4289-b6c2-cb7f1337d8e9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:14.252266 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-371044c2-6bd1-4289-b6c2-cb7f1337d8e9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:14.253030 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-371044c2-6bd1-4289-b6c2-cb7f1337d8e9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:14.253469 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-371044c2-6bd1-4289-b6c2-cb7f1337d8e9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:14.283100 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-371044c2-6bd1-4289-b6c2-cb7f1337d8e9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043212 May 10 21:16:14.283662 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 613/1196] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:14 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:14.300594 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ec5cfefc-1193-484e-bc95-bbe2d0fa65aa tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:14.301205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ec5cfefc-1193-484e-bc95-bbe2d0fa65aa tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:14.307051 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec5cfefc-1193-484e-bc95-bbe2d0fa65aa tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:14.307527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec5cfefc-1193-484e-bc95-bbe2d0fa65aa tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:14.308290 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec5cfefc-1193-484e-bc95-bbe2d0fa65aa tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:14.308724 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec5cfefc-1193-484e-bc95-bbe2d0fa65aa tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:14.440594 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ec5cfefc-1193-484e-bc95-bbe2d0fa65aa tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:14.451459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ec5cfefc-1193-484e-bc95-bbe2d0fa65aa tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151442 May 10 21:16:14.451459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 584/1197] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:14 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:14.550648 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-471434e8-d163-4398-9745-66ba8d10fa42 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:14.551525 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-471434e8-d163-4398-9745-66ba8d10fa42 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:14.557639 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-471434e8-d163-4398-9745-66ba8d10fa42 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:14.558088 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-471434e8-d163-4398-9745-66ba8d10fa42 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:14.558850 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-471434e8-d163-4398-9745-66ba8d10fa42 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:14.559342 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-471434e8-d163-4398-9745-66ba8d10fa42 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:14.587710 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-471434e8-d163-4398-9745-66ba8d10fa42 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041181 May 10 21:16:14.588251 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 614/1198] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:14 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:14.865967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-46246942-d5a0-4990-b92e-efd3148e9326 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:14.866905 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-46246942-d5a0-4990-b92e-efd3148e9326 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:14.873656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-46246942-d5a0-4990-b92e-efd3148e9326 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:14.874115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-46246942-d5a0-4990-b92e-efd3148e9326 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:14.874915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-46246942-d5a0-4990-b92e-efd3148e9326 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:14.875379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-46246942-d5a0-4990-b92e-efd3148e9326 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:14.912176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-46246942-d5a0-4990-b92e-efd3148e9326 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050117 May 10 21:16:14.912734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 585/1199] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:14 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:15.294716 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-0af28c4d-83d2-4ee3-9fb7-2505b3582e7c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:15.295583 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-0af28c4d-83d2-4ee3-9fb7-2505b3582e7c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:15.301840 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0af28c4d-83d2-4ee3-9fb7-2505b3582e7c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:15.302287 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0af28c4d-83d2-4ee3-9fb7-2505b3582e7c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:15.303045 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0af28c4d-83d2-4ee3-9fb7-2505b3582e7c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:15.303505 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0af28c4d-83d2-4ee3-9fb7-2505b3582e7c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:15.334865 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-0af28c4d-83d2-4ee3-9fb7-2505b3582e7c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044287 May 10 21:16:15.335584 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 615/1200] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:15 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:15.465782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b3416801-5dc8-47a3-a08d-8f53fc6b9464 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:15.466418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b3416801-5dc8-47a3-a08d-8f53fc6b9464 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:15.472364 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3416801-5dc8-47a3-a08d-8f53fc6b9464 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:15.472797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3416801-5dc8-47a3-a08d-8f53fc6b9464 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:15.473558 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3416801-5dc8-47a3-a08d-8f53fc6b9464 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:15.473996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3416801-5dc8-47a3-a08d-8f53fc6b9464 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:15.599614 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-61558ace-681f-4beb-beca-591423f427c7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:15.600692 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b3416801-5dc8-47a3-a08d-8f53fc6b9464 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:15.601081 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-61558ace-681f-4beb-beca-591423f427c7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:15.608117 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-61558ace-681f-4beb-beca-591423f427c7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:15.608563 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-61558ace-681f-4beb-beca-591423f427c7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:15.609227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b3416801-5dc8-47a3-a08d-8f53fc6b9464 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.147128 May 10 21:16:15.609338 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-61558ace-681f-4beb-beca-591423f427c7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:15.609574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 586/1201] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:15 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:15.609754 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-61558ace-681f-4beb-beca-591423f427c7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:15.639257 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-61558ace-681f-4beb-beca-591423f427c7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043912 May 10 21:16:15.639794 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 616/1202] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:15 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:15.924525 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-86604f49-40d3-4bee-9c6c-c516c8543a3e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:15.925444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-86604f49-40d3-4bee-9c6c-c516c8543a3e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:15.931768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-86604f49-40d3-4bee-9c6c-c516c8543a3e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:15.938287 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-86604f49-40d3-4bee-9c6c-c516c8543a3e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:15.938287 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-86604f49-40d3-4bee-9c6c-c516c8543a3e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:15.938287 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-86604f49-40d3-4bee-9c6c-c516c8543a3e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:15.963007 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-86604f49-40d3-4bee-9c6c-c516c8543a3e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042575 May 10 21:16:15.963582 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 587/1203] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:15 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:16:16.347776 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-df45be17-bd79-457a-a338-9e83839a9aa3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:16.348706 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-df45be17-bd79-457a-a338-9e83839a9aa3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:16.355148 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-df45be17-bd79-457a-a338-9e83839a9aa3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:16.355600 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-df45be17-bd79-457a-a338-9e83839a9aa3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:16.356545 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-df45be17-bd79-457a-a338-9e83839a9aa3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:16.356983 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-df45be17-bd79-457a-a338-9e83839a9aa3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:16.384813 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-df45be17-bd79-457a-a338-9e83839a9aa3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040966 May 10 21:16:16.385345 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 617/1204] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:16 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:16.626552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e3c14fca-a397-4d5d-b5c7-558d1211f8c5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:16.627231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e3c14fca-a397-4d5d-b5c7-558d1211f8c5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:16.633130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e3c14fca-a397-4d5d-b5c7-558d1211f8c5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:16.633581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e3c14fca-a397-4d5d-b5c7-558d1211f8c5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:16.634346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e3c14fca-a397-4d5d-b5c7-558d1211f8c5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:16.634784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e3c14fca-a397-4d5d-b5c7-558d1211f8c5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:16.649763 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-b4f53814-8825-4371-bcb6-f99571038010 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:16.650731 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-b4f53814-8825-4371-bcb6-f99571038010 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:16.656821 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b4f53814-8825-4371-bcb6-f99571038010 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:16.657266 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b4f53814-8825-4371-bcb6-f99571038010 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:16.658026 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b4f53814-8825-4371-bcb6-f99571038010 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:16.658468 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b4f53814-8825-4371-bcb6-f99571038010 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:16.687777 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-b4f53814-8825-4371-bcb6-f99571038010 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041862 May 10 21:16:16.691579 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 618/1205] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:16 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:16:16.763511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e3c14fca-a397-4d5d-b5c7-558d1211f8c5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:16.770832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e3c14fca-a397-4d5d-b5c7-558d1211f8c5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.148911 May 10 21:16:16.771427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 588/1206] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:16 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:16.975457 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-3283271f-a636-43d0-8b80-659c8ecfe5be tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:16.976310 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-3283271f-a636-43d0-8b80-659c8ecfe5be tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:16.982817 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3283271f-a636-43d0-8b80-659c8ecfe5be tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:16.983293 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3283271f-a636-43d0-8b80-659c8ecfe5be tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:16.984049 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3283271f-a636-43d0-8b80-659c8ecfe5be tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:16.984481 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3283271f-a636-43d0-8b80-659c8ecfe5be tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:17.012809 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-3283271f-a636-43d0-8b80-659c8ecfe5be tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041062 May 10 21:16:17.013578 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 619/1207] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:16 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:17.395922 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a2c2a602-4184-4038-9ab8-cfc976d0ddcb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:17.396844 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a2c2a602-4184-4038-9ab8-cfc976d0ddcb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:17.403983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a2c2a602-4184-4038-9ab8-cfc976d0ddcb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:17.404159 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a2c2a602-4184-4038-9ab8-cfc976d0ddcb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:17.404919 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a2c2a602-4184-4038-9ab8-cfc976d0ddcb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:17.405352 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a2c2a602-4184-4038-9ab8-cfc976d0ddcb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:17.433724 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a2c2a602-4184-4038-9ab8-cfc976d0ddcb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041801 May 10 21:16:17.434326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 589/1208] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:17 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:17.699695 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-02fae94d-f552-4c60-9bbe-f1b4406fc9dc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:17.700726 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-02fae94d-f552-4c60-9bbe-f1b4406fc9dc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:17.707090 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-02fae94d-f552-4c60-9bbe-f1b4406fc9dc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:17.707571 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-02fae94d-f552-4c60-9bbe-f1b4406fc9dc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:17.708334 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-02fae94d-f552-4c60-9bbe-f1b4406fc9dc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:17.708771 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-02fae94d-f552-4c60-9bbe-f1b4406fc9dc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:17.738067 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-02fae94d-f552-4c60-9bbe-f1b4406fc9dc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042381 May 10 21:16:17.738607 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 620/1209] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:17 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:17.788069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-950fb626-5d86-49ae-9ae3-3230dffa1c36 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:17.788700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-950fb626-5d86-49ae-9ae3-3230dffa1c36 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:17.795012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-950fb626-5d86-49ae-9ae3-3230dffa1c36 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:17.795493 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-950fb626-5d86-49ae-9ae3-3230dffa1c36 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:17.796258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-950fb626-5d86-49ae-9ae3-3230dffa1c36 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:17.796698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-950fb626-5d86-49ae-9ae3-3230dffa1c36 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:17.927810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-950fb626-5d86-49ae-9ae3-3230dffa1c36 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:17.935379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-950fb626-5d86-49ae-9ae3-3230dffa1c36 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151093 May 10 21:16:17.935953 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 590/1210] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:17 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:18.024509 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-801bbb77-8d2d-4215-95cd-386955feed5e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:18.025357 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-801bbb77-8d2d-4215-95cd-386955feed5e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:18.032296 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-801bbb77-8d2d-4215-95cd-386955feed5e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:18.032741 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-801bbb77-8d2d-4215-95cd-386955feed5e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:18.033496 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-801bbb77-8d2d-4215-95cd-386955feed5e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:18.033929 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-801bbb77-8d2d-4215-95cd-386955feed5e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:18.061460 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-801bbb77-8d2d-4215-95cd-386955feed5e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040898 May 10 21:16:18.061992 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 621/1211] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:18 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:18.445692 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3563d3b5-90f7-4e5d-aa9f-4ba164168b7a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:18.446610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3563d3b5-90f7-4e5d-aa9f-4ba164168b7a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:18.453914 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3563d3b5-90f7-4e5d-aa9f-4ba164168b7a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:18.454358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3563d3b5-90f7-4e5d-aa9f-4ba164168b7a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:18.455114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3563d3b5-90f7-4e5d-aa9f-4ba164168b7a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:18.455566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3563d3b5-90f7-4e5d-aa9f-4ba164168b7a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:18.484755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3563d3b5-90f7-4e5d-aa9f-4ba164168b7a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043284 May 10 21:16:18.485298 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 591/1212] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:18 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:18.750422 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-aaacec85-92c8-4cd2-abec-bda078e663b7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:18.751381 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-aaacec85-92c8-4cd2-abec-bda078e663b7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:18.758856 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-aaacec85-92c8-4cd2-abec-bda078e663b7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:18.758856 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-aaacec85-92c8-4cd2-abec-bda078e663b7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:18.758856 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-aaacec85-92c8-4cd2-abec-bda078e663b7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:18.759344 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-aaacec85-92c8-4cd2-abec-bda078e663b7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:18.789300 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-aaacec85-92c8-4cd2-abec-bda078e663b7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043156 May 10 21:16:18.789846 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 622/1213] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:18 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:18.952900 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f5222ad8-d947-46dd-8410-cadabe108827 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:18.953441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f5222ad8-d947-46dd-8410-cadabe108827 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:18.959435 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5222ad8-d947-46dd-8410-cadabe108827 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:18.959885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5222ad8-d947-46dd-8410-cadabe108827 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:18.960654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5222ad8-d947-46dd-8410-cadabe108827 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:18.961089 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5222ad8-d947-46dd-8410-cadabe108827 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:19.073326 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f8f0e873-ad88-43df-b0e0-b1f1ad4d1962 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:19.074386 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f8f0e873-ad88-43df-b0e0-b1f1ad4d1962 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:19.080847 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f8f0e873-ad88-43df-b0e0-b1f1ad4d1962 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:19.081299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f8f0e873-ad88-43df-b0e0-b1f1ad4d1962 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:19.082073 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f8f0e873-ad88-43df-b0e0-b1f1ad4d1962 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:19.082513 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f8f0e873-ad88-43df-b0e0-b1f1ad4d1962 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:19.088623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f5222ad8-d947-46dd-8410-cadabe108827 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:19.096674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f5222ad8-d947-46dd-8410-cadabe108827 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.148524 May 10 21:16:19.097238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 592/1214] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:18 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:19.112236 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f8f0e873-ad88-43df-b0e0-b1f1ad4d1962 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042894 May 10 21:16:19.112785 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 623/1215] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:19 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:16:19.496504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f5a6de98-e1fe-492e-8e51-628683e62804 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:19.497832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f5a6de98-e1fe-492e-8e51-628683e62804 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:19.504127 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5a6de98-e1fe-492e-8e51-628683e62804 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:19.504578 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5a6de98-e1fe-492e-8e51-628683e62804 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:19.505344 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5a6de98-e1fe-492e-8e51-628683e62804 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:19.505784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5a6de98-e1fe-492e-8e51-628683e62804 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:19.535930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f5a6de98-e1fe-492e-8e51-628683e62804 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043358 May 10 21:16:19.536474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 593/1216] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:19 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:19.801070 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-91363a8c-91e3-49ba-a33d-8a4735c98bb0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:19.801927 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-91363a8c-91e3-49ba-a33d-8a4735c98bb0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:19.808347 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-91363a8c-91e3-49ba-a33d-8a4735c98bb0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:19.808797 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-91363a8c-91e3-49ba-a33d-8a4735c98bb0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:19.810517 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-91363a8c-91e3-49ba-a33d-8a4735c98bb0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:19.810962 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-91363a8c-91e3-49ba-a33d-8a4735c98bb0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:19.840177 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-91363a8c-91e3-49ba-a33d-8a4735c98bb0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043189 May 10 21:16:19.841379 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 624/1217] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:19 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:20.113914 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dc774714-d629-45f2-b6b0-4b395e8a99ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:20.114524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dc774714-d629-45f2-b6b0-4b395e8a99ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:20.120742 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dc774714-d629-45f2-b6b0-4b395e8a99ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:20.121193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dc774714-d629-45f2-b6b0-4b395e8a99ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:20.122929 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dc774714-d629-45f2-b6b0-4b395e8a99ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:20.123401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dc774714-d629-45f2-b6b0-4b395e8a99ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:20.124112 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-76c85110-6def-4eb2-a372-4bd3574f29c7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:20.125062 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-76c85110-6def-4eb2-a372-4bd3574f29c7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:20.130790 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-76c85110-6def-4eb2-a372-4bd3574f29c7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:20.131277 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-76c85110-6def-4eb2-a372-4bd3574f29c7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:20.132041 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-76c85110-6def-4eb2-a372-4bd3574f29c7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:20.132471 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-76c85110-6def-4eb2-a372-4bd3574f29c7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:20.160924 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-76c85110-6def-4eb2-a372-4bd3574f29c7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041112 May 10 21:16:20.161632 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 625/1218] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:20 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:16:20.254594 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dc774714-d629-45f2-b6b0-4b395e8a99ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:20.261957 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dc774714-d629-45f2-b6b0-4b395e8a99ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151923 May 10 21:16:20.262535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 594/1219] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:20 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:20.548349 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-fb4db1e4-e2dc-4b0e-adb0-8c5c53e3ff50 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:20.549222 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-fb4db1e4-e2dc-4b0e-adb0-8c5c53e3ff50 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:20.555083 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fb4db1e4-e2dc-4b0e-adb0-8c5c53e3ff50 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:20.555564 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fb4db1e4-e2dc-4b0e-adb0-8c5c53e3ff50 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:20.556317 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fb4db1e4-e2dc-4b0e-adb0-8c5c53e3ff50 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:20.556747 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fb4db1e4-e2dc-4b0e-adb0-8c5c53e3ff50 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:20.585832 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-fb4db1e4-e2dc-4b0e-adb0-8c5c53e3ff50 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042327 May 10 21:16:20.586312 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 626/1220] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:20 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:20.852390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0c84c7df-43e6-499b-9ace-5a98594bd30b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:20.853356 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0c84c7df-43e6-499b-9ace-5a98594bd30b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:20.859872 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c84c7df-43e6-499b-9ace-5a98594bd30b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:20.860317 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c84c7df-43e6-499b-9ace-5a98594bd30b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:20.861077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c84c7df-43e6-499b-9ace-5a98594bd30b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:20.861509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c84c7df-43e6-499b-9ace-5a98594bd30b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:20.890282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0c84c7df-43e6-499b-9ace-5a98594bd30b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041932 May 10 21:16:20.895876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 595/1221] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:20 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:21.172819 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-b20762db-3887-41ff-84cb-d9c4c5b9b0b7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:21.173717 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-b20762db-3887-41ff-84cb-d9c4c5b9b0b7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:21.180116 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b20762db-3887-41ff-84cb-d9c4c5b9b0b7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:21.180572 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b20762db-3887-41ff-84cb-d9c4c5b9b0b7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:21.181344 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b20762db-3887-41ff-84cb-d9c4c5b9b0b7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:21.181788 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b20762db-3887-41ff-84cb-d9c4c5b9b0b7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:21.210126 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-b20762db-3887-41ff-84cb-d9c4c5b9b0b7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041996 May 10 21:16:21.210765 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 627/1222] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:21 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:21.279470 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2a1c14dc-f2d4-4fa4-9395-f42178ba3340 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:21.280101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2a1c14dc-f2d4-4fa4-9395-f42178ba3340 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:21.285899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2a1c14dc-f2d4-4fa4-9395-f42178ba3340 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:21.286341 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2a1c14dc-f2d4-4fa4-9395-f42178ba3340 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:21.287092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2a1c14dc-f2d4-4fa4-9395-f42178ba3340 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:21.287545 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2a1c14dc-f2d4-4fa4-9395-f42178ba3340 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:21.416909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2a1c14dc-f2d4-4fa4-9395-f42178ba3340 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:21.424951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2a1c14dc-f2d4-4fa4-9395-f42178ba3340 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.149858 May 10 21:16:21.425455 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 596/1223] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:21 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:21.597637 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a1e6e876-6a34-4062-8c1a-1dd869c5b040 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:21.598576 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a1e6e876-6a34-4062-8c1a-1dd869c5b040 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:21.604639 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a1e6e876-6a34-4062-8c1a-1dd869c5b040 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:21.605088 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a1e6e876-6a34-4062-8c1a-1dd869c5b040 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:21.605863 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a1e6e876-6a34-4062-8c1a-1dd869c5b040 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:21.606309 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a1e6e876-6a34-4062-8c1a-1dd869c5b040 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:21.634600 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a1e6e876-6a34-4062-8c1a-1dd869c5b040 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040849 May 10 21:16:21.635157 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 628/1224] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:21 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:21.905755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-15facdea-47f2-460b-b186-52180fbf2fde tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:21.906703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-15facdea-47f2-460b-b186-52180fbf2fde tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:21.913044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-15facdea-47f2-460b-b186-52180fbf2fde tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:21.913480 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-15facdea-47f2-460b-b186-52180fbf2fde tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:21.914233 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-15facdea-47f2-460b-b186-52180fbf2fde tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:21.914668 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-15facdea-47f2-460b-b186-52180fbf2fde tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:21.944166 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-15facdea-47f2-460b-b186-52180fbf2fde tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042454 May 10 21:16:21.944703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 597/1225] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:21 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:22.221762 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e9f852b8-426e-4faf-9be6-8e492d5403ad tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:22.222613 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e9f852b8-426e-4faf-9be6-8e492d5403ad tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:22.228980 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e9f852b8-426e-4faf-9be6-8e492d5403ad tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:22.229431 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e9f852b8-426e-4faf-9be6-8e492d5403ad tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:22.230197 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e9f852b8-426e-4faf-9be6-8e492d5403ad tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:22.230638 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e9f852b8-426e-4faf-9be6-8e492d5403ad tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:22.259947 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e9f852b8-426e-4faf-9be6-8e492d5403ad tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042172 May 10 21:16:22.260497 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 629/1226] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:22 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:22.441792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-196306ff-4f7c-468c-8f40-68c9d0cea8da tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:22.442406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-196306ff-4f7c-468c-8f40-68c9d0cea8da tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:22.449656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-196306ff-4f7c-468c-8f40-68c9d0cea8da tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:22.450191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-196306ff-4f7c-468c-8f40-68c9d0cea8da tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:22.451085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-196306ff-4f7c-468c-8f40-68c9d0cea8da tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:22.451554 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-196306ff-4f7c-468c-8f40-68c9d0cea8da tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:22.583956 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-196306ff-4f7c-468c-8f40-68c9d0cea8da tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:22.591852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-196306ff-4f7c-468c-8f40-68c9d0cea8da tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.153988 May 10 21:16:22.592411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 598/1227] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:22 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:22.647552 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f176535a-2122-407b-8ad2-84073df66957 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:22.648492 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f176535a-2122-407b-8ad2-84073df66957 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:22.654872 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f176535a-2122-407b-8ad2-84073df66957 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:22.655356 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f176535a-2122-407b-8ad2-84073df66957 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:22.656121 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f176535a-2122-407b-8ad2-84073df66957 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:22.656559 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f176535a-2122-407b-8ad2-84073df66957 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:22.685468 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f176535a-2122-407b-8ad2-84073df66957 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041922 May 10 21:16:22.685995 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 630/1228] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:22 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:22.954987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-de80dce6-a263-4de5-b56e-b9d3be1b6867 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:22.955974 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-de80dce6-a263-4de5-b56e-b9d3be1b6867 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:22.963008 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de80dce6-a263-4de5-b56e-b9d3be1b6867 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:22.963488 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de80dce6-a263-4de5-b56e-b9d3be1b6867 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:22.964287 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de80dce6-a263-4de5-b56e-b9d3be1b6867 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:22.964723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de80dce6-a263-4de5-b56e-b9d3be1b6867 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:22.993302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-de80dce6-a263-4de5-b56e-b9d3be1b6867 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042389 May 10 21:16:22.993845 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 599/1229] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:22 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:23.271433 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-0e45a138-362d-427f-a033-8e2801af8a1e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:23.272310 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-0e45a138-362d-427f-a033-8e2801af8a1e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:23.279177 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0e45a138-362d-427f-a033-8e2801af8a1e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:23.279625 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0e45a138-362d-427f-a033-8e2801af8a1e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:23.280397 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0e45a138-362d-427f-a033-8e2801af8a1e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:23.280822 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0e45a138-362d-427f-a033-8e2801af8a1e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:23.308622 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-0e45a138-362d-427f-a033-8e2801af8a1e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041256 May 10 21:16:23.309176 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 631/1230] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:23 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:23.609756 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-893fadca-1193-4531-ac6d-7343af8120e5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:23.610374 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-893fadca-1193-4531-ac6d-7343af8120e5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:23.616260 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-893fadca-1193-4531-ac6d-7343af8120e5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:23.616740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-893fadca-1193-4531-ac6d-7343af8120e5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:23.617506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-893fadca-1193-4531-ac6d-7343af8120e5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:23.617941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-893fadca-1193-4531-ac6d-7343af8120e5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:23.697373 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-06fdf169-b873-40a0-8a06-668750a48ba4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:23.698630 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-06fdf169-b873-40a0-8a06-668750a48ba4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:23.705563 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-06fdf169-b873-40a0-8a06-668750a48ba4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:23.706087 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-06fdf169-b873-40a0-8a06-668750a48ba4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:23.706923 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-06fdf169-b873-40a0-8a06-668750a48ba4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:23.707460 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-06fdf169-b873-40a0-8a06-668750a48ba4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:23.736707 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-06fdf169-b873-40a0-8a06-668750a48ba4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043733 May 10 21:16:23.737354 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 632/1231] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:23 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:16:23.749608 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-893fadca-1193-4531-ac6d-7343af8120e5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:23.756978 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-893fadca-1193-4531-ac6d-7343af8120e5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151643 May 10 21:16:23.757542 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 600/1232] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:23 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:24.005742 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-fe33f35b-ace5-4dc9-be0a-2df75121662c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:24.006594 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-fe33f35b-ace5-4dc9-be0a-2df75121662c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:24.013246 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fe33f35b-ace5-4dc9-be0a-2df75121662c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:24.013701 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fe33f35b-ace5-4dc9-be0a-2df75121662c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:24.014476 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fe33f35b-ace5-4dc9-be0a-2df75121662c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:24.014918 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fe33f35b-ace5-4dc9-be0a-2df75121662c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:24.043084 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-fe33f35b-ace5-4dc9-be0a-2df75121662c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041384 May 10 21:16:24.044151 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 633/1233] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:24 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:24.320490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-99377392-3a22-40f0-8bcd-ae35ea67f7e5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:24.321453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-99377392-3a22-40f0-8bcd-ae35ea67f7e5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:24.327781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-99377392-3a22-40f0-8bcd-ae35ea67f7e5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:24.328227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-99377392-3a22-40f0-8bcd-ae35ea67f7e5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:24.328987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-99377392-3a22-40f0-8bcd-ae35ea67f7e5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:24.329420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-99377392-3a22-40f0-8bcd-ae35ea67f7e5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:24.358776 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-99377392-3a22-40f0-8bcd-ae35ea67f7e5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042507 May 10 21:16:24.359356 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 601/1234] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:24 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:24.748918 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-939a0b2b-76e7-438d-ab40-e394ecdd4f1e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:24.749872 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-939a0b2b-76e7-438d-ab40-e394ecdd4f1e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:24.756225 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-939a0b2b-76e7-438d-ab40-e394ecdd4f1e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:24.758622 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-939a0b2b-76e7-438d-ab40-e394ecdd4f1e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:24.758622 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-939a0b2b-76e7-438d-ab40-e394ecdd4f1e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:24.758622 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-939a0b2b-76e7-438d-ab40-e394ecdd4f1e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:24.774489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fb4580a2-6f49-4d19-a7d2-4907fc737a08 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:24.775221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fb4580a2-6f49-4d19-a7d2-4907fc737a08 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:24.781814 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb4580a2-6f49-4d19-a7d2-4907fc737a08 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:24.782258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb4580a2-6f49-4d19-a7d2-4907fc737a08 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:24.783022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb4580a2-6f49-4d19-a7d2-4907fc737a08 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:24.783482 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb4580a2-6f49-4d19-a7d2-4907fc737a08 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:24.788380 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-939a0b2b-76e7-438d-ab40-e394ecdd4f1e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043957 May 10 21:16:24.788933 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 634/1235] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:24 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:16:24.911777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fb4580a2-6f49-4d19-a7d2-4907fc737a08 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:24.919675 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fb4580a2-6f49-4d19-a7d2-4907fc737a08 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.148433 May 10 21:16:24.920248 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 602/1236] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:24 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:16:25.055767 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-3409a90e-4149-466e-b216-1f5019492538 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:25.056687 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-3409a90e-4149-466e-b216-1f5019492538 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:25.063358 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3409a90e-4149-466e-b216-1f5019492538 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:25.063913 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3409a90e-4149-466e-b216-1f5019492538 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:25.064675 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3409a90e-4149-466e-b216-1f5019492538 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:25.065108 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3409a90e-4149-466e-b216-1f5019492538 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:25.094263 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-3409a90e-4149-466e-b216-1f5019492538 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042522 May 10 21:16:25.094805 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 635/1237] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:25 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:25.370563 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-024817dd-2948-4c34-88a5-e52ca73b10a2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:25.371513 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-024817dd-2948-4c34-88a5-e52ca73b10a2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:25.378772 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-024817dd-2948-4c34-88a5-e52ca73b10a2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:25.379247 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-024817dd-2948-4c34-88a5-e52ca73b10a2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:25.380015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-024817dd-2948-4c34-88a5-e52ca73b10a2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:25.380445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-024817dd-2948-4c34-88a5-e52ca73b10a2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:25.409137 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-024817dd-2948-4c34-88a5-e52ca73b10a2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042730 May 10 21:16:25.409687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 603/1238] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:25 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:16:25.800636 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-662dd30b-014d-4edc-a7bc-51c65e085fd7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:25.801480 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-662dd30b-014d-4edc-a7bc-51c65e085fd7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:25.808109 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-662dd30b-014d-4edc-a7bc-51c65e085fd7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:25.808556 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-662dd30b-014d-4edc-a7bc-51c65e085fd7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:25.809340 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-662dd30b-014d-4edc-a7bc-51c65e085fd7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:25.810403 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-662dd30b-014d-4edc-a7bc-51c65e085fd7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:25.839105 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-662dd30b-014d-4edc-a7bc-51c65e085fd7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042437 May 10 21:16:25.839673 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 636/1239] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:25 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:25.937403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-89bbb68b-a3ce-4023-bd47-3127b195b7c1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:25.938019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-89bbb68b-a3ce-4023-bd47-3127b195b7c1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:25.944262 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89bbb68b-a3ce-4023-bd47-3127b195b7c1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:25.944733 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89bbb68b-a3ce-4023-bd47-3127b195b7c1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:25.945503 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89bbb68b-a3ce-4023-bd47-3127b195b7c1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:25.945942 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89bbb68b-a3ce-4023-bd47-3127b195b7c1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:26.082876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-89bbb68b-a3ce-4023-bd47-3127b195b7c1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:26.090462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-89bbb68b-a3ce-4023-bd47-3127b195b7c1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.157525 May 10 21:16:26.091861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 604/1240] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:25 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:26.105899 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-39e0f1d3-2a21-40bd-b832-c7ec01a1e287 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:26.106899 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-39e0f1d3-2a21-40bd-b832-c7ec01a1e287 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:26.112878 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-39e0f1d3-2a21-40bd-b832-c7ec01a1e287 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:26.113329 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-39e0f1d3-2a21-40bd-b832-c7ec01a1e287 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:26.114139 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-39e0f1d3-2a21-40bd-b832-c7ec01a1e287 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:26.114575 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-39e0f1d3-2a21-40bd-b832-c7ec01a1e287 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:26.143588 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-39e0f1d3-2a21-40bd-b832-c7ec01a1e287 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041651 May 10 21:16:26.144138 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 637/1241] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:26 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:26.421110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-eb1ffe43-3bab-4ed8-bbbb-7f0ca3ca300b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:26.422025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-eb1ffe43-3bab-4ed8-bbbb-7f0ca3ca300b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:26.428761 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eb1ffe43-3bab-4ed8-bbbb-7f0ca3ca300b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:26.429203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eb1ffe43-3bab-4ed8-bbbb-7f0ca3ca300b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:26.429960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eb1ffe43-3bab-4ed8-bbbb-7f0ca3ca300b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:26.430393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eb1ffe43-3bab-4ed8-bbbb-7f0ca3ca300b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:26.461375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-eb1ffe43-3bab-4ed8-bbbb-7f0ca3ca300b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044405 May 10 21:16:26.461961 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 605/1242] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:26 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:26.851688 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-399aabc5-ae6f-45d3-b59e-d2fc49f66954 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:26.852619 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-399aabc5-ae6f-45d3-b59e-d2fc49f66954 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:26.859620 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-399aabc5-ae6f-45d3-b59e-d2fc49f66954 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:26.860069 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-399aabc5-ae6f-45d3-b59e-d2fc49f66954 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:26.860841 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-399aabc5-ae6f-45d3-b59e-d2fc49f66954 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:26.861295 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-399aabc5-ae6f-45d3-b59e-d2fc49f66954 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:26.890377 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-399aabc5-ae6f-45d3-b59e-d2fc49f66954 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042836 May 10 21:16:26.890938 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 638/1243] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:26 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:27.109066 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d0e058d9-c18f-4060-b33a-23101a3c787a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:27.109612 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d0e058d9-c18f-4060-b33a-23101a3c787a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:27.115605 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0e058d9-c18f-4060-b33a-23101a3c787a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:27.116057 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0e058d9-c18f-4060-b33a-23101a3c787a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:27.116820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0e058d9-c18f-4060-b33a-23101a3c787a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:27.117259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0e058d9-c18f-4060-b33a-23101a3c787a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:27.155585 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6db145e5-a2fd-482a-a26a-d6867a73e9e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:27.156523 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6db145e5-a2fd-482a-a26a-d6867a73e9e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:27.162387 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6db145e5-a2fd-482a-a26a-d6867a73e9e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:27.162839 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6db145e5-a2fd-482a-a26a-d6867a73e9e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:27.163649 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6db145e5-a2fd-482a-a26a-d6867a73e9e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:27.164096 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6db145e5-a2fd-482a-a26a-d6867a73e9e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:27.193577 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6db145e5-a2fd-482a-a26a-d6867a73e9e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042112 May 10 21:16:27.194129 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 639/1244] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:27 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:16:27.247885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d0e058d9-c18f-4060-b33a-23101a3c787a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:27.255224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d0e058d9-c18f-4060-b33a-23101a3c787a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.150775 May 10 21:16:27.255790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 606/1245] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:27 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:27.473132 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-8f0cba88-78bd-47b6-9ecf-84e4ab1b608e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:27.474057 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-8f0cba88-78bd-47b6-9ecf-84e4ab1b608e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:27.479984 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8f0cba88-78bd-47b6-9ecf-84e4ab1b608e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:27.480435 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8f0cba88-78bd-47b6-9ecf-84e4ab1b608e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:27.481215 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8f0cba88-78bd-47b6-9ecf-84e4ab1b608e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:27.481829 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8f0cba88-78bd-47b6-9ecf-84e4ab1b608e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:27.509668 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-8f0cba88-78bd-47b6-9ecf-84e4ab1b608e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040547 May 10 21:16:27.510206 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 640/1246] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:27 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:27.901223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b033a84f-1856-4077-9f9c-add74c3f4164 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:27.902151 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b033a84f-1856-4077-9f9c-add74c3f4164 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:27.908842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b033a84f-1856-4077-9f9c-add74c3f4164 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:27.909286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b033a84f-1856-4077-9f9c-add74c3f4164 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:27.910042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b033a84f-1856-4077-9f9c-add74c3f4164 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:27.910480 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b033a84f-1856-4077-9f9c-add74c3f4164 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:27.939141 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b033a84f-1856-4077-9f9c-add74c3f4164 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041977 May 10 21:16:27.939750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 607/1247] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:27 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:28.205868 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-eb0b9707-237c-4d86-bb46-6779ee2ffa06 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:28.206767 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-eb0b9707-237c-4d86-bb46-6779ee2ffa06 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:28.213440 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-eb0b9707-237c-4d86-bb46-6779ee2ffa06 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:28.213885 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-eb0b9707-237c-4d86-bb46-6779ee2ffa06 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:28.214647 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-eb0b9707-237c-4d86-bb46-6779ee2ffa06 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:28.215082 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-eb0b9707-237c-4d86-bb46-6779ee2ffa06 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:28.243321 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-eb0b9707-237c-4d86-bb46-6779ee2ffa06 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041495 May 10 21:16:28.243857 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 641/1248] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:28 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:16:28.273262 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ce4b8dce-2150-4f22-ac7a-af86312421be tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:28.273862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ce4b8dce-2150-4f22-ac7a-af86312421be tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:28.280300 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ce4b8dce-2150-4f22-ac7a-af86312421be tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:28.280744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ce4b8dce-2150-4f22-ac7a-af86312421be tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:28.281499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ce4b8dce-2150-4f22-ac7a-af86312421be tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:28.281929 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ce4b8dce-2150-4f22-ac7a-af86312421be tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:28.417265 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ce4b8dce-2150-4f22-ac7a-af86312421be tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:28.424866 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ce4b8dce-2150-4f22-ac7a-af86312421be tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.155401 May 10 21:16:28.425415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 608/1249] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:28 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:28.522014 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c92ee5dd-8e91-43ae-9d18-6e4f2b66cd23 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:28.522869 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c92ee5dd-8e91-43ae-9d18-6e4f2b66cd23 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:28.529703 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c92ee5dd-8e91-43ae-9d18-6e4f2b66cd23 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:28.530351 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c92ee5dd-8e91-43ae-9d18-6e4f2b66cd23 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:28.531406 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c92ee5dd-8e91-43ae-9d18-6e4f2b66cd23 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:28.531849 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c92ee5dd-8e91-43ae-9d18-6e4f2b66cd23 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:28.560172 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c92ee5dd-8e91-43ae-9d18-6e4f2b66cd23 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042092 May 10 21:16:28.560721 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 642/1250] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:28 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:28.950724 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d6887d82-0de1-48b3-bda2-86df8bd15fab tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:28.951775 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d6887d82-0de1-48b3-bda2-86df8bd15fab tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:28.958082 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6887d82-0de1-48b3-bda2-86df8bd15fab tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:28.958536 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6887d82-0de1-48b3-bda2-86df8bd15fab tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:28.959346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6887d82-0de1-48b3-bda2-86df8bd15fab tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:28.959792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6887d82-0de1-48b3-bda2-86df8bd15fab tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:28.988872 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d6887d82-0de1-48b3-bda2-86df8bd15fab tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042795 May 10 21:16:28.989423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 609/1251] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:28 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:29.254698 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-fa255109-fbf0-47e8-9886-cd2b3449fa88 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:29.255562 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-fa255109-fbf0-47e8-9886-cd2b3449fa88 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:29.261877 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fa255109-fbf0-47e8-9886-cd2b3449fa88 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:29.262319 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fa255109-fbf0-47e8-9886-cd2b3449fa88 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:29.263329 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fa255109-fbf0-47e8-9886-cd2b3449fa88 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:29.263766 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-fa255109-fbf0-47e8-9886-cd2b3449fa88 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:29.291853 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-fa255109-fbf0-47e8-9886-cd2b3449fa88 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041219 May 10 21:16:29.292386 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 643/1252] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:29 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:29.441623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fba98ef5-cb0b-43ec-819e-35bc54b0c9f9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:29.442233 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fba98ef5-cb0b-43ec-819e-35bc54b0c9f9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:29.448467 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fba98ef5-cb0b-43ec-819e-35bc54b0c9f9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:29.448916 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fba98ef5-cb0b-43ec-819e-35bc54b0c9f9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:29.449674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fba98ef5-cb0b-43ec-819e-35bc54b0c9f9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:29.450142 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fba98ef5-cb0b-43ec-819e-35bc54b0c9f9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:29.572000 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-84b0f094-8806-4b94-aeb1-3b604b8db489 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:29.572935 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-84b0f094-8806-4b94-aeb1-3b604b8db489 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:29.577054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fba98ef5-cb0b-43ec-819e-35bc54b0c9f9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:29.578966 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-84b0f094-8806-4b94-aeb1-3b604b8db489 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:29.579452 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-84b0f094-8806-4b94-aeb1-3b604b8db489 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:29.580234 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-84b0f094-8806-4b94-aeb1-3b604b8db489 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:29.580673 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-84b0f094-8806-4b94-aeb1-3b604b8db489 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:29.584499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fba98ef5-cb0b-43ec-819e-35bc54b0c9f9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.146699 May 10 21:16:29.585071 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 610/1253] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:29 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:29.611454 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-84b0f094-8806-4b94-aeb1-3b604b8db489 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043551 May 10 21:16:29.612011 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 644/1254] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:29 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:16:29.999857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a5a84eef-ed03-4527-83ab-29c589fd1110 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:30.000784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a5a84eef-ed03-4527-83ab-29c589fd1110 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:30.007565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a5a84eef-ed03-4527-83ab-29c589fd1110 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:30.007994 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a5a84eef-ed03-4527-83ab-29c589fd1110 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:30.008759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a5a84eef-ed03-4527-83ab-29c589fd1110 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:30.009198 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a5a84eef-ed03-4527-83ab-29c589fd1110 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:30.039403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a5a84eef-ed03-4527-83ab-29c589fd1110 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043563 May 10 21:16:30.039950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 611/1255] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:29 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:30.304265 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e6d19258-5779-42fa-8ebc-d84375149325 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:30.305198 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e6d19258-5779-42fa-8ebc-d84375149325 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:30.312068 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e6d19258-5779-42fa-8ebc-d84375149325 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:30.312517 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e6d19258-5779-42fa-8ebc-d84375149325 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:30.313287 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e6d19258-5779-42fa-8ebc-d84375149325 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:30.313723 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e6d19258-5779-42fa-8ebc-d84375149325 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:30.343503 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e6d19258-5779-42fa-8ebc-d84375149325 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043198 May 10 21:16:30.344061 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 645/1256] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:30 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:30.601791 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7c70b952-1399-438c-bb8e-e89bc4b71962 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:30.602406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7c70b952-1399-438c-bb8e-e89bc4b71962 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:30.609155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c70b952-1399-438c-bb8e-e89bc4b71962 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:30.609606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c70b952-1399-438c-bb8e-e89bc4b71962 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:30.610370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c70b952-1399-438c-bb8e-e89bc4b71962 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:30.610802 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c70b952-1399-438c-bb8e-e89bc4b71962 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:30.622529 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-7388348e-57e5-4ec6-998b-6d5bf657dd85 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:30.623522 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-7388348e-57e5-4ec6-998b-6d5bf657dd85 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:30.629697 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7388348e-57e5-4ec6-998b-6d5bf657dd85 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:30.630140 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7388348e-57e5-4ec6-998b-6d5bf657dd85 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:30.630904 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7388348e-57e5-4ec6-998b-6d5bf657dd85 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:30.631361 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7388348e-57e5-4ec6-998b-6d5bf657dd85 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:30.660337 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-7388348e-57e5-4ec6-998b-6d5bf657dd85 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042285 May 10 21:16:30.660892 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 646/1257] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:30 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:16:30.749946 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7c70b952-1399-438c-bb8e-e89bc4b71962 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:30.757213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7c70b952-1399-438c-bb8e-e89bc4b71962 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.159318 May 10 21:16:30.757771 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 612/1258] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:30 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:31.051143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e60fb54e-f51a-41a1-bcbf-348f472a34c4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:31.052001 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e60fb54e-f51a-41a1-bcbf-348f472a34c4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:31.057891 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e60fb54e-f51a-41a1-bcbf-348f472a34c4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:31.058335 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e60fb54e-f51a-41a1-bcbf-348f472a34c4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:31.059145 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e60fb54e-f51a-41a1-bcbf-348f472a34c4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:31.059591 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e60fb54e-f51a-41a1-bcbf-348f472a34c4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:31.087335 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e60fb54e-f51a-41a1-bcbf-348f472a34c4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040286 May 10 21:16:31.087866 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 647/1259] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:31 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:31.354501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f478324a-74d7-4ea9-bc27-5acdf590bf25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:31.355448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f478324a-74d7-4ea9-bc27-5acdf590bf25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:31.361814 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f478324a-74d7-4ea9-bc27-5acdf590bf25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:31.362249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f478324a-74d7-4ea9-bc27-5acdf590bf25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:31.363006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f478324a-74d7-4ea9-bc27-5acdf590bf25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:31.363468 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f478324a-74d7-4ea9-bc27-5acdf590bf25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:31.391405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f478324a-74d7-4ea9-bc27-5acdf590bf25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040837 May 10 21:16:31.391942 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 613/1260] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:31 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:31.671804 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-5d0cd63b-0643-4eb8-858a-bab1fe3f9701 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:31.672737 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5d0cd63b-0643-4eb8-858a-bab1fe3f9701 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:31.679100 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5d0cd63b-0643-4eb8-858a-bab1fe3f9701 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:31.679646 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5d0cd63b-0643-4eb8-858a-bab1fe3f9701 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:31.680415 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5d0cd63b-0643-4eb8-858a-bab1fe3f9701 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:31.680855 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5d0cd63b-0643-4eb8-858a-bab1fe3f9701 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:31.710918 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-5d0cd63b-0643-4eb8-858a-bab1fe3f9701 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043141 May 10 21:16:31.711494 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 648/1261] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:31 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:31.773570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9ae3c07c-dbbf-4543-9172-cc1edb8634f0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:31.774181 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9ae3c07c-dbbf-4543-9172-cc1edb8634f0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:31.780298 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ae3c07c-dbbf-4543-9172-cc1edb8634f0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:31.780744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ae3c07c-dbbf-4543-9172-cc1edb8634f0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:31.781503 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ae3c07c-dbbf-4543-9172-cc1edb8634f0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:31.781935 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ae3c07c-dbbf-4543-9172-cc1edb8634f0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:31.912473 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9ae3c07c-dbbf-4543-9172-cc1edb8634f0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:31.920607 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9ae3c07c-dbbf-4543-9172-cc1edb8634f0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.150754 May 10 21:16:31.921245 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 614/1262] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:31 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:32.098759 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-83b930fb-8033-4da8-8a3f-8b4515359595 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:32.099716 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-83b930fb-8033-4da8-8a3f-8b4515359595 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:32.105677 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-83b930fb-8033-4da8-8a3f-8b4515359595 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:32.106261 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-83b930fb-8033-4da8-8a3f-8b4515359595 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:32.107253 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-83b930fb-8033-4da8-8a3f-8b4515359595 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:32.107698 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-83b930fb-8033-4da8-8a3f-8b4515359595 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:32.135230 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-83b930fb-8033-4da8-8a3f-8b4515359595 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040325 May 10 21:16:32.135703 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 649/1263] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:32 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:32.403200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e5d897d3-fd13-4805-942f-68215d26cfa8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:32.404203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e5d897d3-fd13-4805-942f-68215d26cfa8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:32.410567 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e5d897d3-fd13-4805-942f-68215d26cfa8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:32.411015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e5d897d3-fd13-4805-942f-68215d26cfa8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:32.411816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e5d897d3-fd13-4805-942f-68215d26cfa8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:32.412259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e5d897d3-fd13-4805-942f-68215d26cfa8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:32.441516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e5d897d3-fd13-4805-942f-68215d26cfa8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042487 May 10 21:16:32.442060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 615/1264] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:32 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:32.722618 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-58461563-283e-466e-b292-ad3d3f2a3706 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:32.723532 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-58461563-283e-466e-b292-ad3d3f2a3706 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:32.729773 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-58461563-283e-466e-b292-ad3d3f2a3706 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:32.730218 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-58461563-283e-466e-b292-ad3d3f2a3706 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:32.730970 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-58461563-283e-466e-b292-ad3d3f2a3706 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:32.731919 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-58461563-283e-466e-b292-ad3d3f2a3706 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:32.760328 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-58461563-283e-466e-b292-ad3d3f2a3706 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041694 May 10 21:16:32.760868 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 650/1265] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:32 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:32.938320 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ee32176b-cba2-4b6d-913f-be4d9a3b9747 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:32.938967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ee32176b-cba2-4b6d-913f-be4d9a3b9747 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:32.945343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee32176b-cba2-4b6d-913f-be4d9a3b9747 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:32.945785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee32176b-cba2-4b6d-913f-be4d9a3b9747 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:32.946642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee32176b-cba2-4b6d-913f-be4d9a3b9747 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:32.947074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee32176b-cba2-4b6d-913f-be4d9a3b9747 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:33.074114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ee32176b-cba2-4b6d-913f-be4d9a3b9747 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:33.081398 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ee32176b-cba2-4b6d-913f-be4d9a3b9747 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.147508 May 10 21:16:33.081950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 616/1266] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:32 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:33.147709 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6aa42b93-325b-456f-8cff-02b0a8d05811 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:33.148639 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6aa42b93-325b-456f-8cff-02b0a8d05811 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:33.155081 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6aa42b93-325b-456f-8cff-02b0a8d05811 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:33.155558 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6aa42b93-325b-456f-8cff-02b0a8d05811 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:33.156325 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6aa42b93-325b-456f-8cff-02b0a8d05811 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:33.156772 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6aa42b93-325b-456f-8cff-02b0a8d05811 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:33.185270 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6aa42b93-325b-456f-8cff-02b0a8d05811 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041525 May 10 21:16:33.185814 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 651/1267] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:33 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:33.454388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f9050ef5-11dc-4aaa-bb2e-b4684d4e253b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:33.455339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f9050ef5-11dc-4aaa-bb2e-b4684d4e253b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:33.461595 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f9050ef5-11dc-4aaa-bb2e-b4684d4e253b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:33.462039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f9050ef5-11dc-4aaa-bb2e-b4684d4e253b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:33.462789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f9050ef5-11dc-4aaa-bb2e-b4684d4e253b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:33.463251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f9050ef5-11dc-4aaa-bb2e-b4684d4e253b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:33.491306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f9050ef5-11dc-4aaa-bb2e-b4684d4e253b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041553 May 10 21:16:33.491844 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 617/1268] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:33 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:33.772397 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9ec5fdd1-5876-4c30-8e62-6a653c251abe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:33.773253 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-9ec5fdd1-5876-4c30-8e62-6a653c251abe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:33.779537 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9ec5fdd1-5876-4c30-8e62-6a653c251abe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:33.779984 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9ec5fdd1-5876-4c30-8e62-6a653c251abe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:33.780755 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9ec5fdd1-5876-4c30-8e62-6a653c251abe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:33.781197 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9ec5fdd1-5876-4c30-8e62-6a653c251abe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:33.811586 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9ec5fdd1-5876-4c30-8e62-6a653c251abe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043182 May 10 21:16:33.812132 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 652/1269] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:33 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:34.099138 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2ab7493e-e5ad-42c7-a912-b0bfa0ba6816 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:34.099789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2ab7493e-e5ad-42c7-a912-b0bfa0ba6816 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:34.105767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ab7493e-e5ad-42c7-a912-b0bfa0ba6816 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:34.106842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ab7493e-e5ad-42c7-a912-b0bfa0ba6816 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:34.107551 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ab7493e-e5ad-42c7-a912-b0bfa0ba6816 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:34.107989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ab7493e-e5ad-42c7-a912-b0bfa0ba6816 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:34.197280 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d3f5220f-9bc8-4c0c-b1be-cea78ce9a4e3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:34.198441 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d3f5220f-9bc8-4c0c-b1be-cea78ce9a4e3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:34.205660 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d3f5220f-9bc8-4c0c-b1be-cea78ce9a4e3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:34.206200 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d3f5220f-9bc8-4c0c-b1be-cea78ce9a4e3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:34.207089 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d3f5220f-9bc8-4c0c-b1be-cea78ce9a4e3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:34.207660 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d3f5220f-9bc8-4c0c-b1be-cea78ce9a4e3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:34.239909 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d3f5220f-9bc8-4c0c-b1be-cea78ce9a4e3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047020 May 10 21:16:34.240479 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 653/1270] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:34 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:16:34.246471 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2ab7493e-e5ad-42c7-a912-b0bfa0ba6816 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:34.253908 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2ab7493e-e5ad-42c7-a912-b0bfa0ba6816 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.158728 May 10 21:16:34.254454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 618/1271] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:34 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:34.503672 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-2aa73539-26ed-454a-bb19-0102fae4876c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:34.504513 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-2aa73539-26ed-454a-bb19-0102fae4876c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:34.510444 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2aa73539-26ed-454a-bb19-0102fae4876c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:34.510950 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2aa73539-26ed-454a-bb19-0102fae4876c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:34.511749 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2aa73539-26ed-454a-bb19-0102fae4876c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:34.512189 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2aa73539-26ed-454a-bb19-0102fae4876c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:34.541288 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-2aa73539-26ed-454a-bb19-0102fae4876c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041777 May 10 21:16:34.541830 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 654/1272] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:34 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:34.823701 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0dc72be9-ab84-4873-9ab6-5f826f90512d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:34.824566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0dc72be9-ab84-4873-9ab6-5f826f90512d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:34.831495 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0dc72be9-ab84-4873-9ab6-5f826f90512d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:34.831939 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0dc72be9-ab84-4873-9ab6-5f826f90512d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:34.832694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0dc72be9-ab84-4873-9ab6-5f826f90512d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:34.833126 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0dc72be9-ab84-4873-9ab6-5f826f90512d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:34.860767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0dc72be9-ab84-4873-9ab6-5f826f90512d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041171 May 10 21:16:34.861307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 619/1273] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:34 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:35.251768 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-ca4d5168-b07f-44da-bb18-65c7fb4eb302 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:35.252699 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-ca4d5168-b07f-44da-bb18-65c7fb4eb302 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:35.259002 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ca4d5168-b07f-44da-bb18-65c7fb4eb302 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:35.259483 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ca4d5168-b07f-44da-bb18-65c7fb4eb302 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:35.260247 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ca4d5168-b07f-44da-bb18-65c7fb4eb302 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:35.260687 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ca4d5168-b07f-44da-bb18-65c7fb4eb302 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:35.271795 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0ee6a79b-493b-42ae-a103-a0564d498c7b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:35.272408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0ee6a79b-493b-42ae-a103-a0564d498c7b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:35.278411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ee6a79b-493b-42ae-a103-a0564d498c7b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:35.278972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ee6a79b-493b-42ae-a103-a0564d498c7b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:35.279782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ee6a79b-493b-42ae-a103-a0564d498c7b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:35.280226 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ee6a79b-493b-42ae-a103-a0564d498c7b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:35.290617 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-ca4d5168-b07f-44da-bb18-65c7fb4eb302 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043499 May 10 21:16:35.291195 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 655/1274] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:35 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:35.409532 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0ee6a79b-493b-42ae-a103-a0564d498c7b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:35.416905 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0ee6a79b-493b-42ae-a103-a0564d498c7b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.148865 May 10 21:16:35.417456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 620/1275] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:35 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:16:35.553053 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c5688c12-6a58-4af0-a8df-051e3b574958 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:35.553896 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c5688c12-6a58-4af0-a8df-051e3b574958 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:35.560035 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c5688c12-6a58-4af0-a8df-051e3b574958 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:35.560478 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c5688c12-6a58-4af0-a8df-051e3b574958 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:35.561252 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c5688c12-6a58-4af0-a8df-051e3b574958 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:35.561686 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c5688c12-6a58-4af0-a8df-051e3b574958 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:35.589694 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c5688c12-6a58-4af0-a8df-051e3b574958 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040752 May 10 21:16:35.590224 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 656/1276] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:35 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:35.872352 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a96cc705-ecd9-406f-9de4-ff22487920ad tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:35.873281 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a96cc705-ecd9-406f-9de4-ff22487920ad tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:35.879825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a96cc705-ecd9-406f-9de4-ff22487920ad tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:35.880276 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a96cc705-ecd9-406f-9de4-ff22487920ad tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:35.881041 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a96cc705-ecd9-406f-9de4-ff22487920ad tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:35.881478 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a96cc705-ecd9-406f-9de4-ff22487920ad tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:35.910848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a96cc705-ecd9-406f-9de4-ff22487920ad tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042500 May 10 21:16:35.911428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 621/1277] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:35 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:36.302013 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-efad55b0-d7e5-450a-b560-d44ab43e6dc3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:36.302971 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-efad55b0-d7e5-450a-b560-d44ab43e6dc3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:36.309300 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-efad55b0-d7e5-450a-b560-d44ab43e6dc3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:36.309810 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-efad55b0-d7e5-450a-b560-d44ab43e6dc3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:36.310579 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-efad55b0-d7e5-450a-b560-d44ab43e6dc3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:36.311019 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-efad55b0-d7e5-450a-b560-d44ab43e6dc3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:36.338985 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-efad55b0-d7e5-450a-b560-d44ab43e6dc3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041047 May 10 21:16:36.339563 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 657/1278] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:36 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:36.434616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-edaf3ea7-f0e2-4b89-8212-49641a36069b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:36.435289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-edaf3ea7-f0e2-4b89-8212-49641a36069b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:36.441198 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-edaf3ea7-f0e2-4b89-8212-49641a36069b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:36.441652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-edaf3ea7-f0e2-4b89-8212-49641a36069b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:36.442419 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-edaf3ea7-f0e2-4b89-8212-49641a36069b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:36.442859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-edaf3ea7-f0e2-4b89-8212-49641a36069b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:36.575635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-edaf3ea7-f0e2-4b89-8212-49641a36069b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:36.583045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-edaf3ea7-f0e2-4b89-8212-49641a36069b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.152390 May 10 21:16:36.583631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 622/1279] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:36 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:36.601845 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-bcf4cb7b-bc71-45be-9909-3ec93b4c1026 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:36.602778 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-bcf4cb7b-bc71-45be-9909-3ec93b4c1026 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:36.609569 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bcf4cb7b-bc71-45be-9909-3ec93b4c1026 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:36.610016 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bcf4cb7b-bc71-45be-9909-3ec93b4c1026 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:36.610782 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bcf4cb7b-bc71-45be-9909-3ec93b4c1026 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:36.611346 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-bcf4cb7b-bc71-45be-9909-3ec93b4c1026 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:36.640282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-bcf4cb7b-bc71-45be-9909-3ec93b4c1026 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042406 May 10 21:16:36.640824 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 658/1280] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:36 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:36.921943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ac40cb83-4700-42d0-bbd6-2f4b77a4e327 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:36.922871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ac40cb83-4700-42d0-bbd6-2f4b77a4e327 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:36.929217 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ac40cb83-4700-42d0-bbd6-2f4b77a4e327 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:36.929655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ac40cb83-4700-42d0-bbd6-2f4b77a4e327 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:36.930417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ac40cb83-4700-42d0-bbd6-2f4b77a4e327 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:36.930849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ac40cb83-4700-42d0-bbd6-2f4b77a4e327 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:36.960530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ac40cb83-4700-42d0-bbd6-2f4b77a4e327 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042556 May 10 21:16:36.961063 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 623/1281] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:36 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:37.350993 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-b7998e9d-12c5-437a-bf71-3d3ec16f08e6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:37.351968 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-b7998e9d-12c5-437a-bf71-3d3ec16f08e6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:37.358840 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b7998e9d-12c5-437a-bf71-3d3ec16f08e6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:37.359323 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b7998e9d-12c5-437a-bf71-3d3ec16f08e6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:37.360090 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b7998e9d-12c5-437a-bf71-3d3ec16f08e6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:37.360528 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b7998e9d-12c5-437a-bf71-3d3ec16f08e6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:37.388787 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-b7998e9d-12c5-437a-bf71-3d3ec16f08e6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041723 May 10 21:16:37.389312 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 659/1282] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:37 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:37.601211 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-361c0967-dbe6-433f-869e-6da105b713eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:37.601754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-361c0967-dbe6-433f-869e-6da105b713eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:37.608674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-361c0967-dbe6-433f-869e-6da105b713eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:37.609115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-361c0967-dbe6-433f-869e-6da105b713eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:37.609876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-361c0967-dbe6-433f-869e-6da105b713eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:37.610311 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-361c0967-dbe6-433f-869e-6da105b713eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:37.651958 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f196554d-47b9-42b1-b3c9-914d83e3baf6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:37.653423 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f196554d-47b9-42b1-b3c9-914d83e3baf6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:37.659566 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f196554d-47b9-42b1-b3c9-914d83e3baf6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:37.660020 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f196554d-47b9-42b1-b3c9-914d83e3baf6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:37.660794 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f196554d-47b9-42b1-b3c9-914d83e3baf6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:37.661233 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f196554d-47b9-42b1-b3c9-914d83e3baf6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:37.690766 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f196554d-47b9-42b1-b3c9-914d83e3baf6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042730 May 10 21:16:37.691356 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 660/1283] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:37 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:16:37.740943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-361c0967-dbe6-433f-869e-6da105b713eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:37.748712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-361c0967-dbe6-433f-869e-6da105b713eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151489 May 10 21:16:37.749264 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 624/1284] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:37 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:37.972466 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9dea8312-4cb4-4ff2-93fc-072be1e13a1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:37.973306 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-9dea8312-4cb4-4ff2-93fc-072be1e13a1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:37.979516 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9dea8312-4cb4-4ff2-93fc-072be1e13a1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:37.979959 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9dea8312-4cb4-4ff2-93fc-072be1e13a1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:37.980862 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9dea8312-4cb4-4ff2-93fc-072be1e13a1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:37.981429 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9dea8312-4cb4-4ff2-93fc-072be1e13a1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:38.015492 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9dea8312-4cb4-4ff2-93fc-072be1e13a1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046988 May 10 21:16:38.016034 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 661/1285] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:37 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:38.401105 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-faaeb57b-1cb5-4f89-912f-e44087197e8e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:38.402027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-faaeb57b-1cb5-4f89-912f-e44087197e8e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:38.408476 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-faaeb57b-1cb5-4f89-912f-e44087197e8e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:38.408918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-faaeb57b-1cb5-4f89-912f-e44087197e8e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:38.409669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-faaeb57b-1cb5-4f89-912f-e44087197e8e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:38.410100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-faaeb57b-1cb5-4f89-912f-e44087197e8e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:38.438599 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-faaeb57b-1cb5-4f89-912f-e44087197e8e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041484 May 10 21:16:38.439158 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 625/1286] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:38 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:38.703226 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-8e1fc338-9a1a-47c5-8002-3aa0a4986ab6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:38.704149 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-8e1fc338-9a1a-47c5-8002-3aa0a4986ab6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:38.710385 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8e1fc338-9a1a-47c5-8002-3aa0a4986ab6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:38.710828 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8e1fc338-9a1a-47c5-8002-3aa0a4986ab6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:38.711620 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8e1fc338-9a1a-47c5-8002-3aa0a4986ab6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:38.712055 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8e1fc338-9a1a-47c5-8002-3aa0a4986ab6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:38.740680 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-8e1fc338-9a1a-47c5-8002-3aa0a4986ab6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042071 May 10 21:16:38.741211 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 662/1287] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:38 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:38.764724 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f975229a-e8e3-4d59-98b0-413c2ccefacc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:38.765327 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f975229a-e8e3-4d59-98b0-413c2ccefacc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:38.771314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f975229a-e8e3-4d59-98b0-413c2ccefacc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:38.771766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f975229a-e8e3-4d59-98b0-413c2ccefacc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:38.772532 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f975229a-e8e3-4d59-98b0-413c2ccefacc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:38.772972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f975229a-e8e3-4d59-98b0-413c2ccefacc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:38.900201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f975229a-e8e3-4d59-98b0-413c2ccefacc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:38.907662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f975229a-e8e3-4d59-98b0-413c2ccefacc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.146789 May 10 21:16:38.908230 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 626/1288] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:38 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:39.027127 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-5800b666-5b5d-499a-84ef-ecfe4c64eee9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:39.028198 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5800b666-5b5d-499a-84ef-ecfe4c64eee9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:39.034055 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5800b666-5b5d-499a-84ef-ecfe4c64eee9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:39.034623 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5800b666-5b5d-499a-84ef-ecfe4c64eee9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:39.035568 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5800b666-5b5d-499a-84ef-ecfe4c64eee9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:39.035998 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5800b666-5b5d-499a-84ef-ecfe4c64eee9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:39.065445 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-5800b666-5b5d-499a-84ef-ecfe4c64eee9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042346 May 10 21:16:39.068724 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 663/1289] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:39 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:39.450925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e294ebb5-a3a8-4242-b60e-68a3de11c12a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:39.451887 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e294ebb5-a3a8-4242-b60e-68a3de11c12a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:39.458250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e294ebb5-a3a8-4242-b60e-68a3de11c12a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:39.458700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e294ebb5-a3a8-4242-b60e-68a3de11c12a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:39.459497 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e294ebb5-a3a8-4242-b60e-68a3de11c12a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:39.459937 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e294ebb5-a3a8-4242-b60e-68a3de11c12a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:39.489283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e294ebb5-a3a8-4242-b60e-68a3de11c12a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042975 May 10 21:16:39.489832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 627/1290] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:39 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:39.752675 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-0bdc21a8-ac0b-4a85-bf55-a29b7aa5f37e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:39.753524 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-0bdc21a8-ac0b-4a85-bf55-a29b7aa5f37e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:39.760015 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0bdc21a8-ac0b-4a85-bf55-a29b7aa5f37e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:39.760461 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0bdc21a8-ac0b-4a85-bf55-a29b7aa5f37e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:39.761228 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0bdc21a8-ac0b-4a85-bf55-a29b7aa5f37e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:39.761659 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0bdc21a8-ac0b-4a85-bf55-a29b7aa5f37e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:39.790665 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-0bdc21a8-ac0b-4a85-bf55-a29b7aa5f37e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042052 May 10 21:16:39.791221 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 664/1291] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:39 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:39.925052 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-558271fd-f905-431f-94bc-22a00d42ccdb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:39.925693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-558271fd-f905-431f-94bc-22a00d42ccdb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:39.931578 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-558271fd-f905-431f-94bc-22a00d42ccdb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:39.932030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-558271fd-f905-431f-94bc-22a00d42ccdb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:39.932791 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-558271fd-f905-431f-94bc-22a00d42ccdb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:39.933228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-558271fd-f905-431f-94bc-22a00d42ccdb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:40.066598 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-558271fd-f905-431f-94bc-22a00d42ccdb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:40.074608 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-558271fd-f905-431f-94bc-22a00d42ccdb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.153474 May 10 21:16:40.076055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 628/1292] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:39 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:40.078098 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6ebd0855-7c4e-4b81-bbc9-ea910226495a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:40.079034 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6ebd0855-7c4e-4b81-bbc9-ea910226495a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:40.085099 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6ebd0855-7c4e-4b81-bbc9-ea910226495a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:40.085553 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6ebd0855-7c4e-4b81-bbc9-ea910226495a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:40.086327 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6ebd0855-7c4e-4b81-bbc9-ea910226495a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:40.086772 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6ebd0855-7c4e-4b81-bbc9-ea910226495a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:40.114706 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6ebd0855-7c4e-4b81-bbc9-ea910226495a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041102 May 10 21:16:40.115274 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 665/1293] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:40 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:16:40.501399 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8dc47f6b-2c5c-487d-85f5-60157b17bfc6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:40.502328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8dc47f6b-2c5c-487d-85f5-60157b17bfc6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:40.508629 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8dc47f6b-2c5c-487d-85f5-60157b17bfc6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:40.509074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8dc47f6b-2c5c-487d-85f5-60157b17bfc6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:40.509837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8dc47f6b-2c5c-487d-85f5-60157b17bfc6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:40.510276 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8dc47f6b-2c5c-487d-85f5-60157b17bfc6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:40.538235 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8dc47f6b-2c5c-487d-85f5-60157b17bfc6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041295 May 10 21:16:40.538716 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 629/1294] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:40 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:40.802608 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-cf3fa1ab-69ff-48e9-afce-edfe5f25dd96 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:40.803493 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-cf3fa1ab-69ff-48e9-afce-edfe5f25dd96 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:40.810104 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cf3fa1ab-69ff-48e9-afce-edfe5f25dd96 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:40.810548 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cf3fa1ab-69ff-48e9-afce-edfe5f25dd96 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:40.811345 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cf3fa1ab-69ff-48e9-afce-edfe5f25dd96 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:40.811782 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cf3fa1ab-69ff-48e9-afce-edfe5f25dd96 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:40.839432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-cf3fa1ab-69ff-48e9-afce-edfe5f25dd96 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040908 May 10 21:16:40.839968 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 666/1295] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:40 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:41.092937 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f9c2a3b2-26ff-4f3d-a91e-f828a4541a75 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:41.093546 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f9c2a3b2-26ff-4f3d-a91e-f828a4541a75 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:41.099503 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f9c2a3b2-26ff-4f3d-a91e-f828a4541a75 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:41.099946 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f9c2a3b2-26ff-4f3d-a91e-f828a4541a75 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:41.100700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f9c2a3b2-26ff-4f3d-a91e-f828a4541a75 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:41.101132 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f9c2a3b2-26ff-4f3d-a91e-f828a4541a75 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:41.126349 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-7c7e714d-08df-4452-b642-a12504cd7925 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:41.127418 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-7c7e714d-08df-4452-b642-a12504cd7925 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:41.133860 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7c7e714d-08df-4452-b642-a12504cd7925 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:41.134403 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7c7e714d-08df-4452-b642-a12504cd7925 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:41.135312 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7c7e714d-08df-4452-b642-a12504cd7925 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:41.135835 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7c7e714d-08df-4452-b642-a12504cd7925 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:41.166808 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-7c7e714d-08df-4452-b642-a12504cd7925 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044764 May 10 21:16:41.167390 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 667/1296] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:41 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:16:41.231518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f9c2a3b2-26ff-4f3d-a91e-f828a4541a75 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:41.238847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f9c2a3b2-26ff-4f3d-a91e-f828a4541a75 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.150453 May 10 21:16:41.239428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 630/1297] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:41 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:41.549838 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-531f7dc4-d111-4b1d-81ef-ddcc31c1c68a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:41.550677 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-531f7dc4-d111-4b1d-81ef-ddcc31c1c68a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:41.556552 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-531f7dc4-d111-4b1d-81ef-ddcc31c1c68a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:41.556997 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-531f7dc4-d111-4b1d-81ef-ddcc31c1c68a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:41.557750 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-531f7dc4-d111-4b1d-81ef-ddcc31c1c68a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:41.558179 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-531f7dc4-d111-4b1d-81ef-ddcc31c1c68a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:41.587459 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-531f7dc4-d111-4b1d-81ef-ddcc31c1c68a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041583 May 10 21:16:41.587997 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 668/1298] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:41 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:41.851747 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-016bb103-62d1-4886-ba09-b0fa760ce6fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:41.852678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-016bb103-62d1-4886-ba09-b0fa760ce6fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:41.859626 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-016bb103-62d1-4886-ba09-b0fa760ce6fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:41.860077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-016bb103-62d1-4886-ba09-b0fa760ce6fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:41.860844 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-016bb103-62d1-4886-ba09-b0fa760ce6fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:41.861278 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-016bb103-62d1-4886-ba09-b0fa760ce6fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:41.889919 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-016bb103-62d1-4886-ba09-b0fa760ce6fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042184 May 10 21:16:41.890465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 631/1299] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:41 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:42.177955 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-84a94a54-8fa9-492b-981d-6a4c139e4d09 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:42.178939 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-84a94a54-8fa9-492b-981d-6a4c139e4d09 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:42.185835 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-84a94a54-8fa9-492b-981d-6a4c139e4d09 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:42.186278 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-84a94a54-8fa9-492b-981d-6a4c139e4d09 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:42.187038 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-84a94a54-8fa9-492b-981d-6a4c139e4d09 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:42.187501 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-84a94a54-8fa9-492b-981d-6a4c139e4d09 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:42.216698 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-84a94a54-8fa9-492b-981d-6a4c139e4d09 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042738 May 10 21:16:42.217236 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 669/1300] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:42 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:42.256092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6d2d1696-c62f-4abd-8f1d-5b76b1b69806 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:42.256696 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6d2d1696-c62f-4abd-8f1d-5b76b1b69806 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:42.263790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6d2d1696-c62f-4abd-8f1d-5b76b1b69806 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:42.264283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6d2d1696-c62f-4abd-8f1d-5b76b1b69806 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:42.265087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6d2d1696-c62f-4abd-8f1d-5b76b1b69806 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:42.265524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6d2d1696-c62f-4abd-8f1d-5b76b1b69806 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:42.396939 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6d2d1696-c62f-4abd-8f1d-5b76b1b69806 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:42.404555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6d2d1696-c62f-4abd-8f1d-5b76b1b69806 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.152351 May 10 21:16:42.405111 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 632/1301] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:42 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:42.599208 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-b9076ae4-e705-4dc4-b8d7-9123bfbb882c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:42.600100 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-b9076ae4-e705-4dc4-b8d7-9123bfbb882c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:42.606566 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b9076ae4-e705-4dc4-b8d7-9123bfbb882c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:42.607224 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b9076ae4-e705-4dc4-b8d7-9123bfbb882c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:42.607997 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b9076ae4-e705-4dc4-b8d7-9123bfbb882c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:42.608669 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b9076ae4-e705-4dc4-b8d7-9123bfbb882c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:42.636869 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-b9076ae4-e705-4dc4-b8d7-9123bfbb882c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041682 May 10 21:16:42.637698 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 670/1302] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:42 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:42.901720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c93f571c-aa5a-449d-a6d7-114ed5eaf882 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:42.902606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c93f571c-aa5a-449d-a6d7-114ed5eaf882 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:42.909670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c93f571c-aa5a-449d-a6d7-114ed5eaf882 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:42.910120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c93f571c-aa5a-449d-a6d7-114ed5eaf882 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:42.910891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c93f571c-aa5a-449d-a6d7-114ed5eaf882 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:42.911373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c93f571c-aa5a-449d-a6d7-114ed5eaf882 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:42.941158 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c93f571c-aa5a-449d-a6d7-114ed5eaf882 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043560 May 10 21:16:42.941706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 633/1303] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:42 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:43.228321 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-edacebc9-ba2c-424b-8f14-d0e6596132ec tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:43.229180 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-edacebc9-ba2c-424b-8f14-d0e6596132ec tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:43.235876 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-edacebc9-ba2c-424b-8f14-d0e6596132ec tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:43.236332 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-edacebc9-ba2c-424b-8f14-d0e6596132ec tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:43.237106 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-edacebc9-ba2c-424b-8f14-d0e6596132ec tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:43.237554 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-edacebc9-ba2c-424b-8f14-d0e6596132ec tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:43.266484 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-edacebc9-ba2c-424b-8f14-d0e6596132ec tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042195 May 10 21:16:43.267031 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 671/1304] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:43 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:43.421852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-39014261-c259-49fe-a403-19afd329105c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:43.422518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-39014261-c259-49fe-a403-19afd329105c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:43.428418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39014261-c259-49fe-a403-19afd329105c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:43.428863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39014261-c259-49fe-a403-19afd329105c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:43.429617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39014261-c259-49fe-a403-19afd329105c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:43.430084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39014261-c259-49fe-a403-19afd329105c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:43.557756 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-39014261-c259-49fe-a403-19afd329105c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:43.565415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-39014261-c259-49fe-a403-19afd329105c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.147547 May 10 21:16:43.565895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 634/1305] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:43 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:43.648427 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6693115d-cc9a-46d3-a43e-11e97acbe781 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:43.649398 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6693115d-cc9a-46d3-a43e-11e97acbe781 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:43.655929 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6693115d-cc9a-46d3-a43e-11e97acbe781 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:43.656378 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6693115d-cc9a-46d3-a43e-11e97acbe781 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:43.657146 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6693115d-cc9a-46d3-a43e-11e97acbe781 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:43.657589 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6693115d-cc9a-46d3-a43e-11e97acbe781 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:43.686690 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6693115d-cc9a-46d3-a43e-11e97acbe781 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042215 May 10 21:16:43.687261 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 672/1306] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:43 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:43.954083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2fc5458e-d38e-4475-a8e5-64d008896703 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:43.955004 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2fc5458e-d38e-4475-a8e5-64d008896703 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:43.961094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2fc5458e-d38e-4475-a8e5-64d008896703 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:43.961538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2fc5458e-d38e-4475-a8e5-64d008896703 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:43.962306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2fc5458e-d38e-4475-a8e5-64d008896703 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:43.962739 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2fc5458e-d38e-4475-a8e5-64d008896703 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:43.991281 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2fc5458e-d38e-4475-a8e5-64d008896703 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041797 May 10 21:16:43.991914 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 635/1307] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:43 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:44.277907 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-1d26187d-a0ea-48b5-bbc2-ad6d4ad612d6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:44.278861 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-1d26187d-a0ea-48b5-bbc2-ad6d4ad612d6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:44.285220 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1d26187d-a0ea-48b5-bbc2-ad6d4ad612d6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:44.285663 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1d26187d-a0ea-48b5-bbc2-ad6d4ad612d6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:44.286681 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1d26187d-a0ea-48b5-bbc2-ad6d4ad612d6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:44.286878 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1d26187d-a0ea-48b5-bbc2-ad6d4ad612d6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:44.316049 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-1d26187d-a0ea-48b5-bbc2-ad6d4ad612d6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042253 May 10 21:16:44.316590 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 673/1308] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:44 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:44.583859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ab5649a2-d58b-4411-bafd-4b739c72df2e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:44.584386 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ab5649a2-d58b-4411-bafd-4b739c72df2e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:44.590977 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab5649a2-d58b-4411-bafd-4b739c72df2e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:44.591492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab5649a2-d58b-4411-bafd-4b739c72df2e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:44.592261 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab5649a2-d58b-4411-bafd-4b739c72df2e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:44.592685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab5649a2-d58b-4411-bafd-4b739c72df2e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:44.698166 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a69a684e-91ee-4959-9913-f131e9aef265 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:44.699092 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a69a684e-91ee-4959-9913-f131e9aef265 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:44.706115 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a69a684e-91ee-4959-9913-f131e9aef265 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:44.706563 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a69a684e-91ee-4959-9913-f131e9aef265 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:44.707419 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a69a684e-91ee-4959-9913-f131e9aef265 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:44.707857 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a69a684e-91ee-4959-9913-f131e9aef265 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:44.721690 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ab5649a2-d58b-4411-bafd-4b739c72df2e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:44.728978 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ab5649a2-d58b-4411-bafd-4b739c72df2e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.149281 May 10 21:16:44.729545 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 636/1309] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:44 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:16:44.737550 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a69a684e-91ee-4959-9913-f131e9aef265 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043303 May 10 21:16:44.738099 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 674/1310] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:44 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:16:45.003804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f180263b-77de-47c8-b677-2c6b9ac5fdc0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:45.004728 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f180263b-77de-47c8-b677-2c6b9ac5fdc0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:45.010978 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f180263b-77de-47c8-b677-2c6b9ac5fdc0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:45.011455 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f180263b-77de-47c8-b677-2c6b9ac5fdc0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:45.012821 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f180263b-77de-47c8-b677-2c6b9ac5fdc0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:45.013809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f180263b-77de-47c8-b677-2c6b9ac5fdc0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:45.043069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f180263b-77de-47c8-b677-2c6b9ac5fdc0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043314 May 10 21:16:45.043856 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 637/1311] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:44 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:45.328527 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-1b629cb3-73c8-484b-9674-583dde3b7f04 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:45.329386 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-1b629cb3-73c8-484b-9674-583dde3b7f04 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:45.335783 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1b629cb3-73c8-484b-9674-583dde3b7f04 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:45.336229 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1b629cb3-73c8-484b-9674-583dde3b7f04 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:45.337002 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1b629cb3-73c8-484b-9674-583dde3b7f04 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:45.337442 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1b629cb3-73c8-484b-9674-583dde3b7f04 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:45.365846 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-1b629cb3-73c8-484b-9674-583dde3b7f04 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041996 May 10 21:16:45.366380 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 675/1312] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:45 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:45.748008 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b88a0e47-ea32-4df9-ab61-4d21f29a85b3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:45.748636 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b88a0e47-ea32-4df9-ab61-4d21f29a85b3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:45.749675 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e15e5834-88c4-4954-a64d-a9ba9f1449ab tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:45.750616 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e15e5834-88c4-4954-a64d-a9ba9f1449ab tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:45.755902 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b88a0e47-ea32-4df9-ab61-4d21f29a85b3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:45.756354 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b88a0e47-ea32-4df9-ab61-4d21f29a85b3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:45.756546 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e15e5834-88c4-4954-a64d-a9ba9f1449ab tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:45.757002 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e15e5834-88c4-4954-a64d-a9ba9f1449ab tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:45.757122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b88a0e47-ea32-4df9-ab61-4d21f29a85b3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:45.757625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b88a0e47-ea32-4df9-ab61-4d21f29a85b3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:45.757787 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e15e5834-88c4-4954-a64d-a9ba9f1449ab tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:45.758230 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e15e5834-88c4-4954-a64d-a9ba9f1449ab tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:45.787215 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e15e5834-88c4-4954-a64d-a9ba9f1449ab tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042131 May 10 21:16:45.787986 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 676/1313] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:45 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:16:45.889919 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b88a0e47-ea32-4df9-ab61-4d21f29a85b3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:45.897153 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b88a0e47-ea32-4df9-ab61-4d21f29a85b3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.154221 May 10 21:16:45.897714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 638/1314] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:45 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:46.055798 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d428713f-9b52-4eeb-b143-50739737e492 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:46.062015 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d428713f-9b52-4eeb-b143-50739737e492 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:46.063250 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d428713f-9b52-4eeb-b143-50739737e492 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:46.063698 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d428713f-9b52-4eeb-b143-50739737e492 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:46.064468 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d428713f-9b52-4eeb-b143-50739737e492 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:46.065207 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d428713f-9b52-4eeb-b143-50739737e492 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:46.095194 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d428713f-9b52-4eeb-b143-50739737e492 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044374 May 10 21:16:46.095742 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 677/1315] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:46 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:46.377515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-87ccf17c-d7e0-419c-af4e-49a5f037f4c7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:46.378460 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-87ccf17c-d7e0-419c-af4e-49a5f037f4c7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:46.384865 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87ccf17c-d7e0-419c-af4e-49a5f037f4c7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:46.385313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87ccf17c-d7e0-419c-af4e-49a5f037f4c7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:46.386081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87ccf17c-d7e0-419c-af4e-49a5f037f4c7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:46.386515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87ccf17c-d7e0-419c-af4e-49a5f037f4c7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:46.416980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-87ccf17c-d7e0-419c-af4e-49a5f037f4c7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043401 May 10 21:16:46.417528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 639/1316] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:46 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:46.798729 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a7fa8971-a84d-4d66-aff8-627772ecc6a3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:46.799727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a7fa8971-a84d-4d66-aff8-627772ecc6a3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:46.806071 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a7fa8971-a84d-4d66-aff8-627772ecc6a3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:46.806519 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a7fa8971-a84d-4d66-aff8-627772ecc6a3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:46.807325 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a7fa8971-a84d-4d66-aff8-627772ecc6a3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:46.807762 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a7fa8971-a84d-4d66-aff8-627772ecc6a3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:46.837046 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a7fa8971-a84d-4d66-aff8-627772ecc6a3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042280 May 10 21:16:46.837592 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 678/1317] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:46 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:46.914864 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-df745b98-eca3-4612-b1f3-7913bf96da94 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:46.915456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-df745b98-eca3-4612-b1f3-7913bf96da94 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:46.921318 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df745b98-eca3-4612-b1f3-7913bf96da94 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:46.921759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df745b98-eca3-4612-b1f3-7913bf96da94 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:46.922513 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df745b98-eca3-4612-b1f3-7913bf96da94 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:46.922945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df745b98-eca3-4612-b1f3-7913bf96da94 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:47.050549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-df745b98-eca3-4612-b1f3-7913bf96da94 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:47.057857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-df745b98-eca3-4612-b1f3-7913bf96da94 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.146890 May 10 21:16:47.058412 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 640/1318] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:46 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:47.106625 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-58ad013f-188a-48d4-8e23-541eb16bc21a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:47.107643 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-58ad013f-188a-48d4-8e23-541eb16bc21a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:47.113433 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-58ad013f-188a-48d4-8e23-541eb16bc21a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:47.113878 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-58ad013f-188a-48d4-8e23-541eb16bc21a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:47.114635 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-58ad013f-188a-48d4-8e23-541eb16bc21a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:47.115067 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-58ad013f-188a-48d4-8e23-541eb16bc21a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:47.143844 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-58ad013f-188a-48d4-8e23-541eb16bc21a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041757 May 10 21:16:47.144384 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 679/1319] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:47 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:47.429050 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f98319cf-485d-4dc9-a71f-5e69a77041c9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:47.429975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f98319cf-485d-4dc9-a71f-5e69a77041c9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:47.436343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f98319cf-485d-4dc9-a71f-5e69a77041c9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:47.436785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f98319cf-485d-4dc9-a71f-5e69a77041c9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:47.437538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f98319cf-485d-4dc9-a71f-5e69a77041c9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:47.438000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f98319cf-485d-4dc9-a71f-5e69a77041c9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:47.466430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f98319cf-485d-4dc9-a71f-5e69a77041c9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041483 May 10 21:16:47.466986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 641/1320] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:47 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:47.848566 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9ddd0c2d-5b12-4a56-b944-7cdb48e71a7d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:47.849490 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-9ddd0c2d-5b12-4a56-b944-7cdb48e71a7d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:47.855762 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9ddd0c2d-5b12-4a56-b944-7cdb48e71a7d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:47.856280 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9ddd0c2d-5b12-4a56-b944-7cdb48e71a7d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:47.857036 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9ddd0c2d-5b12-4a56-b944-7cdb48e71a7d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:47.857465 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9ddd0c2d-5b12-4a56-b944-7cdb48e71a7d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:47.885726 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9ddd0c2d-5b12-4a56-b944-7cdb48e71a7d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041070 May 10 21:16:47.886271 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 680/1321] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:47 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:48.075954 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2c4bcff7-6d01-45ed-862c-d79b7de69591 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:48.076566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2c4bcff7-6d01-45ed-862c-d79b7de69591 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:48.082512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c4bcff7-6d01-45ed-862c-d79b7de69591 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:48.082994 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c4bcff7-6d01-45ed-862c-d79b7de69591 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:48.083792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c4bcff7-6d01-45ed-862c-d79b7de69591 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:48.084227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c4bcff7-6d01-45ed-862c-d79b7de69591 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:48.155914 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-7112320e-c235-484a-b730-b57060287ef8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:48.156766 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-7112320e-c235-484a-b730-b57060287ef8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:48.162651 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7112320e-c235-484a-b730-b57060287ef8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:48.163108 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7112320e-c235-484a-b730-b57060287ef8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:48.163919 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7112320e-c235-484a-b730-b57060287ef8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:48.164766 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7112320e-c235-484a-b730-b57060287ef8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:48.193977 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-7112320e-c235-484a-b730-b57060287ef8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042074 May 10 21:16:48.194545 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 681/1322] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:48 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:16:48.218423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2c4bcff7-6d01-45ed-862c-d79b7de69591 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:48.225725 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2c4bcff7-6d01-45ed-862c-d79b7de69591 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.154312 May 10 21:16:48.226273 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 642/1323] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:48 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:48.477945 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-2f61ba50-236c-4582-bba5-afdb3e6f96a5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:48.478825 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-2f61ba50-236c-4582-bba5-afdb3e6f96a5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:48.485445 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2f61ba50-236c-4582-bba5-afdb3e6f96a5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:48.485893 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2f61ba50-236c-4582-bba5-afdb3e6f96a5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:48.486654 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2f61ba50-236c-4582-bba5-afdb3e6f96a5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:48.487091 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2f61ba50-236c-4582-bba5-afdb3e6f96a5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:48.515070 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-2f61ba50-236c-4582-bba5-afdb3e6f96a5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041140 May 10 21:16:48.515637 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 682/1324] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:48 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:48.897758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-eac64bc5-7194-4287-bd07-8b4e35e3cb41 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:48.898681 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-eac64bc5-7194-4287-bd07-8b4e35e3cb41 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:48.905777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eac64bc5-7194-4287-bd07-8b4e35e3cb41 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:48.906215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eac64bc5-7194-4287-bd07-8b4e35e3cb41 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:48.906973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eac64bc5-7194-4287-bd07-8b4e35e3cb41 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:48.907440 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eac64bc5-7194-4287-bd07-8b4e35e3cb41 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:48.936455 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-eac64bc5-7194-4287-bd07-8b4e35e3cb41 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042610 May 10 21:16:48.937015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 643/1325] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:48 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:16:49.206480 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-8c8047c7-d5ae-43b4-b31f-f82f4d30e0f3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:49.207375 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-8c8047c7-d5ae-43b4-b31f-f82f4d30e0f3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:49.213858 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8c8047c7-d5ae-43b4-b31f-f82f4d30e0f3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:49.214296 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8c8047c7-d5ae-43b4-b31f-f82f4d30e0f3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:49.215049 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8c8047c7-d5ae-43b4-b31f-f82f4d30e0f3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:49.215563 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8c8047c7-d5ae-43b4-b31f-f82f4d30e0f3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:49.241923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5f60b022-d195-42f5-b807-1a19a5ee649c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:49.243231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5f60b022-d195-42f5-b807-1a19a5ee649c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:49.244338 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-8c8047c7-d5ae-43b4-b31f-f82f4d30e0f3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042001 May 10 21:16:49.244874 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 683/1326] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:49 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:49.249886 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f60b022-d195-42f5-b807-1a19a5ee649c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:49.250343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f60b022-d195-42f5-b807-1a19a5ee649c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:49.251159 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f60b022-d195-42f5-b807-1a19a5ee649c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:49.251630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f60b022-d195-42f5-b807-1a19a5ee649c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:49.379724 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5f60b022-d195-42f5-b807-1a19a5ee649c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:49.386959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5f60b022-d195-42f5-b807-1a19a5ee649c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.149134 May 10 21:16:49.387709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 644/1327] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:49 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:16:49.526946 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-204da7d3-4ffc-4094-987e-db86e801f044 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:49.527893 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-204da7d3-4ffc-4094-987e-db86e801f044 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:49.533722 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-204da7d3-4ffc-4094-987e-db86e801f044 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:49.534163 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-204da7d3-4ffc-4094-987e-db86e801f044 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:49.534918 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-204da7d3-4ffc-4094-987e-db86e801f044 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:49.535379 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-204da7d3-4ffc-4094-987e-db86e801f044 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:49.564362 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-204da7d3-4ffc-4094-987e-db86e801f044 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041413 May 10 21:16:49.564911 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 684/1328] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:49 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:49.948188 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5eb6f214-1a21-48cc-8b02-b5b8256f62fd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:49.949128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5eb6f214-1a21-48cc-8b02-b5b8256f62fd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:49.955995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5eb6f214-1a21-48cc-8b02-b5b8256f62fd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:49.956448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5eb6f214-1a21-48cc-8b02-b5b8256f62fd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:49.957219 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5eb6f214-1a21-48cc-8b02-b5b8256f62fd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:49.957664 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5eb6f214-1a21-48cc-8b02-b5b8256f62fd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:49.986288 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5eb6f214-1a21-48cc-8b02-b5b8256f62fd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042050 May 10 21:16:49.986845 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 645/1329] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:49 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:50.256597 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-b6b4a53b-e663-485e-9893-e6ece68ab3ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:50.257458 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-b6b4a53b-e663-485e-9893-e6ece68ab3ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:50.263949 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b6b4a53b-e663-485e-9893-e6ece68ab3ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:50.264401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b6b4a53b-e663-485e-9893-e6ece68ab3ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:50.265169 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b6b4a53b-e663-485e-9893-e6ece68ab3ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:50.265612 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b6b4a53b-e663-485e-9893-e6ece68ab3ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:50.294642 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-b6b4a53b-e663-485e-9893-e6ece68ab3ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041826 May 10 21:16:50.295212 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 685/1330] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:50 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:50.404091 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1eb7e398-2f7a-4038-9438-5b9d249c486b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:50.404719 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1eb7e398-2f7a-4038-9438-5b9d249c486b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:50.410654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1eb7e398-2f7a-4038-9438-5b9d249c486b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:50.411092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1eb7e398-2f7a-4038-9438-5b9d249c486b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:50.411933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1eb7e398-2f7a-4038-9438-5b9d249c486b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:50.412411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1eb7e398-2f7a-4038-9438-5b9d249c486b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:50.544779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1eb7e398-2f7a-4038-9438-5b9d249c486b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:50.552810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1eb7e398-2f7a-4038-9438-5b9d249c486b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.153079 May 10 21:16:50.553373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 646/1331] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:50 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:50.575414 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-5c260db8-b10f-4537-9b88-875715f8fd6f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:50.576347 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5c260db8-b10f-4537-9b88-875715f8fd6f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:50.582129 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5c260db8-b10f-4537-9b88-875715f8fd6f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:50.582583 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5c260db8-b10f-4537-9b88-875715f8fd6f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:50.583369 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5c260db8-b10f-4537-9b88-875715f8fd6f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:50.583808 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5c260db8-b10f-4537-9b88-875715f8fd6f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:50.613449 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-5c260db8-b10f-4537-9b88-875715f8fd6f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042063 May 10 21:16:50.614005 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 686/1332] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:50 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:50.998077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4e72d17a-b836-46e3-97bc-9f87e51b3941 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:50.999012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4e72d17a-b836-46e3-97bc-9f87e51b3941 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:51.005327 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4e72d17a-b836-46e3-97bc-9f87e51b3941 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:51.005876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4e72d17a-b836-46e3-97bc-9f87e51b3941 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:51.006641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4e72d17a-b836-46e3-97bc-9f87e51b3941 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:51.007136 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4e72d17a-b836-46e3-97bc-9f87e51b3941 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:51.036332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4e72d17a-b836-46e3-97bc-9f87e51b3941 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042401 May 10 21:16:51.036871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 647/1333] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:50 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:51.306283 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d9a06047-52e1-4fd3-bf70-115b07725e03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:51.307194 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d9a06047-52e1-4fd3-bf70-115b07725e03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:51.314125 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d9a06047-52e1-4fd3-bf70-115b07725e03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:51.314577 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d9a06047-52e1-4fd3-bf70-115b07725e03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:51.315369 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d9a06047-52e1-4fd3-bf70-115b07725e03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:51.315813 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d9a06047-52e1-4fd3-bf70-115b07725e03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:51.344658 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d9a06047-52e1-4fd3-bf70-115b07725e03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042442 May 10 21:16:51.345197 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 687/1334] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:51 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:51.570186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e1de51bb-5664-4ce2-8d04-fb14e940533a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:51.570822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e1de51bb-5664-4ce2-8d04-fb14e940533a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:51.576892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e1de51bb-5664-4ce2-8d04-fb14e940533a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:51.577336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e1de51bb-5664-4ce2-8d04-fb14e940533a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:51.578091 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e1de51bb-5664-4ce2-8d04-fb14e940533a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:51.578522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e1de51bb-5664-4ce2-8d04-fb14e940533a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:51.625772 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-443abcf2-fa5b-4619-b0f1-7b4db8b810e8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:51.626694 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-443abcf2-fa5b-4619-b0f1-7b4db8b810e8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:51.632529 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-443abcf2-fa5b-4619-b0f1-7b4db8b810e8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:51.632972 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-443abcf2-fa5b-4619-b0f1-7b4db8b810e8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:51.633727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-443abcf2-fa5b-4619-b0f1-7b4db8b810e8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:51.634157 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-443abcf2-fa5b-4619-b0f1-7b4db8b810e8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:51.662912 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-443abcf2-fa5b-4619-b0f1-7b4db8b810e8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041693 May 10 21:16:51.663491 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 688/1335] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:51 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:16:51.707146 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e1de51bb-5664-4ce2-8d04-fb14e940533a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:51.714505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e1de51bb-5664-4ce2-8d04-fb14e940533a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.148498 May 10 21:16:51.715060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 648/1336] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:51 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:52.048298 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-2b2acba6-9120-472d-8095-b0483e54e142 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:52.049261 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-2b2acba6-9120-472d-8095-b0483e54e142 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:52.055704 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2b2acba6-9120-472d-8095-b0483e54e142 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:52.056221 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2b2acba6-9120-472d-8095-b0483e54e142 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:52.057007 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2b2acba6-9120-472d-8095-b0483e54e142 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:52.057448 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2b2acba6-9120-472d-8095-b0483e54e142 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:52.089977 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-2b2acba6-9120-472d-8095-b0483e54e142 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046402 May 10 21:16:52.091202 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 689/1337] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:52 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:52.356524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3e6043b2-07eb-4a94-9728-6d1484f4677a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:52.357455 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3e6043b2-07eb-4a94-9728-6d1484f4677a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:52.363879 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3e6043b2-07eb-4a94-9728-6d1484f4677a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:52.364330 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3e6043b2-07eb-4a94-9728-6d1484f4677a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:52.365099 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3e6043b2-07eb-4a94-9728-6d1484f4677a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:52.365536 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3e6043b2-07eb-4a94-9728-6d1484f4677a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:52.393920 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3e6043b2-07eb-4a94-9728-6d1484f4677a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041443 May 10 21:16:52.394457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 649/1338] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:52 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:16:52.674611 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-77a93b3d-2a79-4e2f-83dd-92afb19a3529 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:52.675578 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-77a93b3d-2a79-4e2f-83dd-92afb19a3529 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:52.681874 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-77a93b3d-2a79-4e2f-83dd-92afb19a3529 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:52.682354 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-77a93b3d-2a79-4e2f-83dd-92afb19a3529 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:52.683141 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-77a93b3d-2a79-4e2f-83dd-92afb19a3529 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:52.683595 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-77a93b3d-2a79-4e2f-83dd-92afb19a3529 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:52.712847 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-77a93b3d-2a79-4e2f-83dd-92afb19a3529 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042233 May 10 21:16:52.713401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 690/1339] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:52 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:16:52.731277 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-238fb73b-bb7a-4827-a5cb-827a78ab1cdb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:52.731915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-238fb73b-bb7a-4827-a5cb-827a78ab1cdb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:52.737771 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-238fb73b-bb7a-4827-a5cb-827a78ab1cdb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:52.738211 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-238fb73b-bb7a-4827-a5cb-827a78ab1cdb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:52.738963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-238fb73b-bb7a-4827-a5cb-827a78ab1cdb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:52.739427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-238fb73b-bb7a-4827-a5cb-827a78ab1cdb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:52.866890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-238fb73b-bb7a-4827-a5cb-827a78ab1cdb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:52.874690 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-238fb73b-bb7a-4827-a5cb-827a78ab1cdb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.147273 May 10 21:16:52.875275 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 650/1340] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:52 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:53.103039 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-2c0d246f-a5bf-4b52-acbe-9cb789ca2f04 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:53.103981 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-2c0d246f-a5bf-4b52-acbe-9cb789ca2f04 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:53.110330 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2c0d246f-a5bf-4b52-acbe-9cb789ca2f04 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:53.110775 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2c0d246f-a5bf-4b52-acbe-9cb789ca2f04 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:53.111557 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2c0d246f-a5bf-4b52-acbe-9cb789ca2f04 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:53.111991 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2c0d246f-a5bf-4b52-acbe-9cb789ca2f04 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:53.140482 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-2c0d246f-a5bf-4b52-acbe-9cb789ca2f04 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041371 May 10 21:16:53.140944 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 691/1341] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:53 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:53.405815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3ca38837-1165-4062-9a49-cf38e395cef7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:53.406706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3ca38837-1165-4062-9a49-cf38e395cef7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:53.413120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ca38837-1165-4062-9a49-cf38e395cef7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:53.413573 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ca38837-1165-4062-9a49-cf38e395cef7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:53.414343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ca38837-1165-4062-9a49-cf38e395cef7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:53.414790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ca38837-1165-4062-9a49-cf38e395cef7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:53.444786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3ca38837-1165-4062-9a49-cf38e395cef7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043621 May 10 21:16:53.445325 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 651/1342] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:53 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:53.724894 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-355a7acc-74e2-47d8-83b2-1572db4e48cc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:53.725747 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-355a7acc-74e2-47d8-83b2-1572db4e48cc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:53.732548 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-355a7acc-74e2-47d8-83b2-1572db4e48cc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:53.733003 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-355a7acc-74e2-47d8-83b2-1572db4e48cc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:53.733765 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-355a7acc-74e2-47d8-83b2-1572db4e48cc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:53.734202 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-355a7acc-74e2-47d8-83b2-1572db4e48cc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:53.763716 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-355a7acc-74e2-47d8-83b2-1572db4e48cc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041812 May 10 21:16:53.764252 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 692/1343] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:53 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:53.892132 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d2b25984-f8a3-47c2-9855-3fa44310fc21 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:53.892749 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d2b25984-f8a3-47c2-9855-3fa44310fc21 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:53.898772 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2b25984-f8a3-47c2-9855-3fa44310fc21 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:53.899259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2b25984-f8a3-47c2-9855-3fa44310fc21 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:53.900026 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2b25984-f8a3-47c2-9855-3fa44310fc21 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:53.900461 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2b25984-f8a3-47c2-9855-3fa44310fc21 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:54.031660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d2b25984-f8a3-47c2-9855-3fa44310fc21 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:54.039015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d2b25984-f8a3-47c2-9855-3fa44310fc21 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.150708 May 10 21:16:54.039607 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 652/1344] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:53 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:54.152017 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-5b505b62-21db-49e7-b6f2-b55b41787baa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:54.153142 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5b505b62-21db-49e7-b6f2-b55b41787baa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:54.159179 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5b505b62-21db-49e7-b6f2-b55b41787baa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:54.159625 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5b505b62-21db-49e7-b6f2-b55b41787baa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:54.160378 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5b505b62-21db-49e7-b6f2-b55b41787baa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:54.160817 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5b505b62-21db-49e7-b6f2-b55b41787baa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:54.188876 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-5b505b62-21db-49e7-b6f2-b55b41787baa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040858 May 10 21:16:54.189407 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 693/1345] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:54 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:54.457055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6a87b42c-8695-4f7a-98ad-f9b1046c1085 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:54.457975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6a87b42c-8695-4f7a-98ad-f9b1046c1085 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:54.464269 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a87b42c-8695-4f7a-98ad-f9b1046c1085 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:54.464714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a87b42c-8695-4f7a-98ad-f9b1046c1085 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:54.465541 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a87b42c-8695-4f7a-98ad-f9b1046c1085 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:54.466005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a87b42c-8695-4f7a-98ad-f9b1046c1085 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:54.494251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6a87b42c-8695-4f7a-98ad-f9b1046c1085 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041137 May 10 21:16:54.494793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 653/1346] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:54 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:54.775218 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-2fa8dacb-8950-4ad7-b857-69b4af527f48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:54.776139 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-2fa8dacb-8950-4ad7-b857-69b4af527f48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:54.782576 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2fa8dacb-8950-4ad7-b857-69b4af527f48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:54.787337 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2fa8dacb-8950-4ad7-b857-69b4af527f48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:54.787337 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2fa8dacb-8950-4ad7-b857-69b4af527f48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:54.787337 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2fa8dacb-8950-4ad7-b857-69b4af527f48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:54.813398 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-2fa8dacb-8950-4ad7-b857-69b4af527f48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042157 May 10 21:16:54.813937 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 694/1347] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:54 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:55.056921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2d9077e2-a20e-450c-ac77-ce73894fb80e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:55.057478 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2d9077e2-a20e-450c-ac77-ce73894fb80e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:55.063539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d9077e2-a20e-450c-ac77-ce73894fb80e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:55.063990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d9077e2-a20e-450c-ac77-ce73894fb80e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:55.064760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d9077e2-a20e-450c-ac77-ce73894fb80e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:55.065196 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d9077e2-a20e-450c-ac77-ce73894fb80e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:55.191624 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2d9077e2-a20e-450c-ac77-ce73894fb80e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:55.199224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2d9077e2-a20e-450c-ac77-ce73894fb80e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.146231 May 10 21:16:55.200300 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 654/1348] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:55 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:55.201148 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-8a8d5035-9c40-4eeb-99f5-dfd779832319 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:55.202062 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-8a8d5035-9c40-4eeb-99f5-dfd779832319 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:55.207910 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8a8d5035-9c40-4eeb-99f5-dfd779832319 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:55.208350 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8a8d5035-9c40-4eeb-99f5-dfd779832319 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:55.209107 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8a8d5035-9c40-4eeb-99f5-dfd779832319 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:55.209539 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8a8d5035-9c40-4eeb-99f5-dfd779832319 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:55.238125 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-8a8d5035-9c40-4eeb-99f5-dfd779832319 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041616 May 10 21:16:55.238664 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 695/1349] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:55 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:16:55.506771 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6e54bd75-06c0-4421-ab6b-3e4e86c8dc34 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:55.507728 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6e54bd75-06c0-4421-ab6b-3e4e86c8dc34 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:55.514528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6e54bd75-06c0-4421-ab6b-3e4e86c8dc34 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:55.514980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6e54bd75-06c0-4421-ab6b-3e4e86c8dc34 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:55.515790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6e54bd75-06c0-4421-ab6b-3e4e86c8dc34 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:55.516234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6e54bd75-06c0-4421-ab6b-3e4e86c8dc34 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:55.544840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6e54bd75-06c0-4421-ab6b-3e4e86c8dc34 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042036 May 10 21:16:55.545383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 655/1350] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:55 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:55.826326 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c49f3fbb-2839-4644-bcfe-91dc27835535 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:55.826887 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c49f3fbb-2839-4644-bcfe-91dc27835535 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:55.833207 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c49f3fbb-2839-4644-bcfe-91dc27835535 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:55.833648 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c49f3fbb-2839-4644-bcfe-91dc27835535 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:55.834409 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c49f3fbb-2839-4644-bcfe-91dc27835535 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:55.834841 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c49f3fbb-2839-4644-bcfe-91dc27835535 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:55.862829 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c49f3fbb-2839-4644-bcfe-91dc27835535 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041601 May 10 21:16:55.863410 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 696/1351] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:55 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:56.217563 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-12b4f040-e9ce-4a03-b1c6-c5c52921e44f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:56.218179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-12b4f040-e9ce-4a03-b1c6-c5c52921e44f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:56.224088 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-12b4f040-e9ce-4a03-b1c6-c5c52921e44f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:56.224538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-12b4f040-e9ce-4a03-b1c6-c5c52921e44f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:56.225339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-12b4f040-e9ce-4a03-b1c6-c5c52921e44f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:56.225776 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-12b4f040-e9ce-4a03-b1c6-c5c52921e44f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:56.250342 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-4a7f4d8b-1938-4363-93e0-549c5368116b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:56.251352 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-4a7f4d8b-1938-4363-93e0-549c5368116b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:56.257446 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4a7f4d8b-1938-4363-93e0-549c5368116b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:56.257912 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4a7f4d8b-1938-4363-93e0-549c5368116b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:56.258714 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4a7f4d8b-1938-4363-93e0-549c5368116b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:56.259206 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4a7f4d8b-1938-4363-93e0-549c5368116b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:56.288832 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-4a7f4d8b-1938-4363-93e0-549c5368116b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043168 May 10 21:16:56.289389 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 697/1352] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:56 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:16:56.362360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-12b4f040-e9ce-4a03-b1c6-c5c52921e44f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:56.369925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-12b4f040-e9ce-4a03-b1c6-c5c52921e44f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.156984 May 10 21:16:56.370487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 656/1353] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:56 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:56.555753 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-5507cc0b-14e5-4e37-91ca-c713c0918fc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:56.556600 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5507cc0b-14e5-4e37-91ca-c713c0918fc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:56.563182 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5507cc0b-14e5-4e37-91ca-c713c0918fc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:56.563636 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5507cc0b-14e5-4e37-91ca-c713c0918fc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:56.564400 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5507cc0b-14e5-4e37-91ca-c713c0918fc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:56.564839 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5507cc0b-14e5-4e37-91ca-c713c0918fc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:56.593663 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-5507cc0b-14e5-4e37-91ca-c713c0918fc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041926 May 10 21:16:56.594207 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 698/1354] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:56 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:56.874339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ebeb10ef-6785-45ca-996a-9c7339c38f7e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:56.875449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ebeb10ef-6785-45ca-996a-9c7339c38f7e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:56.881760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ebeb10ef-6785-45ca-996a-9c7339c38f7e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:56.882211 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ebeb10ef-6785-45ca-996a-9c7339c38f7e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:56.882976 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ebeb10ef-6785-45ca-996a-9c7339c38f7e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:56.883449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ebeb10ef-6785-45ca-996a-9c7339c38f7e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:56.913710 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ebeb10ef-6785-45ca-996a-9c7339c38f7e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043321 May 10 21:16:56.914263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 657/1355] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:56 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:57.300560 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f597e0f3-bafe-4a4a-a7d3-ebc30cafde02 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:57.301438 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f597e0f3-bafe-4a4a-a7d3-ebc30cafde02 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:57.307700 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f597e0f3-bafe-4a4a-a7d3-ebc30cafde02 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:57.308146 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f597e0f3-bafe-4a4a-a7d3-ebc30cafde02 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:57.308900 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f597e0f3-bafe-4a4a-a7d3-ebc30cafde02 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:57.310023 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f597e0f3-bafe-4a4a-a7d3-ebc30cafde02 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:57.338663 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f597e0f3-bafe-4a4a-a7d3-ebc30cafde02 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042081 May 10 21:16:57.339215 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 699/1356] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:57 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:57.486241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1bb330a5-5dd5-4532-9750-bf06149f6719 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:57.486906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1bb330a5-5dd5-4532-9750-bf06149f6719 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:57.492799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1bb330a5-5dd5-4532-9750-bf06149f6719 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:57.493249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1bb330a5-5dd5-4532-9750-bf06149f6719 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:57.494017 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1bb330a5-5dd5-4532-9750-bf06149f6719 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:57.494464 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1bb330a5-5dd5-4532-9750-bf06149f6719 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:57.605635 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-5512f198-90f4-40ed-b86e-c311761cdcda tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:57.607222 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5512f198-90f4-40ed-b86e-c311761cdcda tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:57.613163 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5512f198-90f4-40ed-b86e-c311761cdcda tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:57.613618 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5512f198-90f4-40ed-b86e-c311761cdcda tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:57.614402 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5512f198-90f4-40ed-b86e-c311761cdcda tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:57.614842 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5512f198-90f4-40ed-b86e-c311761cdcda tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:57.628594 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1bb330a5-5dd5-4532-9750-bf06149f6719 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:57.635950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1bb330a5-5dd5-4532-9750-bf06149f6719 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.252865 May 10 21:16:57.636768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 658/1357] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:57 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:16:57.644296 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-5512f198-90f4-40ed-b86e-c311761cdcda tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042814 May 10 21:16:57.644847 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 700/1358] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:57 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:16:57.925884 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-90222cbd-3f22-4dd4-a75f-07e136fc44b4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:57.926807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-90222cbd-3f22-4dd4-a75f-07e136fc44b4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:57.933218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-90222cbd-3f22-4dd4-a75f-07e136fc44b4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:57.933662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-90222cbd-3f22-4dd4-a75f-07e136fc44b4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:57.934420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-90222cbd-3f22-4dd4-a75f-07e136fc44b4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:57.934849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-90222cbd-3f22-4dd4-a75f-07e136fc44b4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:57.962912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-90222cbd-3f22-4dd4-a75f-07e136fc44b4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040965 May 10 21:16:57.963492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 659/1359] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:57 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:58.350423 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-110755b4-8d54-4aa1-8e16-19abba44f9f6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:58.351396 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-110755b4-8d54-4aa1-8e16-19abba44f9f6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:58.358243 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-110755b4-8d54-4aa1-8e16-19abba44f9f6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:58.358697 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-110755b4-8d54-4aa1-8e16-19abba44f9f6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:58.359498 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-110755b4-8d54-4aa1-8e16-19abba44f9f6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:58.359951 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-110755b4-8d54-4aa1-8e16-19abba44f9f6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:58.389375 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-110755b4-8d54-4aa1-8e16-19abba44f9f6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042808 May 10 21:16:58.389996 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 701/1360] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:58 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:58.653300 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d332ca72-02ee-47e0-ab0b-1d441d302450 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:58.653933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d332ca72-02ee-47e0-ab0b-1d441d302450 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:58.655838 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-1ffd2dd7-ed0d-4eef-b8c3-db70ae669541 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:58.656783 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-1ffd2dd7-ed0d-4eef-b8c3-db70ae669541 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:58.660159 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d332ca72-02ee-47e0-ab0b-1d441d302450 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:58.660620 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d332ca72-02ee-47e0-ab0b-1d441d302450 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:58.661424 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d332ca72-02ee-47e0-ab0b-1d441d302450 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:58.661862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d332ca72-02ee-47e0-ab0b-1d441d302450 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:58.662546 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1ffd2dd7-ed0d-4eef-b8c3-db70ae669541 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:58.663001 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1ffd2dd7-ed0d-4eef-b8c3-db70ae669541 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:58.663814 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1ffd2dd7-ed0d-4eef-b8c3-db70ae669541 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:58.664259 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-1ffd2dd7-ed0d-4eef-b8c3-db70ae669541 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:58.693118 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-1ffd2dd7-ed0d-4eef-b8c3-db70ae669541 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041322 May 10 21:16:58.693928 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 702/1361] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:58 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:16:58.789725 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d332ca72-02ee-47e0-ab0b-1d441d302450 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:58.798406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d332ca72-02ee-47e0-ab0b-1d441d302450 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.148804 May 10 21:16:58.798983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 660/1362] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:58 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:16:58.974782 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-68ca2d0b-8bae-44b0-85c4-116171b443a3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:58.975758 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-68ca2d0b-8bae-44b0-85c4-116171b443a3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:58.982276 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-68ca2d0b-8bae-44b0-85c4-116171b443a3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:58.982726 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-68ca2d0b-8bae-44b0-85c4-116171b443a3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:58.983536 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-68ca2d0b-8bae-44b0-85c4-116171b443a3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:58.983978 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-68ca2d0b-8bae-44b0-85c4-116171b443a3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:59.013522 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-68ca2d0b-8bae-44b0-85c4-116171b443a3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042651 May 10 21:16:59.014074 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 703/1363] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:58 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:59.400950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-552e12f7-0d9d-462a-9846-70e0f7559492 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:59.401881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-552e12f7-0d9d-462a-9846-70e0f7559492 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:59.408732 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-552e12f7-0d9d-462a-9846-70e0f7559492 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:59.409176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-552e12f7-0d9d-462a-9846-70e0f7559492 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:59.409967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-552e12f7-0d9d-462a-9846-70e0f7559492 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:59.410401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-552e12f7-0d9d-462a-9846-70e0f7559492 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:59.439151 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-552e12f7-0d9d-462a-9846-70e0f7559492 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042151 May 10 21:16:59.439691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 661/1364] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:16:59 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:16:59.705427 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-838bd000-47cb-4fa6-9a1b-3dc04ac9125d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:59.706282 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-838bd000-47cb-4fa6-9a1b-3dc04ac9125d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:59.712956 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-838bd000-47cb-4fa6-9a1b-3dc04ac9125d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:59.713485 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-838bd000-47cb-4fa6-9a1b-3dc04ac9125d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:59.714290 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-838bd000-47cb-4fa6-9a1b-3dc04ac9125d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:59.714736 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-838bd000-47cb-4fa6-9a1b-3dc04ac9125d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:59.743752 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-838bd000-47cb-4fa6-9a1b-3dc04ac9125d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042406 May 10 21:16:59.744299 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 704/1365] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:16:59 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:16:59.815924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6585d74b-4790-4278-93fb-53504cdb0acc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:16:59.816532 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6585d74b-4790-4278-93fb-53504cdb0acc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:16:59.822737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6585d74b-4790-4278-93fb-53504cdb0acc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:59.823205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6585d74b-4790-4278-93fb-53504cdb0acc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:59.823965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6585d74b-4790-4278-93fb-53504cdb0acc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:16:59.824394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6585d74b-4790-4278-93fb-53504cdb0acc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:16:59.955852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6585d74b-4790-4278-93fb-53504cdb0acc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:16:59.963290 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6585d74b-4790-4278-93fb-53504cdb0acc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151158 May 10 21:16:59.963854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 662/1366] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:16:59 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:00.023980 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-9102e9fb-4495-435b-a358-35ad032aa3d9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:00.024937 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-9102e9fb-4495-435b-a358-35ad032aa3d9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:00.031808 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9102e9fb-4495-435b-a358-35ad032aa3d9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:00.032257 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9102e9fb-4495-435b-a358-35ad032aa3d9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:00.033032 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9102e9fb-4495-435b-a358-35ad032aa3d9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:00.033473 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-9102e9fb-4495-435b-a358-35ad032aa3d9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:00.062061 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-9102e9fb-4495-435b-a358-35ad032aa3d9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041970 May 10 21:17:00.062604 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 705/1367] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:00 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:00.451469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5e92e71e-9e5f-4fe2-a07d-f6b7be96d465 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:00.452435 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5e92e71e-9e5f-4fe2-a07d-f6b7be96d465 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:00.458801 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5e92e71e-9e5f-4fe2-a07d-f6b7be96d465 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:00.459294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5e92e71e-9e5f-4fe2-a07d-f6b7be96d465 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:00.460077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5e92e71e-9e5f-4fe2-a07d-f6b7be96d465 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:00.460524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5e92e71e-9e5f-4fe2-a07d-f6b7be96d465 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:00.489539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5e92e71e-9e5f-4fe2-a07d-f6b7be96d465 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042900 May 10 21:17:00.490079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 663/1368] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:00 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:00.755666 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-e5b255f6-10d4-4a3f-987c-2de651d1698c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:00.756589 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-e5b255f6-10d4-4a3f-987c-2de651d1698c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:00.763774 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e5b255f6-10d4-4a3f-987c-2de651d1698c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:00.764225 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e5b255f6-10d4-4a3f-987c-2de651d1698c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:00.765126 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e5b255f6-10d4-4a3f-987c-2de651d1698c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:00.765571 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-e5b255f6-10d4-4a3f-987c-2de651d1698c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:00.797744 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-e5b255f6-10d4-4a3f-987c-2de651d1698c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046156 May 10 21:17:00.798302 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 706/1369] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:00 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:00.982042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-837c2890-7979-43f1-bccb-efa150f21ba8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:00.982782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-837c2890-7979-43f1-bccb-efa150f21ba8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:00.988692 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-837c2890-7979-43f1-bccb-efa150f21ba8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:00.989141 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-837c2890-7979-43f1-bccb-efa150f21ba8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:00.989911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-837c2890-7979-43f1-bccb-efa150f21ba8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:00.990348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-837c2890-7979-43f1-bccb-efa150f21ba8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:01.073924 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-5c7bd33c-88eb-482b-aa01-c0b56907d06b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:01.074923 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5c7bd33c-88eb-482b-aa01-c0b56907d06b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:01.080861 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5c7bd33c-88eb-482b-aa01-c0b56907d06b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:01.081369 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5c7bd33c-88eb-482b-aa01-c0b56907d06b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:01.082069 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5c7bd33c-88eb-482b-aa01-c0b56907d06b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:01.082508 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5c7bd33c-88eb-482b-aa01-c0b56907d06b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:01.115626 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-5c7bd33c-88eb-482b-aa01-c0b56907d06b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045591 May 10 21:17:01.116455 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 707/1370] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:01 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:17:01.208468 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-837c2890-7979-43f1-bccb-efa150f21ba8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:01.217691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-837c2890-7979-43f1-bccb-efa150f21ba8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.240077 May 10 21:17:01.218380 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 664/1371] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:00 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:01.502053 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-8110d4a8-ddda-4105-9c4b-85936eb9b8ac tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:01.502930 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-8110d4a8-ddda-4105-9c4b-85936eb9b8ac tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:01.511632 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8110d4a8-ddda-4105-9c4b-85936eb9b8ac tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:01.512079 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8110d4a8-ddda-4105-9c4b-85936eb9b8ac tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:01.513420 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8110d4a8-ddda-4105-9c4b-85936eb9b8ac tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:01.513897 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8110d4a8-ddda-4105-9c4b-85936eb9b8ac tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:01.546193 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-8110d4a8-ddda-4105-9c4b-85936eb9b8ac tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048277 May 10 21:17:01.546769 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 708/1372] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:01 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:01.810076 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-51c1d45f-7e5a-4539-83f9-ccf68226422b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:01.810949 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-51c1d45f-7e5a-4539-83f9-ccf68226422b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:01.817294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51c1d45f-7e5a-4539-83f9-ccf68226422b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:01.817756 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51c1d45f-7e5a-4539-83f9-ccf68226422b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:01.818523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51c1d45f-7e5a-4539-83f9-ccf68226422b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:01.819245 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51c1d45f-7e5a-4539-83f9-ccf68226422b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:01.847990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-51c1d45f-7e5a-4539-83f9-ccf68226422b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042530 May 10 21:17:01.848539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 665/1373] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:01 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:02.128437 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-504ac825-5354-49e5-ad46-e50bd7c88431 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:02.129388 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-504ac825-5354-49e5-ad46-e50bd7c88431 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:02.135698 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-504ac825-5354-49e5-ad46-e50bd7c88431 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:02.136144 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-504ac825-5354-49e5-ad46-e50bd7c88431 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:02.136897 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-504ac825-5354-49e5-ad46-e50bd7c88431 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:02.137352 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-504ac825-5354-49e5-ad46-e50bd7c88431 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:02.165504 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-504ac825-5354-49e5-ad46-e50bd7c88431 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041091 May 10 21:17:02.166042 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 709/1374] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:02 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:17:02.235718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-378d5623-72f7-411a-8ca4-af22971d7268 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:02.236353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-378d5623-72f7-411a-8ca4-af22971d7268 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:02.242233 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-378d5623-72f7-411a-8ca4-af22971d7268 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:02.242674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-378d5623-72f7-411a-8ca4-af22971d7268 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:02.243530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-378d5623-72f7-411a-8ca4-af22971d7268 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:02.243965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-378d5623-72f7-411a-8ca4-af22971d7268 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:02.370892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-378d5623-72f7-411a-8ca4-af22971d7268 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:02.378609 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-378d5623-72f7-411a-8ca4-af22971d7268 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.147282 May 10 21:17:02.379109 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 666/1375] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:02 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:02.557540 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-dd18c97e-fe01-40f9-a57e-35124e007f14 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:02.558546 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-dd18c97e-fe01-40f9-a57e-35124e007f14 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:02.564469 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-dd18c97e-fe01-40f9-a57e-35124e007f14 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:02.564912 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-dd18c97e-fe01-40f9-a57e-35124e007f14 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:02.565664 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-dd18c97e-fe01-40f9-a57e-35124e007f14 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:02.566095 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-dd18c97e-fe01-40f9-a57e-35124e007f14 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:02.594589 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-dd18c97e-fe01-40f9-a57e-35124e007f14 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041045 May 10 21:17:02.595138 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 710/1376] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:02 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:02.860751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bf440221-16e2-40ca-a308-ae0681d7142f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:02.861708 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bf440221-16e2-40ca-a308-ae0681d7142f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:02.868156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf440221-16e2-40ca-a308-ae0681d7142f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:02.868653 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf440221-16e2-40ca-a308-ae0681d7142f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:02.869418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf440221-16e2-40ca-a308-ae0681d7142f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:02.869855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf440221-16e2-40ca-a308-ae0681d7142f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:02.899906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bf440221-16e2-40ca-a308-ae0681d7142f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044127 May 10 21:17:02.900525 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 667/1377] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:02 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:03.177798 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-3f537d62-204e-4c93-a5dc-03e3fd3e0ec9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:03.178641 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-3f537d62-204e-4c93-a5dc-03e3fd3e0ec9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:03.184882 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3f537d62-204e-4c93-a5dc-03e3fd3e0ec9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:03.185322 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3f537d62-204e-4c93-a5dc-03e3fd3e0ec9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:03.186072 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3f537d62-204e-4c93-a5dc-03e3fd3e0ec9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:03.186500 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-3f537d62-204e-4c93-a5dc-03e3fd3e0ec9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:03.214470 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-3f537d62-204e-4c93-a5dc-03e3fd3e0ec9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040753 May 10 21:17:03.214997 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 711/1378] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:03 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:03.395622 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c5127733-e955-48f9-9a3d-74b99b68ecaf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:03.396230 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c5127733-e955-48f9-9a3d-74b99b68ecaf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:03.402490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5127733-e955-48f9-9a3d-74b99b68ecaf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:03.403586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5127733-e955-48f9-9a3d-74b99b68ecaf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:03.404464 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5127733-e955-48f9-9a3d-74b99b68ecaf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:03.404902 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5127733-e955-48f9-9a3d-74b99b68ecaf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:03.532305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c5127733-e955-48f9-9a3d-74b99b68ecaf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:03.539634 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c5127733-e955-48f9-9a3d-74b99b68ecaf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.147913 May 10 21:17:03.540192 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 668/1379] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:03 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:03.606091 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-187d51d9-c849-4241-a06e-bfc14fdb4b11 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:03.607154 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-187d51d9-c849-4241-a06e-bfc14fdb4b11 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:03.613383 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-187d51d9-c849-4241-a06e-bfc14fdb4b11 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:03.613835 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-187d51d9-c849-4241-a06e-bfc14fdb4b11 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:03.614695 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-187d51d9-c849-4241-a06e-bfc14fdb4b11 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:03.615166 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-187d51d9-c849-4241-a06e-bfc14fdb4b11 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:03.645506 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-187d51d9-c849-4241-a06e-bfc14fdb4b11 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043470 May 10 21:17:03.646053 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 712/1380] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:03 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:03.912327 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ec9a3e46-7561-466f-994b-6cefd2da7adb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:03.913251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ec9a3e46-7561-466f-994b-6cefd2da7adb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:03.919854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec9a3e46-7561-466f-994b-6cefd2da7adb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:03.920297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec9a3e46-7561-466f-994b-6cefd2da7adb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:03.921054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec9a3e46-7561-466f-994b-6cefd2da7adb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:03.921481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec9a3e46-7561-466f-994b-6cefd2da7adb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:03.952123 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ec9a3e46-7561-466f-994b-6cefd2da7adb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043795 May 10 21:17:03.952909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 669/1381] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:03 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:04.226663 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-35153d3e-1329-4cd8-98cf-a5d532875e64 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:04.227677 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-35153d3e-1329-4cd8-98cf-a5d532875e64 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:04.234143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-35153d3e-1329-4cd8-98cf-a5d532875e64 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:04.234590 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-35153d3e-1329-4cd8-98cf-a5d532875e64 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:04.235388 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-35153d3e-1329-4cd8-98cf-a5d532875e64 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:04.235820 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-35153d3e-1329-4cd8-98cf-a5d532875e64 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:04.265066 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-35153d3e-1329-4cd8-98cf-a5d532875e64 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042421 May 10 21:17:04.265645 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 713/1382] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:04 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:04.557302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0ee6656e-98e2-439b-aad1-70729d957d5d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:04.557831 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0ee6656e-98e2-439b-aad1-70729d957d5d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:04.564468 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ee6656e-98e2-439b-aad1-70729d957d5d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:04.564914 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ee6656e-98e2-439b-aad1-70729d957d5d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:04.565669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ee6656e-98e2-439b-aad1-70729d957d5d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:04.566101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ee6656e-98e2-439b-aad1-70729d957d5d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:04.657550 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6744c8bf-82b1-4ace-bb58-a45e4d10b7fb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:04.658598 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6744c8bf-82b1-4ace-bb58-a45e4d10b7fb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:04.664863 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6744c8bf-82b1-4ace-bb58-a45e4d10b7fb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:04.665305 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6744c8bf-82b1-4ace-bb58-a45e4d10b7fb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:04.666073 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6744c8bf-82b1-4ace-bb58-a45e4d10b7fb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:04.666511 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6744c8bf-82b1-4ace-bb58-a45e4d10b7fb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:04.696932 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6744c8bf-82b1-4ace-bb58-a45e4d10b7fb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043853 May 10 21:17:04.697500 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 714/1383] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:04 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:17:04.702069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0ee6656e-98e2-439b-aad1-70729d957d5d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:04.709442 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0ee6656e-98e2-439b-aad1-70729d957d5d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.156140 May 10 21:17:04.709996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 670/1384] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:04 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:04.964321 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-8240fc2f-7b92-48b1-ac5c-17c89945a3fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:04.966095 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-8240fc2f-7b92-48b1-ac5c-17c89945a3fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:04.972217 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8240fc2f-7b92-48b1-ac5c-17c89945a3fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:04.972658 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8240fc2f-7b92-48b1-ac5c-17c89945a3fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:04.973424 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8240fc2f-7b92-48b1-ac5c-17c89945a3fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:04.973856 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8240fc2f-7b92-48b1-ac5c-17c89945a3fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:05.002780 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-8240fc2f-7b92-48b1-ac5c-17c89945a3fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042985 May 10 21:17:05.003381 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 715/1385] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:04 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:05.276735 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a49b0d97-5b76-4b24-b7a3-4c894fb2f1b7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:05.277588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a49b0d97-5b76-4b24-b7a3-4c894fb2f1b7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:05.284599 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a49b0d97-5b76-4b24-b7a3-4c894fb2f1b7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:05.285056 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a49b0d97-5b76-4b24-b7a3-4c894fb2f1b7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:05.285832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a49b0d97-5b76-4b24-b7a3-4c894fb2f1b7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:05.286275 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a49b0d97-5b76-4b24-b7a3-4c894fb2f1b7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:05.314377 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a49b0d97-5b76-4b24-b7a3-4c894fb2f1b7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041710 May 10 21:17:05.314922 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 671/1386] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:05 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:05.708552 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-739e493f-8b39-4b57-b078-2aee343692cc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:05.709506 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-739e493f-8b39-4b57-b078-2aee343692cc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:05.715928 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-739e493f-8b39-4b57-b078-2aee343692cc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:05.716380 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-739e493f-8b39-4b57-b078-2aee343692cc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:05.717145 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-739e493f-8b39-4b57-b078-2aee343692cc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:05.717579 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-739e493f-8b39-4b57-b078-2aee343692cc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:05.727054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f397193b-ed22-4bf6-950b-88cd2cfec8cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:05.727687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f397193b-ed22-4bf6-950b-88cd2cfec8cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:05.734087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f397193b-ed22-4bf6-950b-88cd2cfec8cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:05.734538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f397193b-ed22-4bf6-950b-88cd2cfec8cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:05.735446 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f397193b-ed22-4bf6-950b-88cd2cfec8cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:05.735897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f397193b-ed22-4bf6-950b-88cd2cfec8cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:05.746347 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-739e493f-8b39-4b57-b078-2aee343692cc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041732 May 10 21:17:05.747726 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 716/1387] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:05 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:05.863361 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f397193b-ed22-4bf6-950b-88cd2cfec8cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:05.870602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f397193b-ed22-4bf6-950b-88cd2cfec8cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.147387 May 10 21:17:05.871171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 672/1388] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:05 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:17:06.014896 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-ddd0aeea-c888-462b-a8c1-e6d865426375 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:06.015880 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-ddd0aeea-c888-462b-a8c1-e6d865426375 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:06.021790 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ddd0aeea-c888-462b-a8c1-e6d865426375 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:06.022233 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ddd0aeea-c888-462b-a8c1-e6d865426375 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:06.022988 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ddd0aeea-c888-462b-a8c1-e6d865426375 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:06.023458 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ddd0aeea-c888-462b-a8c1-e6d865426375 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:06.051985 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-ddd0aeea-c888-462b-a8c1-e6d865426375 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041339 May 10 21:17:06.052524 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 717/1389] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:06 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:06.326627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9330abd2-1b62-4836-846d-6306cc793c2d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:06.327602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9330abd2-1b62-4836-846d-6306cc793c2d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:06.333915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9330abd2-1b62-4836-846d-6306cc793c2d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:06.334359 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9330abd2-1b62-4836-846d-6306cc793c2d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:06.335150 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9330abd2-1b62-4836-846d-6306cc793c2d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:06.335576 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9330abd2-1b62-4836-846d-6306cc793c2d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:06.363485 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9330abd2-1b62-4836-846d-6306cc793c2d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041513 May 10 21:17:06.364023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 673/1390] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:06 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:06.759316 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-46038e0a-b21d-40ae-9c1d-adbdf3d46e63 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:06.760259 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-46038e0a-b21d-40ae-9c1d-adbdf3d46e63 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:06.767680 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-46038e0a-b21d-40ae-9c1d-adbdf3d46e63 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:06.778718 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-46038e0a-b21d-40ae-9c1d-adbdf3d46e63 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:06.778718 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-46038e0a-b21d-40ae-9c1d-adbdf3d46e63 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:06.778718 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-46038e0a-b21d-40ae-9c1d-adbdf3d46e63 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:06.798403 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-46038e0a-b21d-40ae-9c1d-adbdf3d46e63 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043192 May 10 21:17:06.801653 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 718/1391] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:06 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:06.888349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bb103118-6a11-44a2-b0eb-24b3f7185071 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:06.888878 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bb103118-6a11-44a2-b0eb-24b3f7185071 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:06.894625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bb103118-6a11-44a2-b0eb-24b3f7185071 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:06.895070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bb103118-6a11-44a2-b0eb-24b3f7185071 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:06.895873 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bb103118-6a11-44a2-b0eb-24b3f7185071 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:06.896308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bb103118-6a11-44a2-b0eb-24b3f7185071 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:07.031388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bb103118-6a11-44a2-b0eb-24b3f7185071 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:07.038765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bb103118-6a11-44a2-b0eb-24b3f7185071 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.154507 May 10 21:17:07.039354 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 674/1392] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:06 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:07.064375 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c1e236e7-2207-4c67-87b9-4b129f3e7528 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:07.065319 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c1e236e7-2207-4c67-87b9-4b129f3e7528 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:07.071446 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c1e236e7-2207-4c67-87b9-4b129f3e7528 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:07.071893 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c1e236e7-2207-4c67-87b9-4b129f3e7528 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:07.072646 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c1e236e7-2207-4c67-87b9-4b129f3e7528 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:07.073080 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c1e236e7-2207-4c67-87b9-4b129f3e7528 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:07.101346 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c1e236e7-2207-4c67-87b9-4b129f3e7528 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041209 May 10 21:17:07.101887 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 719/1393] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:07 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:07.375649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b1312ba1-a831-4ce0-b995-c923a404f02f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:07.376577 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b1312ba1-a831-4ce0-b995-c923a404f02f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:07.382944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b1312ba1-a831-4ce0-b995-c923a404f02f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:07.383418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b1312ba1-a831-4ce0-b995-c923a404f02f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:07.384177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b1312ba1-a831-4ce0-b995-c923a404f02f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:07.384608 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b1312ba1-a831-4ce0-b995-c923a404f02f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:07.413676 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b1312ba1-a831-4ce0-b995-c923a404f02f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042685 May 10 21:17:07.414227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 675/1394] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:07 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:07.811164 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-daa2fcbf-2834-45d9-a0e3-410dc21e0be0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:07.812043 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-daa2fcbf-2834-45d9-a0e3-410dc21e0be0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:07.818431 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-daa2fcbf-2834-45d9-a0e3-410dc21e0be0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:07.819145 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-daa2fcbf-2834-45d9-a0e3-410dc21e0be0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:07.819965 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-daa2fcbf-2834-45d9-a0e3-410dc21e0be0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:07.820400 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-daa2fcbf-2834-45d9-a0e3-410dc21e0be0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:07.850022 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-daa2fcbf-2834-45d9-a0e3-410dc21e0be0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043985 May 10 21:17:07.850574 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 720/1395] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:07 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:08.056276 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fa04ef09-ae52-4261-9a6c-a17b389d97c2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:08.056883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fa04ef09-ae52-4261-9a6c-a17b389d97c2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:08.062903 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fa04ef09-ae52-4261-9a6c-a17b389d97c2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:08.063324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fa04ef09-ae52-4261-9a6c-a17b389d97c2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:08.064087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fa04ef09-ae52-4261-9a6c-a17b389d97c2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:08.064518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fa04ef09-ae52-4261-9a6c-a17b389d97c2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:08.112882 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-258efdcd-1261-4cab-800e-cd8af062ad66 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:08.113805 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-258efdcd-1261-4cab-800e-cd8af062ad66 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:08.119670 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-258efdcd-1261-4cab-800e-cd8af062ad66 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:08.120122 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-258efdcd-1261-4cab-800e-cd8af062ad66 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:08.120883 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-258efdcd-1261-4cab-800e-cd8af062ad66 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:08.121323 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-258efdcd-1261-4cab-800e-cd8af062ad66 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:08.150485 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-258efdcd-1261-4cab-800e-cd8af062ad66 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041495 May 10 21:17:08.151057 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 721/1396] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:08 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:17:08.202831 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fa04ef09-ae52-4261-9a6c-a17b389d97c2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:08.210203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fa04ef09-ae52-4261-9a6c-a17b389d97c2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.157833 May 10 21:17:08.210758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 676/1397] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:08 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:08.425593 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-7f083520-8807-4ada-a8c2-90c076dbfaf4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:08.426539 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-7f083520-8807-4ada-a8c2-90c076dbfaf4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:08.432488 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7f083520-8807-4ada-a8c2-90c076dbfaf4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:08.432930 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7f083520-8807-4ada-a8c2-90c076dbfaf4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:08.433706 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7f083520-8807-4ada-a8c2-90c076dbfaf4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:08.434643 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-7f083520-8807-4ada-a8c2-90c076dbfaf4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:08.463368 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-7f083520-8807-4ada-a8c2-90c076dbfaf4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041707 May 10 21:17:08.463901 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 722/1398] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:08 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:08.861757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7ac5f777-e579-47ed-8837-1b251c874dc4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:08.862687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7ac5f777-e579-47ed-8837-1b251c874dc4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:08.869102 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ac5f777-e579-47ed-8837-1b251c874dc4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:08.869558 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ac5f777-e579-47ed-8837-1b251c874dc4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:08.870326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ac5f777-e579-47ed-8837-1b251c874dc4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:08.870768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ac5f777-e579-47ed-8837-1b251c874dc4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:08.899661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7ac5f777-e579-47ed-8837-1b251c874dc4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041842 May 10 21:17:08.900218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 677/1399] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:08 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:09.162974 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c9f98ed1-9eea-4262-b613-e925560c0606 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:09.163844 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c9f98ed1-9eea-4262-b613-e925560c0606 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:09.170179 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c9f98ed1-9eea-4262-b613-e925560c0606 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:09.170618 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c9f98ed1-9eea-4262-b613-e925560c0606 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:09.171408 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c9f98ed1-9eea-4262-b613-e925560c0606 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:09.171854 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c9f98ed1-9eea-4262-b613-e925560c0606 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:09.200707 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c9f98ed1-9eea-4262-b613-e925560c0606 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041138 May 10 21:17:09.201237 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 723/1400] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:09 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:09.228575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5be68e61-0b7e-466a-9328-b856006d744a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:09.229199 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5be68e61-0b7e-466a-9328-b856006d744a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:09.235081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5be68e61-0b7e-466a-9328-b856006d744a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:09.235562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5be68e61-0b7e-466a-9328-b856006d744a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:09.236323 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5be68e61-0b7e-466a-9328-b856006d744a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:09.236758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5be68e61-0b7e-466a-9328-b856006d744a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:09.367489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5be68e61-0b7e-466a-9328-b856006d744a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:09.375874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5be68e61-0b7e-466a-9328-b856006d744a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151148 May 10 21:17:09.376489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 678/1401] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:09 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:09.474955 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-ed5c619f-5fc8-4f9e-8ad0-9053f3e24d43 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:09.475861 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-ed5c619f-5fc8-4f9e-8ad0-9053f3e24d43 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:09.482389 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ed5c619f-5fc8-4f9e-8ad0-9053f3e24d43 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:09.482840 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ed5c619f-5fc8-4f9e-8ad0-9053f3e24d43 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:09.483652 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ed5c619f-5fc8-4f9e-8ad0-9053f3e24d43 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:09.484097 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ed5c619f-5fc8-4f9e-8ad0-9053f3e24d43 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:09.512807 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-ed5c619f-5fc8-4f9e-8ad0-9053f3e24d43 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041871 May 10 21:17:09.513352 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 724/1402] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:09 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:09.912105 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d541cd31-cba7-43ec-a7ad-da4c6f31f933 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:09.913036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d541cd31-cba7-43ec-a7ad-da4c6f31f933 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:09.920036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d541cd31-cba7-43ec-a7ad-da4c6f31f933 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:09.920489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d541cd31-cba7-43ec-a7ad-da4c6f31f933 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:09.921267 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d541cd31-cba7-43ec-a7ad-da4c6f31f933 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:09.921709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d541cd31-cba7-43ec-a7ad-da4c6f31f933 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:09.950127 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d541cd31-cba7-43ec-a7ad-da4c6f31f933 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042048 May 10 21:17:09.950711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 679/1403] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:09 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:10.212385 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-69d41e30-f93a-4b72-b18c-cc25c199b887 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:10.213230 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-69d41e30-f93a-4b72-b18c-cc25c199b887 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:10.220774 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-69d41e30-f93a-4b72-b18c-cc25c199b887 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:10.221223 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-69d41e30-f93a-4b72-b18c-cc25c199b887 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:10.221991 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-69d41e30-f93a-4b72-b18c-cc25c199b887 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:10.222430 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-69d41e30-f93a-4b72-b18c-cc25c199b887 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:10.251339 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-69d41e30-f93a-4b72-b18c-cc25c199b887 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042942 May 10 21:17:10.251879 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 725/1404] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:10 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:10.394116 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5c546a75-445f-4198-96c3-da7fc9f63bf0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:10.394828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5c546a75-445f-4198-96c3-da7fc9f63bf0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:10.400889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5c546a75-445f-4198-96c3-da7fc9f63bf0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:10.401333 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5c546a75-445f-4198-96c3-da7fc9f63bf0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:10.402098 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5c546a75-445f-4198-96c3-da7fc9f63bf0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:10.402531 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5c546a75-445f-4198-96c3-da7fc9f63bf0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:10.524339 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d4f84e62-c797-4b0e-8899-e2f33f92f936 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:10.525269 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d4f84e62-c797-4b0e-8899-e2f33f92f936 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:10.531629 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d4f84e62-c797-4b0e-8899-e2f33f92f936 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:10.532075 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d4f84e62-c797-4b0e-8899-e2f33f92f936 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:10.532845 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d4f84e62-c797-4b0e-8899-e2f33f92f936 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:10.533343 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d4f84e62-c797-4b0e-8899-e2f33f92f936 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:10.535966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5c546a75-445f-4198-96c3-da7fc9f63bf0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:10.543199 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5c546a75-445f-4198-96c3-da7fc9f63bf0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.152894 May 10 21:17:10.543754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 680/1405] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:10 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:10.562150 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d4f84e62-c797-4b0e-8899-e2f33f92f936 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041741 May 10 21:17:10.562688 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 726/1406] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:10 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:17:10.961627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9c736868-6201-428d-bced-be698822a58a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:10.962560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9c736868-6201-428d-bced-be698822a58a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:10.970076 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c736868-6201-428d-bced-be698822a58a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:10.970529 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c736868-6201-428d-bced-be698822a58a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:10.971342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c736868-6201-428d-bced-be698822a58a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:10.971809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c736868-6201-428d-bced-be698822a58a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:11.001201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9c736868-6201-428d-bced-be698822a58a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043515 May 10 21:17:11.001767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 681/1407] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:10 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:11.262889 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-62835bb3-71fc-41ea-8f45-3375e66ee55d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:11.263792 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-62835bb3-71fc-41ea-8f45-3375e66ee55d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:11.270201 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-62835bb3-71fc-41ea-8f45-3375e66ee55d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:11.270645 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-62835bb3-71fc-41ea-8f45-3375e66ee55d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:11.271435 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-62835bb3-71fc-41ea-8f45-3375e66ee55d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:11.271870 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-62835bb3-71fc-41ea-8f45-3375e66ee55d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:11.300910 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-62835bb3-71fc-41ea-8f45-3375e66ee55d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041992 May 10 21:17:11.301451 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 727/1408] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:11 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:11.560716 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-66caa61f-b0c1-417a-bf1c-fef291db10c2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:11.561360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-66caa61f-b0c1-417a-bf1c-fef291db10c2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:11.567324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-66caa61f-b0c1-417a-bf1c-fef291db10c2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:11.567770 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-66caa61f-b0c1-417a-bf1c-fef291db10c2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:11.568524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-66caa61f-b0c1-417a-bf1c-fef291db10c2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:11.569220 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-66caa61f-b0c1-417a-bf1c-fef291db10c2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:11.574159 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-084f1dda-0814-4233-8ed7-27aa1f4e4f11 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:11.575091 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-084f1dda-0814-4233-8ed7-27aa1f4e4f11 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:11.580863 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-084f1dda-0814-4233-8ed7-27aa1f4e4f11 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:11.581309 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-084f1dda-0814-4233-8ed7-27aa1f4e4f11 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:11.582081 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-084f1dda-0814-4233-8ed7-27aa1f4e4f11 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:11.582520 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-084f1dda-0814-4233-8ed7-27aa1f4e4f11 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:11.613086 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-084f1dda-0814-4233-8ed7-27aa1f4e4f11 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042974 May 10 21:17:11.613736 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 728/1409] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:11 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:17:11.697748 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-66caa61f-b0c1-417a-bf1c-fef291db10c2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:11.705655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-66caa61f-b0c1-417a-bf1c-fef291db10c2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.148938 May 10 21:17:11.706215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 682/1410] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:11 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:12.012761 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-54d7c1cf-94ba-4d05-add2-1434a15456d7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:12.014221 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-54d7c1cf-94ba-4d05-add2-1434a15456d7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:12.020376 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-54d7c1cf-94ba-4d05-add2-1434a15456d7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:12.020823 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-54d7c1cf-94ba-4d05-add2-1434a15456d7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:12.021615 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-54d7c1cf-94ba-4d05-add2-1434a15456d7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:12.022049 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-54d7c1cf-94ba-4d05-add2-1434a15456d7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:12.050619 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-54d7c1cf-94ba-4d05-add2-1434a15456d7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041847 May 10 21:17:12.051169 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 729/1411] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:12 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:12.313389 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-941f5c36-5857-4876-a2b6-f50037e8dcf7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:12.314313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-941f5c36-5857-4876-a2b6-f50037e8dcf7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:12.320863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-941f5c36-5857-4876-a2b6-f50037e8dcf7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:12.321307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-941f5c36-5857-4876-a2b6-f50037e8dcf7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:12.322062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-941f5c36-5857-4876-a2b6-f50037e8dcf7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:12.322493 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-941f5c36-5857-4876-a2b6-f50037e8dcf7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:12.350941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-941f5c36-5857-4876-a2b6-f50037e8dcf7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042271 May 10 21:17:12.351507 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 683/1412] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:12 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:12.624489 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a998d32d-133c-4c6d-89c6-1c7c5317f970 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:12.625416 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a998d32d-133c-4c6d-89c6-1c7c5317f970 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:12.631813 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a998d32d-133c-4c6d-89c6-1c7c5317f970 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:12.632261 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a998d32d-133c-4c6d-89c6-1c7c5317f970 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:12.633030 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a998d32d-133c-4c6d-89c6-1c7c5317f970 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:12.633468 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a998d32d-133c-4c6d-89c6-1c7c5317f970 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:12.661376 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a998d32d-133c-4c6d-89c6-1c7c5317f970 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041444 May 10 21:17:12.661921 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 730/1413] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:12 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:12.722789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8e7a6d59-be10-4ffc-a5ca-92b13c3d0bae tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:12.723430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8e7a6d59-be10-4ffc-a5ca-92b13c3d0bae tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:12.729292 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e7a6d59-be10-4ffc-a5ca-92b13c3d0bae tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:12.729743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e7a6d59-be10-4ffc-a5ca-92b13c3d0bae tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:12.730505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e7a6d59-be10-4ffc-a5ca-92b13c3d0bae tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:12.730947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e7a6d59-be10-4ffc-a5ca-92b13c3d0bae tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:12.863070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8e7a6d59-be10-4ffc-a5ca-92b13c3d0bae tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:12.870434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8e7a6d59-be10-4ffc-a5ca-92b13c3d0bae tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151500 May 10 21:17:12.870998 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 684/1414] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:12 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:13.062520 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-2cbb17ae-467d-4a7c-8aab-7374eeda63a5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:13.063485 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-2cbb17ae-467d-4a7c-8aab-7374eeda63a5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:13.069687 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2cbb17ae-467d-4a7c-8aab-7374eeda63a5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:13.070131 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2cbb17ae-467d-4a7c-8aab-7374eeda63a5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:13.070886 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2cbb17ae-467d-4a7c-8aab-7374eeda63a5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:13.071348 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2cbb17ae-467d-4a7c-8aab-7374eeda63a5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:13.099489 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-2cbb17ae-467d-4a7c-8aab-7374eeda63a5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041385 May 10 21:17:13.100029 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 731/1415] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:13 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:13.363369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-21f08ccf-1deb-46df-9920-f82105bb397d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:13.364296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-21f08ccf-1deb-46df-9920-f82105bb397d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:13.370623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21f08ccf-1deb-46df-9920-f82105bb397d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:13.371092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21f08ccf-1deb-46df-9920-f82105bb397d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:13.371943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21f08ccf-1deb-46df-9920-f82105bb397d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:13.372361 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21f08ccf-1deb-46df-9920-f82105bb397d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:13.403140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-21f08ccf-1deb-46df-9920-f82105bb397d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043753 May 10 21:17:13.403713 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 685/1416] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:13 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:13.673411 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-afe05fe4-61ee-4c39-aa03-1b74dd0df3c6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:13.674535 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-afe05fe4-61ee-4c39-aa03-1b74dd0df3c6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:13.681141 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-afe05fe4-61ee-4c39-aa03-1b74dd0df3c6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:13.681583 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-afe05fe4-61ee-4c39-aa03-1b74dd0df3c6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:13.682383 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-afe05fe4-61ee-4c39-aa03-1b74dd0df3c6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:13.682813 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-afe05fe4-61ee-4c39-aa03-1b74dd0df3c6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:13.712818 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-afe05fe4-61ee-4c39-aa03-1b74dd0df3c6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044069 May 10 21:17:13.713372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 732/1417] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:13 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:13.887789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0a76cf3c-2916-4bf3-a185-6eba0fc5c44f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:13.888403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0a76cf3c-2916-4bf3-a185-6eba0fc5c44f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:13.895492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0a76cf3c-2916-4bf3-a185-6eba0fc5c44f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:13.895942 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0a76cf3c-2916-4bf3-a185-6eba0fc5c44f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:13.896717 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0a76cf3c-2916-4bf3-a185-6eba0fc5c44f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:13.897157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0a76cf3c-2916-4bf3-a185-6eba0fc5c44f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:14.028394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0a76cf3c-2916-4bf3-a185-6eba0fc5c44f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:14.036399 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0a76cf3c-2916-4bf3-a185-6eba0fc5c44f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.152491 May 10 21:17:14.036964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 686/1418] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:13 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:14.109988 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-0f4bdd54-6286-4ff1-8966-e3447d1019d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:14.110906 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-0f4bdd54-6286-4ff1-8966-e3447d1019d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:14.116892 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0f4bdd54-6286-4ff1-8966-e3447d1019d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:14.117335 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0f4bdd54-6286-4ff1-8966-e3447d1019d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:14.118092 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0f4bdd54-6286-4ff1-8966-e3447d1019d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:14.118529 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0f4bdd54-6286-4ff1-8966-e3447d1019d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:14.148329 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-0f4bdd54-6286-4ff1-8966-e3447d1019d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042427 May 10 21:17:14.148882 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 733/1419] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:14 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:14.414020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8ae4ca08-5416-4959-98ae-f32df91a3676 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:14.414957 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8ae4ca08-5416-4959-98ae-f32df91a3676 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:14.421140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ae4ca08-5416-4959-98ae-f32df91a3676 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:14.421593 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ae4ca08-5416-4959-98ae-f32df91a3676 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:14.422370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ae4ca08-5416-4959-98ae-f32df91a3676 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:14.422810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ae4ca08-5416-4959-98ae-f32df91a3676 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:14.453788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8ae4ca08-5416-4959-98ae-f32df91a3676 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043757 May 10 21:17:14.454347 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 687/1420] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:14 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:14.724549 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-8ab868b2-2edd-402f-b320-e89d440f745f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:14.725470 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-8ab868b2-2edd-402f-b320-e89d440f745f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:14.731883 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8ab868b2-2edd-402f-b320-e89d440f745f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:14.732332 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8ab868b2-2edd-402f-b320-e89d440f745f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:14.733590 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8ab868b2-2edd-402f-b320-e89d440f745f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:14.734021 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-8ab868b2-2edd-402f-b320-e89d440f745f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:14.762328 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-8ab868b2-2edd-402f-b320-e89d440f745f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041688 May 10 21:17:14.762872 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 734/1421] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:14 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:15.053568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d539455e-dda1-4ef5-a106-aa7a79970c3b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:15.054157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d539455e-dda1-4ef5-a106-aa7a79970c3b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:15.062137 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d539455e-dda1-4ef5-a106-aa7a79970c3b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:15.062582 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d539455e-dda1-4ef5-a106-aa7a79970c3b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:15.063369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d539455e-dda1-4ef5-a106-aa7a79970c3b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:15.063808 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d539455e-dda1-4ef5-a106-aa7a79970c3b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:15.160688 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d20991e2-e9d7-465e-a7bd-8850043b8b7a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:15.161622 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d20991e2-e9d7-465e-a7bd-8850043b8b7a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:15.167584 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d20991e2-e9d7-465e-a7bd-8850043b8b7a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:15.168045 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d20991e2-e9d7-465e-a7bd-8850043b8b7a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:15.168820 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d20991e2-e9d7-465e-a7bd-8850043b8b7a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:15.169267 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d20991e2-e9d7-465e-a7bd-8850043b8b7a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:15.197274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d539455e-dda1-4ef5-a106-aa7a79970c3b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:15.202035 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d20991e2-e9d7-465e-a7bd-8850043b8b7a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045007 May 10 21:17:15.202732 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 735/1422] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:15 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:17:15.205005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d539455e-dda1-4ef5-a106-aa7a79970c3b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.155406 May 10 21:17:15.205557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 688/1423] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:15 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:15.464992 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-2f169e2a-36bc-4afa-b611-2ef01b5897da tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:15.465906 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-2f169e2a-36bc-4afa-b611-2ef01b5897da tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:15.472531 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2f169e2a-36bc-4afa-b611-2ef01b5897da tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:15.472973 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2f169e2a-36bc-4afa-b611-2ef01b5897da tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:15.473727 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2f169e2a-36bc-4afa-b611-2ef01b5897da tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:15.474161 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2f169e2a-36bc-4afa-b611-2ef01b5897da tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:15.501675 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-2f169e2a-36bc-4afa-b611-2ef01b5897da tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040640 May 10 21:17:15.502211 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 736/1424] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:15 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:15.774206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1a6f998b-b690-4132-aac7-4b839de76f59 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:15.775056 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1a6f998b-b690-4132-aac7-4b839de76f59 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:15.781732 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1a6f998b-b690-4132-aac7-4b839de76f59 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:15.782173 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1a6f998b-b690-4132-aac7-4b839de76f59 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:15.782928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1a6f998b-b690-4132-aac7-4b839de76f59 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:15.783390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1a6f998b-b690-4132-aac7-4b839de76f59 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:15.811250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1a6f998b-b690-4132-aac7-4b839de76f59 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040659 May 10 21:17:15.811805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 689/1425] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:15 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:16.213545 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-03c25f6e-d3d3-4e7c-b8c9-0e833b726d3d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:16.214475 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-03c25f6e-d3d3-4e7c-b8c9-0e833b726d3d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:16.221035 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-03c25f6e-d3d3-4e7c-b8c9-0e833b726d3d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:16.221479 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-03c25f6e-d3d3-4e7c-b8c9-0e833b726d3d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:16.221610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a551a1d5-33e6-445e-b1c2-37f12b8369bc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:16.222192 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a551a1d5-33e6-445e-b1c2-37f12b8369bc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:16.222303 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-03c25f6e-d3d3-4e7c-b8c9-0e833b726d3d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:16.222667 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-03c25f6e-d3d3-4e7c-b8c9-0e833b726d3d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:16.228357 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a551a1d5-33e6-445e-b1c2-37f12b8369bc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:16.228802 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a551a1d5-33e6-445e-b1c2-37f12b8369bc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:16.229560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a551a1d5-33e6-445e-b1c2-37f12b8369bc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:16.229996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a551a1d5-33e6-445e-b1c2-37f12b8369bc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:16.252421 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-03c25f6e-d3d3-4e7c-b8c9-0e833b726d3d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042796 May 10 21:17:16.252981 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 737/1426] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:16 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:16.358497 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a551a1d5-33e6-445e-b1c2-37f12b8369bc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:16.365836 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a551a1d5-33e6-445e-b1c2-37f12b8369bc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.148107 May 10 21:17:16.366389 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 690/1427] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:16 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:16.513059 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-4cdac6fa-59f6-4732-a14e-ad7ff1792e72 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:16.513982 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-4cdac6fa-59f6-4732-a14e-ad7ff1792e72 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:16.519950 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4cdac6fa-59f6-4732-a14e-ad7ff1792e72 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:16.520400 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4cdac6fa-59f6-4732-a14e-ad7ff1792e72 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:16.521168 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4cdac6fa-59f6-4732-a14e-ad7ff1792e72 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:16.521610 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-4cdac6fa-59f6-4732-a14e-ad7ff1792e72 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:16.550907 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-4cdac6fa-59f6-4732-a14e-ad7ff1792e72 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041917 May 10 21:17:16.551480 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 738/1428] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:16 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:16.822360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fdeccf9a-ad92-4c1f-9b0a-0804b66bfdd8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:16.823279 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fdeccf9a-ad92-4c1f-9b0a-0804b66bfdd8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:16.829839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fdeccf9a-ad92-4c1f-9b0a-0804b66bfdd8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:16.830286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fdeccf9a-ad92-4c1f-9b0a-0804b66bfdd8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:16.831051 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fdeccf9a-ad92-4c1f-9b0a-0804b66bfdd8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:16.831551 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fdeccf9a-ad92-4c1f-9b0a-0804b66bfdd8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:16.862641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fdeccf9a-ad92-4c1f-9b0a-0804b66bfdd8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044611 May 10 21:17:16.863204 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 691/1429] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:16 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:17.264540 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-404b6625-7cc3-4e6e-a9fd-55dcee7a3f0f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:17.265519 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-404b6625-7cc3-4e6e-a9fd-55dcee7a3f0f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:17.271929 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-404b6625-7cc3-4e6e-a9fd-55dcee7a3f0f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:17.272388 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-404b6625-7cc3-4e6e-a9fd-55dcee7a3f0f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:17.273162 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-404b6625-7cc3-4e6e-a9fd-55dcee7a3f0f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:17.273637 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-404b6625-7cc3-4e6e-a9fd-55dcee7a3f0f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:17.302955 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-404b6625-7cc3-4e6e-a9fd-55dcee7a3f0f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042970 May 10 21:17:17.303586 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 739/1430] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:17 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:17.383512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a74fa64c-40ca-4085-ad5e-8e1d4e1b5f38 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:17.384129 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a74fa64c-40ca-4085-ad5e-8e1d4e1b5f38 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:17.391022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a74fa64c-40ca-4085-ad5e-8e1d4e1b5f38 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:17.391496 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a74fa64c-40ca-4085-ad5e-8e1d4e1b5f38 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:17.392263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a74fa64c-40ca-4085-ad5e-8e1d4e1b5f38 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:17.392700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a74fa64c-40ca-4085-ad5e-8e1d4e1b5f38 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:17.520109 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a74fa64c-40ca-4085-ad5e-8e1d4e1b5f38 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:17.527381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a74fa64c-40ca-4085-ad5e-8e1d4e1b5f38 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.147736 May 10 21:17:17.527940 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 692/1431] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:17 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:17.563558 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-cc04c246-0f3f-4050-aad8-4e8a0fcf5a3d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:17.564479 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-cc04c246-0f3f-4050-aad8-4e8a0fcf5a3d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:17.570534 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cc04c246-0f3f-4050-aad8-4e8a0fcf5a3d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:17.570974 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cc04c246-0f3f-4050-aad8-4e8a0fcf5a3d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:17.571780 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cc04c246-0f3f-4050-aad8-4e8a0fcf5a3d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:17.572209 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-cc04c246-0f3f-4050-aad8-4e8a0fcf5a3d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:17.601255 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-cc04c246-0f3f-4050-aad8-4e8a0fcf5a3d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042229 May 10 21:17:17.601810 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 740/1432] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:17 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:17.874865 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-26f6c660-89bd-40a1-bcd0-ab7e51d49de4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:17.875815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-26f6c660-89bd-40a1-bcd0-ab7e51d49de4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:17.881779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-26f6c660-89bd-40a1-bcd0-ab7e51d49de4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:17.882237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-26f6c660-89bd-40a1-bcd0-ab7e51d49de4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:17.883006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-26f6c660-89bd-40a1-bcd0-ab7e51d49de4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:17.883469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-26f6c660-89bd-40a1-bcd0-ab7e51d49de4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:17.911320 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-26f6c660-89bd-40a1-bcd0-ab7e51d49de4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041180 May 10 21:17:17.911861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 693/1433] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:17 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:18.314004 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d481f55e-1da3-43a1-a294-d587db3f6889 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:18.314936 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d481f55e-1da3-43a1-a294-d587db3f6889 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:18.321597 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d481f55e-1da3-43a1-a294-d587db3f6889 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:18.322046 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d481f55e-1da3-43a1-a294-d587db3f6889 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:18.322820 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d481f55e-1da3-43a1-a294-d587db3f6889 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:18.323292 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d481f55e-1da3-43a1-a294-d587db3f6889 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:18.351400 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d481f55e-1da3-43a1-a294-d587db3f6889 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041438 May 10 21:17:18.351939 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 741/1434] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:18 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:18.544561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bdb998a6-829e-498a-8ae1-1b8113fb6fe3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:18.545421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bdb998a6-829e-498a-8ae1-1b8113fb6fe3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:18.551964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bdb998a6-829e-498a-8ae1-1b8113fb6fe3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:18.552362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bdb998a6-829e-498a-8ae1-1b8113fb6fe3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:18.553122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bdb998a6-829e-498a-8ae1-1b8113fb6fe3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:18.553562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bdb998a6-829e-498a-8ae1-1b8113fb6fe3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:18.613505 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-aeb74e9d-99b7-4615-b76e-858cb045adfa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:18.614461 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-aeb74e9d-99b7-4615-b76e-858cb045adfa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:18.620271 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-aeb74e9d-99b7-4615-b76e-858cb045adfa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:18.620706 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-aeb74e9d-99b7-4615-b76e-858cb045adfa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:18.621469 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-aeb74e9d-99b7-4615-b76e-858cb045adfa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:18.621898 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-aeb74e9d-99b7-4615-b76e-858cb045adfa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:18.651059 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-aeb74e9d-99b7-4615-b76e-858cb045adfa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041522 May 10 21:17:18.651643 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 742/1435] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:18 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:17:18.688857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bdb998a6-829e-498a-8ae1-1b8113fb6fe3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:18.696471 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bdb998a6-829e-498a-8ae1-1b8113fb6fe3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.155757 May 10 21:17:18.697030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 694/1436] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:18 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:18.922773 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-69eed0ea-d887-419d-a2a5-67fca46a3b31 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:18.923710 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-69eed0ea-d887-419d-a2a5-67fca46a3b31 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:18.929654 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-69eed0ea-d887-419d-a2a5-67fca46a3b31 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:18.930100 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-69eed0ea-d887-419d-a2a5-67fca46a3b31 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:18.930866 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-69eed0ea-d887-419d-a2a5-67fca46a3b31 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:18.931338 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-69eed0ea-d887-419d-a2a5-67fca46a3b31 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:18.960519 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-69eed0ea-d887-419d-a2a5-67fca46a3b31 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041753 May 10 21:17:18.961066 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 743/1437] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:18 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:19.363806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-720fda49-83c9-418e-af74-c97fc5521ff2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:19.364739 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-720fda49-83c9-418e-af74-c97fc5521ff2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:19.370648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-720fda49-83c9-418e-af74-c97fc5521ff2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:19.371101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-720fda49-83c9-418e-af74-c97fc5521ff2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:19.371893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-720fda49-83c9-418e-af74-c97fc5521ff2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:19.372327 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-720fda49-83c9-418e-af74-c97fc5521ff2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:19.402414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-720fda49-83c9-418e-af74-c97fc5521ff2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042646 May 10 21:17:19.413348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 695/1438] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:19 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:19.663615 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-46ca984f-7fee-4cdc-a9c9-1419269c66bb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:19.664468 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-46ca984f-7fee-4cdc-a9c9-1419269c66bb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:19.670804 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-46ca984f-7fee-4cdc-a9c9-1419269c66bb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:19.672046 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-46ca984f-7fee-4cdc-a9c9-1419269c66bb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:19.672811 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-46ca984f-7fee-4cdc-a9c9-1419269c66bb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:19.673247 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-46ca984f-7fee-4cdc-a9c9-1419269c66bb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:19.701628 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-46ca984f-7fee-4cdc-a9c9-1419269c66bb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042144 May 10 21:17:19.702181 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 744/1439] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:19 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:19.713505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b812ff83-8ec6-43d0-a8d7-b4157367f198 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:19.714160 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b812ff83-8ec6-43d0-a8d7-b4157367f198 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:19.721509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b812ff83-8ec6-43d0-a8d7-b4157367f198 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:19.721962 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b812ff83-8ec6-43d0-a8d7-b4157367f198 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:19.722724 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b812ff83-8ec6-43d0-a8d7-b4157367f198 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:19.723187 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b812ff83-8ec6-43d0-a8d7-b4157367f198 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:19.852797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b812ff83-8ec6-43d0-a8d7-b4157367f198 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:19.860854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b812ff83-8ec6-43d0-a8d7-b4157367f198 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151107 May 10 21:17:19.861410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 696/1440] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:19 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:19.971982 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6eedfb0e-9949-42fa-85ff-e85150115cbe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:19.972830 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6eedfb0e-9949-42fa-85ff-e85150115cbe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:19.978694 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6eedfb0e-9949-42fa-85ff-e85150115cbe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:19.979207 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6eedfb0e-9949-42fa-85ff-e85150115cbe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:19.979974 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6eedfb0e-9949-42fa-85ff-e85150115cbe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:19.980412 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6eedfb0e-9949-42fa-85ff-e85150115cbe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:20.008216 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6eedfb0e-9949-42fa-85ff-e85150115cbe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041036 May 10 21:17:20.008759 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 745/1441] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:19 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:20.423740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1ca8c5d6-934f-464e-8e33-b7ed7cd6bf5a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:20.424697 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1ca8c5d6-934f-464e-8e33-b7ed7cd6bf5a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:20.430713 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1ca8c5d6-934f-464e-8e33-b7ed7cd6bf5a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:20.431198 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1ca8c5d6-934f-464e-8e33-b7ed7cd6bf5a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:20.431965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1ca8c5d6-934f-464e-8e33-b7ed7cd6bf5a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:20.432539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1ca8c5d6-934f-464e-8e33-b7ed7cd6bf5a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:20.462039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1ca8c5d6-934f-464e-8e33-b7ed7cd6bf5a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042927 May 10 21:17:20.462582 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 697/1442] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:20 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:20.713456 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-393a3bf4-0612-488e-9b0d-e4953a6dbc59 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:20.714379 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-393a3bf4-0612-488e-9b0d-e4953a6dbc59 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:20.721328 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-393a3bf4-0612-488e-9b0d-e4953a6dbc59 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:20.721771 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-393a3bf4-0612-488e-9b0d-e4953a6dbc59 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:20.722524 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-393a3bf4-0612-488e-9b0d-e4953a6dbc59 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:20.722955 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-393a3bf4-0612-488e-9b0d-e4953a6dbc59 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:20.750775 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-393a3bf4-0612-488e-9b0d-e4953a6dbc59 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041363 May 10 21:17:20.751347 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 746/1443] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:20 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:20.878166 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f4066c33-5df2-4e93-8025-8fdc6f27bea5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:20.878701 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f4066c33-5df2-4e93-8025-8fdc6f27bea5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:20.885014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4066c33-5df2-4e93-8025-8fdc6f27bea5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:20.885458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4066c33-5df2-4e93-8025-8fdc6f27bea5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:20.886218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4066c33-5df2-4e93-8025-8fdc6f27bea5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:20.886650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4066c33-5df2-4e93-8025-8fdc6f27bea5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:21.018711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f4066c33-5df2-4e93-8025-8fdc6f27bea5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:21.019394 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-798af2ce-3fe2-4847-94ea-8a98627d047a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:21.020322 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-798af2ce-3fe2-4847-94ea-8a98627d047a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:21.026162 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-798af2ce-3fe2-4847-94ea-8a98627d047a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:21.026349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f4066c33-5df2-4e93-8025-8fdc6f27bea5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.152329 May 10 21:17:21.026593 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-798af2ce-3fe2-4847-94ea-8a98627d047a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:21.026907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 698/1444] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:20 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:21.027457 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-798af2ce-3fe2-4847-94ea-8a98627d047a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:21.027971 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-798af2ce-3fe2-4847-94ea-8a98627d047a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:21.056653 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-798af2ce-3fe2-4847-94ea-8a98627d047a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041754 May 10 21:17:21.057187 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 747/1445] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:21 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:17:21.473661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b1e557a2-e83b-4bb9-a155-3846928cf1ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:21.474588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b1e557a2-e83b-4bb9-a155-3846928cf1ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:21.480515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b1e557a2-e83b-4bb9-a155-3846928cf1ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:21.480961 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b1e557a2-e83b-4bb9-a155-3846928cf1ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:21.481718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b1e557a2-e83b-4bb9-a155-3846928cf1ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:21.482149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b1e557a2-e83b-4bb9-a155-3846928cf1ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:21.511669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b1e557a2-e83b-4bb9-a155-3846928cf1ee tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041981 May 10 21:17:21.512212 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 699/1446] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:21 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:21.761995 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-ee41ffc4-f574-4e56-91a8-bc9bba31855f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:21.762856 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-ee41ffc4-f574-4e56-91a8-bc9bba31855f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:21.770006 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ee41ffc4-f574-4e56-91a8-bc9bba31855f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:21.770448 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ee41ffc4-f574-4e56-91a8-bc9bba31855f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:21.771231 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ee41ffc4-f574-4e56-91a8-bc9bba31855f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:21.771663 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ee41ffc4-f574-4e56-91a8-bc9bba31855f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:21.800309 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-ee41ffc4-f574-4e56-91a8-bc9bba31855f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042375 May 10 21:17:21.800849 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 748/1447] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:21 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:22.044321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-966f269e-da64-4f25-872b-8cb7a6549c1b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:22.044850 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-966f269e-da64-4f25-872b-8cb7a6549c1b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:22.051101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-966f269e-da64-4f25-872b-8cb7a6549c1b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:22.051586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-966f269e-da64-4f25-872b-8cb7a6549c1b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:22.052344 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-966f269e-da64-4f25-872b-8cb7a6549c1b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:22.052777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-966f269e-da64-4f25-872b-8cb7a6549c1b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:22.068501 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-88067aef-2a6c-471b-a7dc-f119087a61cd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:22.069689 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-88067aef-2a6c-471b-a7dc-f119087a61cd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:22.075468 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-88067aef-2a6c-471b-a7dc-f119087a61cd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:22.075919 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-88067aef-2a6c-471b-a7dc-f119087a61cd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:22.076690 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-88067aef-2a6c-471b-a7dc-f119087a61cd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:22.077939 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-88067aef-2a6c-471b-a7dc-f119087a61cd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:22.107260 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-88067aef-2a6c-471b-a7dc-f119087a61cd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042635 May 10 21:17:22.107816 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 749/1448] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:22 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:17:22.182782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-966f269e-da64-4f25-872b-8cb7a6549c1b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:22.190765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-966f269e-da64-4f25-872b-8cb7a6549c1b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.150355 May 10 21:17:22.191408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 700/1449] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:22 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:22.523209 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-0be80ede-3061-4cae-a53b-7b1675303a83 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:22.524141 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-0be80ede-3061-4cae-a53b-7b1675303a83 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:22.530827 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0be80ede-3061-4cae-a53b-7b1675303a83 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:22.532371 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0be80ede-3061-4cae-a53b-7b1675303a83 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:22.532371 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0be80ede-3061-4cae-a53b-7b1675303a83 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:22.532371 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0be80ede-3061-4cae-a53b-7b1675303a83 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:22.561458 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-0be80ede-3061-4cae-a53b-7b1675303a83 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042136 May 10 21:17:22.562073 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 750/1450] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:22 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:22.812441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f510cfc8-bb07-4a8e-abef-4348f3367d26 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:22.813274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f510cfc8-bb07-4a8e-abef-4348f3367d26 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:22.820503 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f510cfc8-bb07-4a8e-abef-4348f3367d26 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:22.821001 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f510cfc8-bb07-4a8e-abef-4348f3367d26 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:22.821790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f510cfc8-bb07-4a8e-abef-4348f3367d26 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:22.822232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f510cfc8-bb07-4a8e-abef-4348f3367d26 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:22.827516 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:17:22.827964 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Tue May 10 21:17:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 21:17:22.856595 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f510cfc8-bb07-4a8e-abef-4348f3367d26 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048218 May 10 21:17:22.857411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 701/1451] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:22 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:23.119260 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-2a622cf6-acce-4afa-a34c-933460bbb4f7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:23.120191 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-2a622cf6-acce-4afa-a34c-933460bbb4f7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:23.128024 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2a622cf6-acce-4afa-a34c-933460bbb4f7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:23.128472 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2a622cf6-acce-4afa-a34c-933460bbb4f7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:23.129238 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2a622cf6-acce-4afa-a34c-933460bbb4f7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:23.129675 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2a622cf6-acce-4afa-a34c-933460bbb4f7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:23.160265 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-2a622cf6-acce-4afa-a34c-933460bbb4f7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044959 May 10 21:17:23.160804 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 751/1452] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:23 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:23.208527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-47e578a5-51e2-4b16-b3dc-526c05e441c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:23.209142 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-47e578a5-51e2-4b16-b3dc-526c05e441c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:23.215517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47e578a5-51e2-4b16-b3dc-526c05e441c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:23.215962 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47e578a5-51e2-4b16-b3dc-526c05e441c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:23.216722 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47e578a5-51e2-4b16-b3dc-526c05e441c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:23.217155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47e578a5-51e2-4b16-b3dc-526c05e441c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:23.349471 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-47e578a5-51e2-4b16-b3dc-526c05e441c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:23.356824 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-47e578a5-51e2-4b16-b3dc-526c05e441c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.152179 May 10 21:17:23.357393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 702/1453] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:23 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:23.573435 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-da2b62be-b27c-4790-b00b-396f81c49b60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:23.574292 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-da2b62be-b27c-4790-b00b-396f81c49b60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:23.580961 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-da2b62be-b27c-4790-b00b-396f81c49b60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:23.581416 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-da2b62be-b27c-4790-b00b-396f81c49b60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:23.582184 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-da2b62be-b27c-4790-b00b-396f81c49b60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:23.582627 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-da2b62be-b27c-4790-b00b-396f81c49b60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:23.611924 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-da2b62be-b27c-4790-b00b-396f81c49b60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042750 May 10 21:17:23.613360 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 752/1454] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:23 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:23.869100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d2c52a79-80a6-49ac-bc3b-7a5b55968893 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:23.870019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d2c52a79-80a6-49ac-bc3b-7a5b55968893 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:23.876888 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2c52a79-80a6-49ac-bc3b-7a5b55968893 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:23.877335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2c52a79-80a6-49ac-bc3b-7a5b55968893 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:23.878096 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2c52a79-80a6-49ac-bc3b-7a5b55968893 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:23.878528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2c52a79-80a6-49ac-bc3b-7a5b55968893 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:23.908993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d2c52a79-80a6-49ac-bc3b-7a5b55968893 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043803 May 10 21:17:23.909549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 703/1455] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:23 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:24.173145 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-5e0160d3-54a5-4d70-a1c2-7c390f95c35f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:24.174009 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-5e0160d3-54a5-4d70-a1c2-7c390f95c35f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:24.180369 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5e0160d3-54a5-4d70-a1c2-7c390f95c35f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:24.180823 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5e0160d3-54a5-4d70-a1c2-7c390f95c35f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:24.181594 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5e0160d3-54a5-4d70-a1c2-7c390f95c35f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:24.182036 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-5e0160d3-54a5-4d70-a1c2-7c390f95c35f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:24.211107 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-5e0160d3-54a5-4d70-a1c2-7c390f95c35f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042442 May 10 21:17:24.212579 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 753/1456] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:24 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:24.373709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-92eb7ed6-af88-442a-89cb-0209c3067c35 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:24.374395 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-92eb7ed6-af88-442a-89cb-0209c3067c35 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:24.380656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-92eb7ed6-af88-442a-89cb-0209c3067c35 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:24.381101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-92eb7ed6-af88-442a-89cb-0209c3067c35 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:24.381855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-92eb7ed6-af88-442a-89cb-0209c3067c35 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:24.382313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-92eb7ed6-af88-442a-89cb-0209c3067c35 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:24.511091 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-92eb7ed6-af88-442a-89cb-0209c3067c35 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:24.519001 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-92eb7ed6-af88-442a-89cb-0209c3067c35 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.149182 May 10 21:17:24.519604 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 704/1457] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:24 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:24.623436 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-0ebbca26-b159-46fb-8347-a1b9f2f5060f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:24.624449 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-0ebbca26-b159-46fb-8347-a1b9f2f5060f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:24.630293 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0ebbca26-b159-46fb-8347-a1b9f2f5060f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:24.630752 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0ebbca26-b159-46fb-8347-a1b9f2f5060f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:24.631550 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0ebbca26-b159-46fb-8347-a1b9f2f5060f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:24.632062 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0ebbca26-b159-46fb-8347-a1b9f2f5060f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:24.660918 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-0ebbca26-b159-46fb-8347-a1b9f2f5060f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041485 May 10 21:17:24.661454 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 754/1458] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:24 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:24.921041 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9914199f-76df-4fe6-abbe-1f4050c2c7c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:24.921968 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9914199f-76df-4fe6-abbe-1f4050c2c7c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:24.927770 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9914199f-76df-4fe6-abbe-1f4050c2c7c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:24.928219 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9914199f-76df-4fe6-abbe-1f4050c2c7c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:24.928989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9914199f-76df-4fe6-abbe-1f4050c2c7c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:24.929431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9914199f-76df-4fe6-abbe-1f4050c2c7c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:24.959816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9914199f-76df-4fe6-abbe-1f4050c2c7c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042764 May 10 21:17:24.960369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 705/1459] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:24 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:25.222048 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-acbcea24-af0c-40ae-8061-2adcb9634e41 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:25.223002 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-acbcea24-af0c-40ae-8061-2adcb9634e41 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:25.229334 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-acbcea24-af0c-40ae-8061-2adcb9634e41 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:25.229788 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-acbcea24-af0c-40ae-8061-2adcb9634e41 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:25.230589 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-acbcea24-af0c-40ae-8061-2adcb9634e41 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:25.231035 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-acbcea24-af0c-40ae-8061-2adcb9634e41 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:25.259975 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-acbcea24-af0c-40ae-8061-2adcb9634e41 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042062 May 10 21:17:25.260518 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 755/1460] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:25 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:25.536828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-832bb71d-8ff0-464f-871e-ac0ad18a0de9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:25.537368 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-832bb71d-8ff0-464f-871e-ac0ad18a0de9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:25.543799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-832bb71d-8ff0-464f-871e-ac0ad18a0de9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:25.544247 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-832bb71d-8ff0-464f-871e-ac0ad18a0de9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:25.545005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-832bb71d-8ff0-464f-871e-ac0ad18a0de9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:25.545440 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-832bb71d-8ff0-464f-871e-ac0ad18a0de9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:25.672978 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-ee3c9dc1-b0f7-41be-93a5-eea25acf6a2f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:25.673941 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-ee3c9dc1-b0f7-41be-93a5-eea25acf6a2f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:25.674554 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-832bb71d-8ff0-464f-871e-ac0ad18a0de9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:25.679792 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ee3c9dc1-b0f7-41be-93a5-eea25acf6a2f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:25.680244 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ee3c9dc1-b0f7-41be-93a5-eea25acf6a2f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:25.681016 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ee3c9dc1-b0f7-41be-93a5-eea25acf6a2f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:25.681465 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ee3c9dc1-b0f7-41be-93a5-eea25acf6a2f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:25.682050 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-832bb71d-8ff0-464f-871e-ac0ad18a0de9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.149299 May 10 21:17:25.682632 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 706/1461] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:25 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:25.710338 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-ee3c9dc1-b0f7-41be-93a5-eea25acf6a2f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041834 May 10 21:17:25.710882 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 756/1462] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:25 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:17:25.972067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d8296701-64a1-458f-b201-3f79ed627e44 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:25.972996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d8296701-64a1-458f-b201-3f79ed627e44 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:25.979295 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d8296701-64a1-458f-b201-3f79ed627e44 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:25.979751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d8296701-64a1-458f-b201-3f79ed627e44 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:25.980525 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d8296701-64a1-458f-b201-3f79ed627e44 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:25.980970 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d8296701-64a1-458f-b201-3f79ed627e44 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:26.009103 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d8296701-64a1-458f-b201-3f79ed627e44 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041643 May 10 21:17:26.009646 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 707/1463] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:25 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:26.271414 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-08c8bac7-f261-4cd1-bd62-4fb0d6ebd113 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:26.272456 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-08c8bac7-f261-4cd1-bd62-4fb0d6ebd113 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:26.278825 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-08c8bac7-f261-4cd1-bd62-4fb0d6ebd113 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:26.279306 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-08c8bac7-f261-4cd1-bd62-4fb0d6ebd113 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:26.280067 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-08c8bac7-f261-4cd1-bd62-4fb0d6ebd113 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:26.280501 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-08c8bac7-f261-4cd1-bd62-4fb0d6ebd113 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:26.308808 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-08c8bac7-f261-4cd1-bd62-4fb0d6ebd113 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041411 May 10 21:17:26.309292 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 757/1464] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:26 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:26.619775 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:17:26.619955 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Tue May 10 21:17:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 21:17:26.699403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-09a958ba-4be7-4e3f-940f-dfc080cfb27d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:26.700012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-09a958ba-4be7-4e3f-940f-dfc080cfb27d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:26.708011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-09a958ba-4be7-4e3f-940f-dfc080cfb27d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:26.708467 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-09a958ba-4be7-4e3f-940f-dfc080cfb27d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:26.709232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-09a958ba-4be7-4e3f-940f-dfc080cfb27d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:26.709664 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-09a958ba-4be7-4e3f-940f-dfc080cfb27d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:26.722246 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-78262307-3d4b-4439-bcd6-92ef31abb9c7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:26.723204 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-78262307-3d4b-4439-bcd6-92ef31abb9c7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:26.728949 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-78262307-3d4b-4439-bcd6-92ef31abb9c7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:26.729403 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-78262307-3d4b-4439-bcd6-92ef31abb9c7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:26.730172 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-78262307-3d4b-4439-bcd6-92ef31abb9c7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:26.730611 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-78262307-3d4b-4439-bcd6-92ef31abb9c7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:26.761259 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-78262307-3d4b-4439-bcd6-92ef31abb9c7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043411 May 10 21:17:26.761844 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 758/1465] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:26 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:17:26.841279 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-09a958ba-4be7-4e3f-940f-dfc080cfb27d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:26.849443 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-09a958ba-4be7-4e3f-940f-dfc080cfb27d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.153732 May 10 21:17:26.850015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 708/1466] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:26 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:27.021579 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a5fe3a07-81c7-404a-be51-8b33781d3d9b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:27.022503 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a5fe3a07-81c7-404a-be51-8b33781d3d9b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:27.028544 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a5fe3a07-81c7-404a-be51-8b33781d3d9b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:27.028996 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a5fe3a07-81c7-404a-be51-8b33781d3d9b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:27.029768 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a5fe3a07-81c7-404a-be51-8b33781d3d9b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:27.030212 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a5fe3a07-81c7-404a-be51-8b33781d3d9b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:27.058311 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a5fe3a07-81c7-404a-be51-8b33781d3d9b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040704 May 10 21:17:27.058853 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 759/1467] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:27 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:27.321011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e9ba4f62-ec1a-4902-990a-3eef794257ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:27.321858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e9ba4f62-ec1a-4902-990a-3eef794257ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:27.328143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e9ba4f62-ec1a-4902-990a-3eef794257ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:27.328302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e9ba4f62-ec1a-4902-990a-3eef794257ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:27.329010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e9ba4f62-ec1a-4902-990a-3eef794257ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:27.329442 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e9ba4f62-ec1a-4902-990a-3eef794257ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:27.357928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e9ba4f62-ec1a-4902-990a-3eef794257ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041189 May 10 21:17:27.358479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 709/1468] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:27 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:27.772579 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-88eebe4b-16d4-4dad-9675-6cddea0d32cd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:27.773516 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-88eebe4b-16d4-4dad-9675-6cddea0d32cd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:27.780053 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-88eebe4b-16d4-4dad-9675-6cddea0d32cd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:27.780504 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-88eebe4b-16d4-4dad-9675-6cddea0d32cd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:27.781335 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-88eebe4b-16d4-4dad-9675-6cddea0d32cd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:27.781774 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-88eebe4b-16d4-4dad-9675-6cddea0d32cd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:27.809648 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-88eebe4b-16d4-4dad-9675-6cddea0d32cd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040999 May 10 21:17:27.810195 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 760/1469] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:27 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:27.867798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6fff4f8c-788e-4f5b-9ffe-f0c489906364 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:27.868350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6fff4f8c-788e-4f5b-9ffe-f0c489906364 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:27.875521 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6fff4f8c-788e-4f5b-9ffe-f0c489906364 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:27.875967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6fff4f8c-788e-4f5b-9ffe-f0c489906364 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:27.876741 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6fff4f8c-788e-4f5b-9ffe-f0c489906364 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:27.877180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6fff4f8c-788e-4f5b-9ffe-f0c489906364 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:28.005712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6fff4f8c-788e-4f5b-9ffe-f0c489906364 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:28.013274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6fff4f8c-788e-4f5b-9ffe-f0c489906364 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.149205 May 10 21:17:28.013836 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 710/1470] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:27 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:28.070175 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-91d6e7e1-b449-4952-bf1c-45693d1ef59e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:28.071149 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-91d6e7e1-b449-4952-bf1c-45693d1ef59e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:28.077034 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-91d6e7e1-b449-4952-bf1c-45693d1ef59e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:28.077483 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-91d6e7e1-b449-4952-bf1c-45693d1ef59e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:28.078933 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-91d6e7e1-b449-4952-bf1c-45693d1ef59e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:28.079401 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-91d6e7e1-b449-4952-bf1c-45693d1ef59e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:28.107156 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-91d6e7e1-b449-4952-bf1c-45693d1ef59e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041163 May 10 21:17:28.107693 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 761/1471] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:28 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:28.369993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-47f87ad6-0b02-4354-a930-23dab7e66b34 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:28.370914 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-47f87ad6-0b02-4354-a930-23dab7e66b34 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:28.377965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47f87ad6-0b02-4354-a930-23dab7e66b34 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:28.378416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47f87ad6-0b02-4354-a930-23dab7e66b34 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:28.379210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47f87ad6-0b02-4354-a930-23dab7e66b34 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:28.379649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47f87ad6-0b02-4354-a930-23dab7e66b34 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:28.409156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-47f87ad6-0b02-4354-a930-23dab7e66b34 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043081 May 10 21:17:28.409701 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 711/1472] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:28 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:17:28.822130 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-79d9c1a8-0ddc-4461-891e-4dd6ace9e9cb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:28.823218 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-79d9c1a8-0ddc-4461-891e-4dd6ace9e9cb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:28.834388 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-79d9c1a8-0ddc-4461-891e-4dd6ace9e9cb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:28.834388 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-79d9c1a8-0ddc-4461-891e-4dd6ace9e9cb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:28.834388 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-79d9c1a8-0ddc-4461-891e-4dd6ace9e9cb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:28.834388 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-79d9c1a8-0ddc-4461-891e-4dd6ace9e9cb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:28.862989 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-79d9c1a8-0ddc-4461-891e-4dd6ace9e9cb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043200 May 10 21:17:28.862989 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 762/1473] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:28 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:29.031796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6b62c341-e0ef-4b20-a5ba-041350633d1c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:29.032407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6b62c341-e0ef-4b20-a5ba-041350633d1c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:29.038705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6b62c341-e0ef-4b20-a5ba-041350633d1c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:29.039181 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6b62c341-e0ef-4b20-a5ba-041350633d1c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:29.039953 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6b62c341-e0ef-4b20-a5ba-041350633d1c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:29.040388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6b62c341-e0ef-4b20-a5ba-041350633d1c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:29.117991 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-c4d38bee-e96a-4db3-8b24-c3880c04715e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:29.118964 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-c4d38bee-e96a-4db3-8b24-c3880c04715e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:29.126270 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c4d38bee-e96a-4db3-8b24-c3880c04715e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:29.126722 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c4d38bee-e96a-4db3-8b24-c3880c04715e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:29.127540 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c4d38bee-e96a-4db3-8b24-c3880c04715e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:29.127980 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-c4d38bee-e96a-4db3-8b24-c3880c04715e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:29.157828 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-c4d38bee-e96a-4db3-8b24-c3880c04715e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043716 May 10 21:17:29.158372 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 763/1474] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:29 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:17:29.173952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6b62c341-e0ef-4b20-a5ba-041350633d1c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:29.181247 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6b62c341-e0ef-4b20-a5ba-041350633d1c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.154127 May 10 21:17:29.181801 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 712/1475] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:29 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:29.420724 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-2418d227-8e4e-4abf-aeb8-4f827d7fe4ac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:29.422676 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-2418d227-8e4e-4abf-aeb8-4f827d7fe4ac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:29.428606 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2418d227-8e4e-4abf-aeb8-4f827d7fe4ac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:29.429060 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2418d227-8e4e-4abf-aeb8-4f827d7fe4ac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:29.429825 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2418d227-8e4e-4abf-aeb8-4f827d7fe4ac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:29.430260 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-2418d227-8e4e-4abf-aeb8-4f827d7fe4ac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:29.459215 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-2418d227-8e4e-4abf-aeb8-4f827d7fe4ac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042474 May 10 21:17:29.459754 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 764/1476] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:29 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:29.872066 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-363aae80-a26f-4222-a4dd-ca0157091ae1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:29.872982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-363aae80-a26f-4222-a4dd-ca0157091ae1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:29.879178 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-363aae80-a26f-4222-a4dd-ca0157091ae1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:29.879626 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-363aae80-a26f-4222-a4dd-ca0157091ae1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:29.880390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-363aae80-a26f-4222-a4dd-ca0157091ae1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:29.880822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-363aae80-a26f-4222-a4dd-ca0157091ae1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:29.909940 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-363aae80-a26f-4222-a4dd-ca0157091ae1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042005 May 10 21:17:29.910483 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 713/1477] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:29 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:30.169592 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-6b951063-0fbc-4c9c-9841-b88fc5334f31 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:30.170432 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-6b951063-0fbc-4c9c-9841-b88fc5334f31 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:30.178094 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6b951063-0fbc-4c9c-9841-b88fc5334f31 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:30.178545 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6b951063-0fbc-4c9c-9841-b88fc5334f31 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:30.179335 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6b951063-0fbc-4c9c-9841-b88fc5334f31 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:30.179771 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-6b951063-0fbc-4c9c-9841-b88fc5334f31 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:30.199428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-884f0b54-d91f-4550-b133-3c190117bdb1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:30.200041 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-884f0b54-d91f-4550-b133-3c190117bdb1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:30.207410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-884f0b54-d91f-4550-b133-3c190117bdb1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:30.207861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-884f0b54-d91f-4550-b133-3c190117bdb1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:30.208743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-884f0b54-d91f-4550-b133-3c190117bdb1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:30.209176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-884f0b54-d91f-4550-b133-3c190117bdb1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:30.209289 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-6b951063-0fbc-4c9c-9841-b88fc5334f31 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043904 May 10 21:17:30.209758 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 765/1478] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:30 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:30.337946 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-884f0b54-d91f-4550-b133-3c190117bdb1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:30.346418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-884f0b54-d91f-4550-b133-3c190117bdb1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151015 May 10 21:17:30.346981 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 714/1479] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:30 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:17:30.471467 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f49b3243-c2c2-4b4e-a45d-c57dd6146d7b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:30.472317 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f49b3243-c2c2-4b4e-a45d-c57dd6146d7b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:30.478149 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f49b3243-c2c2-4b4e-a45d-c57dd6146d7b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:30.478595 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f49b3243-c2c2-4b4e-a45d-c57dd6146d7b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:30.479382 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f49b3243-c2c2-4b4e-a45d-c57dd6146d7b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:30.479816 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f49b3243-c2c2-4b4e-a45d-c57dd6146d7b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:30.510030 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f49b3243-c2c2-4b4e-a45d-c57dd6146d7b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043346 May 10 21:17:30.510581 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 766/1480] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:30 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:30.922269 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-803d4b6a-4686-4187-a191-9ebca5a527e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:30.923148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-803d4b6a-4686-4187-a191-9ebca5a527e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:30.929097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-803d4b6a-4686-4187-a191-9ebca5a527e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:30.929531 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-803d4b6a-4686-4187-a191-9ebca5a527e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:30.930286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-803d4b6a-4686-4187-a191-9ebca5a527e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:30.930720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-803d4b6a-4686-4187-a191-9ebca5a527e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:30.959741 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-803d4b6a-4686-4187-a191-9ebca5a527e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042063 May 10 21:17:30.960287 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 715/1481] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:30 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:31.221759 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a79251c4-4ccc-4c2a-a42c-167f3f662d1a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:31.222646 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a79251c4-4ccc-4c2a-a42c-167f3f662d1a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:31.229052 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a79251c4-4ccc-4c2a-a42c-167f3f662d1a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:31.229506 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a79251c4-4ccc-4c2a-a42c-167f3f662d1a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:31.230277 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a79251c4-4ccc-4c2a-a42c-167f3f662d1a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:31.230722 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a79251c4-4ccc-4c2a-a42c-167f3f662d1a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:31.259086 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a79251c4-4ccc-4c2a-a42c-167f3f662d1a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042157 May 10 21:17:31.259650 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 767/1482] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:31 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:31.364009 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-285504f7-2a31-43b3-befa-69ab7940a6d4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:31.364622 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-285504f7-2a31-43b3-befa-69ab7940a6d4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:31.370961 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-285504f7-2a31-43b3-befa-69ab7940a6d4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:31.371452 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-285504f7-2a31-43b3-befa-69ab7940a6d4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:31.372219 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-285504f7-2a31-43b3-befa-69ab7940a6d4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:31.372654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-285504f7-2a31-43b3-befa-69ab7940a6d4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:31.503521 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-285504f7-2a31-43b3-befa-69ab7940a6d4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:31.510919 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-285504f7-2a31-43b3-befa-69ab7940a6d4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.150747 May 10 21:17:31.511501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 716/1483] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:31 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:31.521374 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-43de2d30-2f75-4711-9002-fa0ef1721220 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:31.528941 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-43de2d30-2f75-4711-9002-fa0ef1721220 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:31.528941 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-43de2d30-2f75-4711-9002-fa0ef1721220 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:31.529127 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-43de2d30-2f75-4711-9002-fa0ef1721220 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:31.529746 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-43de2d30-2f75-4711-9002-fa0ef1721220 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:31.530212 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-43de2d30-2f75-4711-9002-fa0ef1721220 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:31.559992 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-43de2d30-2f75-4711-9002-fa0ef1721220 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042622 May 10 21:17:31.560534 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 768/1484] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:31 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:31.971521 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2fa214a2-5aaf-43e7-8a4e-0cd573495365 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:31.972443 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2fa214a2-5aaf-43e7-8a4e-0cd573495365 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:31.978306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2fa214a2-5aaf-43e7-8a4e-0cd573495365 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:31.978748 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2fa214a2-5aaf-43e7-8a4e-0cd573495365 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:31.979536 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2fa214a2-5aaf-43e7-8a4e-0cd573495365 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:31.979973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2fa214a2-5aaf-43e7-8a4e-0cd573495365 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:32.008553 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2fa214a2-5aaf-43e7-8a4e-0cd573495365 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041164 May 10 21:17:32.009020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 717/1485] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:31 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:32.270843 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-d8849cd9-4b30-4455-9d5a-dc255df5a486 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:32.271708 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-d8849cd9-4b30-4455-9d5a-dc255df5a486 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:32.278156 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d8849cd9-4b30-4455-9d5a-dc255df5a486 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:32.278599 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d8849cd9-4b30-4455-9d5a-dc255df5a486 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:32.279387 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d8849cd9-4b30-4455-9d5a-dc255df5a486 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:32.279822 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-d8849cd9-4b30-4455-9d5a-dc255df5a486 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:32.308986 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-d8849cd9-4b30-4455-9d5a-dc255df5a486 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042152 May 10 21:17:32.309899 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 769/1486] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:32 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:32.528661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-079b8a20-4f98-45af-8c4a-2da67b9b0a05 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:32.529196 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-079b8a20-4f98-45af-8c4a-2da67b9b0a05 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:32.536048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-079b8a20-4f98-45af-8c4a-2da67b9b0a05 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:32.536491 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-079b8a20-4f98-45af-8c4a-2da67b9b0a05 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:32.537242 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-079b8a20-4f98-45af-8c4a-2da67b9b0a05 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:32.537674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-079b8a20-4f98-45af-8c4a-2da67b9b0a05 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:32.572053 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-f2405685-323b-41fd-b4b1-db2b24a72855 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:32.573117 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-f2405685-323b-41fd-b4b1-db2b24a72855 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:32.579550 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f2405685-323b-41fd-b4b1-db2b24a72855 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:32.580074 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f2405685-323b-41fd-b4b1-db2b24a72855 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:32.580940 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f2405685-323b-41fd-b4b1-db2b24a72855 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:32.581457 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-f2405685-323b-41fd-b4b1-db2b24a72855 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:32.612301 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-f2405685-323b-41fd-b4b1-db2b24a72855 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044429 May 10 21:17:32.612861 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 770/1487] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:32 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:17:32.670363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-079b8a20-4f98-45af-8c4a-2da67b9b0a05 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:32.677787 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-079b8a20-4f98-45af-8c4a-2da67b9b0a05 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.153064 May 10 21:17:32.678326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 718/1488] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:32 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:33.019932 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-b43f77b7-5634-42d9-98de-943a572195ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:33.020887 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-b43f77b7-5634-42d9-98de-943a572195ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:33.026734 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b43f77b7-5634-42d9-98de-943a572195ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:33.027214 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b43f77b7-5634-42d9-98de-943a572195ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:33.027979 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b43f77b7-5634-42d9-98de-943a572195ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:33.028416 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-b43f77b7-5634-42d9-98de-943a572195ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:33.058193 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-b43f77b7-5634-42d9-98de-943a572195ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042153 May 10 21:17:33.058735 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 771/1489] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:33 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:33.321106 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-98ff3d04-ecfc-417e-8d87-bd9ee37fb714 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:33.321938 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-98ff3d04-ecfc-417e-8d87-bd9ee37fb714 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:33.327865 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-98ff3d04-ecfc-417e-8d87-bd9ee37fb714 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:33.328311 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-98ff3d04-ecfc-417e-8d87-bd9ee37fb714 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:33.329070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-98ff3d04-ecfc-417e-8d87-bd9ee37fb714 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:33.329501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-98ff3d04-ecfc-417e-8d87-bd9ee37fb714 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:33.359612 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-98ff3d04-ecfc-417e-8d87-bd9ee37fb714 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042063 May 10 21:17:33.360203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 719/1490] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:33 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:33.624455 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-58ee3391-b015-41b5-980b-e439eaaf429d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:33.625516 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-58ee3391-b015-41b5-980b-e439eaaf429d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:33.631885 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-58ee3391-b015-41b5-980b-e439eaaf429d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:33.632334 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-58ee3391-b015-41b5-980b-e439eaaf429d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:33.633100 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-58ee3391-b015-41b5-980b-e439eaaf429d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:33.633537 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-58ee3391-b015-41b5-980b-e439eaaf429d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:33.662808 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-58ee3391-b015-41b5-980b-e439eaaf429d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042320 May 10 21:17:33.663388 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 772/1491] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:33 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:33.695205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d6820763-ddc2-49e4-84fd-00c8a34cc120 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:33.695850 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d6820763-ddc2-49e4-84fd-00c8a34cc120 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:33.702115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6820763-ddc2-49e4-84fd-00c8a34cc120 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:33.703558 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6820763-ddc2-49e4-84fd-00c8a34cc120 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:33.704337 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6820763-ddc2-49e4-84fd-00c8a34cc120 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:33.704778 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6820763-ddc2-49e4-84fd-00c8a34cc120 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:33.835244 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d6820763-ddc2-49e4-84fd-00c8a34cc120 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:33.842528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d6820763-ddc2-49e4-84fd-00c8a34cc120 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151455 May 10 21:17:33.843809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 720/1492] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:33 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:34.070207 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-0428f27f-5dc0-46bf-9dc0-8ebfb67e2ed0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:34.071056 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-0428f27f-5dc0-46bf-9dc0-8ebfb67e2ed0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:34.076959 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0428f27f-5dc0-46bf-9dc0-8ebfb67e2ed0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:34.077410 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0428f27f-5dc0-46bf-9dc0-8ebfb67e2ed0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:34.078487 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0428f27f-5dc0-46bf-9dc0-8ebfb67e2ed0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:34.078931 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-0428f27f-5dc0-46bf-9dc0-8ebfb67e2ed0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:34.107242 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-0428f27f-5dc0-46bf-9dc0-8ebfb67e2ed0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041316 May 10 21:17:34.107797 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 773/1493] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:34 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:34.371530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dcd29b92-d137-4b08-9d95-88d0be62ca00 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:34.372451 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dcd29b92-d137-4b08-9d95-88d0be62ca00 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:34.378990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dcd29b92-d137-4b08-9d95-88d0be62ca00 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:34.379465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dcd29b92-d137-4b08-9d95-88d0be62ca00 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:34.380382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dcd29b92-d137-4b08-9d95-88d0be62ca00 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:34.380823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dcd29b92-d137-4b08-9d95-88d0be62ca00 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:34.409186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dcd29b92-d137-4b08-9d95-88d0be62ca00 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041623 May 10 21:17:34.410003 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 721/1494] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:34 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:34.674938 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-a47bc915-baed-40af-95eb-b617a51c35ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:34.675825 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-a47bc915-baed-40af-95eb-b617a51c35ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:34.682085 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a47bc915-baed-40af-95eb-b617a51c35ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:34.682530 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a47bc915-baed-40af-95eb-b617a51c35ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:34.683322 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a47bc915-baed-40af-95eb-b617a51c35ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:34.683755 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-a47bc915-baed-40af-95eb-b617a51c35ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:34.711933 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-a47bc915-baed-40af-95eb-b617a51c35ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041637 May 10 21:17:34.712470 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 774/1495] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:34 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:34.861064 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e2afbf14-daf8-4ea0-ad33-5e990b315b00 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:34.861674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e2afbf14-daf8-4ea0-ad33-5e990b315b00 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:34.868029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e2afbf14-daf8-4ea0-ad33-5e990b315b00 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:34.868477 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e2afbf14-daf8-4ea0-ad33-5e990b315b00 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:34.869240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e2afbf14-daf8-4ea0-ad33-5e990b315b00 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:34.869677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e2afbf14-daf8-4ea0-ad33-5e990b315b00 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:35.008945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e2afbf14-daf8-4ea0-ad33-5e990b315b00 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:35.016972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e2afbf14-daf8-4ea0-ad33-5e990b315b00 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.160532 May 10 21:17:35.017533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 722/1496] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:34 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:35.121589 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-55156359-2017-4022-9a4f-fb35d6d09122 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:35.122515 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-55156359-2017-4022-9a4f-fb35d6d09122 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:35.128603 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-55156359-2017-4022-9a4f-fb35d6d09122 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:35.129046 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-55156359-2017-4022-9a4f-fb35d6d09122 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:35.129801 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-55156359-2017-4022-9a4f-fb35d6d09122 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:35.130235 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-55156359-2017-4022-9a4f-fb35d6d09122 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:35.159174 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-55156359-2017-4022-9a4f-fb35d6d09122 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041481 May 10 21:17:35.159707 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 775/1497] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:35 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:35.420520 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-74e654e4-cc62-4afe-98dc-14ae8ddc2744 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:35.421635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-74e654e4-cc62-4afe-98dc-14ae8ddc2744 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:35.427869 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74e654e4-cc62-4afe-98dc-14ae8ddc2744 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:35.428326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74e654e4-cc62-4afe-98dc-14ae8ddc2744 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:35.429096 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74e654e4-cc62-4afe-98dc-14ae8ddc2744 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:35.429533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74e654e4-cc62-4afe-98dc-14ae8ddc2744 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:35.459233 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-74e654e4-cc62-4afe-98dc-14ae8ddc2744 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042689 May 10 21:17:35.459786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 723/1498] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:35 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:35.723662 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.api.openstack.wsgi [None req-ee6d3308-4a7e-4e65-97a7-064b57b93076 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:35.724531 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG nova.compute.api [None req-ee6d3308-4a7e-4e65-97a7-064b57b93076 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117713) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:35.730738 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ee6d3308-4a7e-4e65-97a7-064b57b93076 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:35.731209 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ee6d3308-4a7e-4e65-97a7-064b57b93076 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:35.731967 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ee6d3308-4a7e-4e65-97a7-064b57b93076 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:35.732399 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: DEBUG oslo_concurrency.lockutils [None req-ee6d3308-4a7e-4e65-97a7-064b57b93076 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:35.761391 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: INFO nova.api.openstack.requestlog [None req-ee6d3308-4a7e-4e65-97a7-064b57b93076 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041723 May 10 21:17:35.762450 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: [pid: 117713|app: 0|req: 776/1499] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:35 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:36.034586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8c81bc72-2b95-476c-a8d4-8b00e5405387 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:36.035166 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8c81bc72-2b95-476c-a8d4-8b00e5405387 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:36.041659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c81bc72-2b95-476c-a8d4-8b00e5405387 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:36.042151 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c81bc72-2b95-476c-a8d4-8b00e5405387 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:36.042931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c81bc72-2b95-476c-a8d4-8b00e5405387 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:36.043414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c81bc72-2b95-476c-a8d4-8b00e5405387 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:36.176638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8c81bc72-2b95-476c-a8d4-8b00e5405387 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:36.179990 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: Traceback (most recent call last): May 10 21:17:36.180143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 10 21:17:36.180143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: timer() May 10 21:17:36.180143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 10 21:17:36.180143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: cb(*args, **kw) May 10 21:17:36.180143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire May 10 21:17:36.180143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: waiter.switch() May 10 21:17:36.180143 dv-cinder-828807-2-iscsi devstack@n-api.service[117713]: greenlet.error: cannot switch to a different thread May 10 21:17:36.184374 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8c81bc72-2b95-476c-a8d4-8b00e5405387 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.154464 May 10 21:17:36.184967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 724/1500] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:36 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:36.471742 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1c3d6f51-01e7-40ab-b0ea-cc7dfd967096 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:36.472659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1c3d6f51-01e7-40ab-b0ea-cc7dfd967096 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:36.478550 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1c3d6f51-01e7-40ab-b0ea-cc7dfd967096 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:36.478997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1c3d6f51-01e7-40ab-b0ea-cc7dfd967096 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:36.479794 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1c3d6f51-01e7-40ab-b0ea-cc7dfd967096 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:36.480233 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1c3d6f51-01e7-40ab-b0ea-cc7dfd967096 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:36.508169 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1c3d6f51-01e7-40ab-b0ea-cc7dfd967096 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041436 May 10 21:17:36.508717 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 725/1501] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:36 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:17:36.773621 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3e2bef2d-8b94-44f3-9d63-f54e582543de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:36.774558 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3e2bef2d-8b94-44f3-9d63-f54e582543de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:36.780565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3e2bef2d-8b94-44f3-9d63-f54e582543de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:36.781125 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3e2bef2d-8b94-44f3-9d63-f54e582543de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:36.781894 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3e2bef2d-8b94-44f3-9d63-f54e582543de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:36.782345 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3e2bef2d-8b94-44f3-9d63-f54e582543de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:36.810419 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3e2bef2d-8b94-44f3-9d63-f54e582543de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040740 May 10 21:17:36.810974 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 726/1502] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:36 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:17:37.202549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c90a87df-548c-411d-887a-28e5b251631e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:37.203196 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c90a87df-548c-411d-887a-28e5b251631e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:37.209625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c90a87df-548c-411d-887a-28e5b251631e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:37.210075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c90a87df-548c-411d-887a-28e5b251631e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:37.210843 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c90a87df-548c-411d-887a-28e5b251631e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:37.211315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c90a87df-548c-411d-887a-28e5b251631e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:37.345760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c90a87df-548c-411d-887a-28e5b251631e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:37.353063 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c90a87df-548c-411d-887a-28e5b251631e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.154407 May 10 21:17:37.353623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 727/1503] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:37 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:17:37.519234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c42b4846-8dce-4911-80cf-d185034044ba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:37.520086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c42b4846-8dce-4911-80cf-d185034044ba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:37.525948 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c42b4846-8dce-4911-80cf-d185034044ba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:37.526402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c42b4846-8dce-4911-80cf-d185034044ba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:37.527203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c42b4846-8dce-4911-80cf-d185034044ba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:37.527649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c42b4846-8dce-4911-80cf-d185034044ba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:37.556654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c42b4846-8dce-4911-80cf-d185034044ba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041368 May 10 21:17:37.557199 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 728/1504] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:37 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:17:37.822095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-211e0288-02b3-437f-bd33-be3dfaa4085e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:37.823037 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-211e0288-02b3-437f-bd33-be3dfaa4085e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:37.829083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-211e0288-02b3-437f-bd33-be3dfaa4085e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:37.829533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-211e0288-02b3-437f-bd33-be3dfaa4085e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:37.830306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-211e0288-02b3-437f-bd33-be3dfaa4085e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:37.830747 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-211e0288-02b3-437f-bd33-be3dfaa4085e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:37.859839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-211e0288-02b3-437f-bd33-be3dfaa4085e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041912 May 10 21:17:37.860388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 729/1505] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:37 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:17:38.371997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-336456a5-5162-47ca-93ca-7f18d9a53917 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:38.372618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-336456a5-5162-47ca-93ca-7f18d9a53917 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:38.379010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-336456a5-5162-47ca-93ca-7f18d9a53917 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:38.379493 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-336456a5-5162-47ca-93ca-7f18d9a53917 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:38.380255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-336456a5-5162-47ca-93ca-7f18d9a53917 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:38.380694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-336456a5-5162-47ca-93ca-7f18d9a53917 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:38.510155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-336456a5-5162-47ca-93ca-7f18d9a53917 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:38.517805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-336456a5-5162-47ca-93ca-7f18d9a53917 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.149764 May 10 21:17:38.518363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 730/1506] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:38 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:17:38.568134 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5ba9b642-f1d1-4ada-8c41-82d175e74a56 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:38.568979 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5ba9b642-f1d1-4ada-8c41-82d175e74a56 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:38.575018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ba9b642-f1d1-4ada-8c41-82d175e74a56 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:38.575501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ba9b642-f1d1-4ada-8c41-82d175e74a56 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:38.576273 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ba9b642-f1d1-4ada-8c41-82d175e74a56 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:38.576706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ba9b642-f1d1-4ada-8c41-82d175e74a56 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:38.615834 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5ba9b642-f1d1-4ada-8c41-82d175e74a56 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051473 May 10 21:17:38.616392 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 731/1507] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:38 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:17:38.871284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a345846c-541f-44cb-a9fd-a0ec46662259 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:38.872249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a345846c-541f-44cb-a9fd-a0ec46662259 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:38.878275 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a345846c-541f-44cb-a9fd-a0ec46662259 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:38.878730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a345846c-541f-44cb-a9fd-a0ec46662259 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:38.879537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a345846c-541f-44cb-a9fd-a0ec46662259 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:38.879983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a345846c-541f-44cb-a9fd-a0ec46662259 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:38.909912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a345846c-541f-44cb-a9fd-a0ec46662259 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042544 May 10 21:17:38.910501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 732/1508] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:38 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:17:39.535215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-28bfc927-c510-4ecf-9f27-17f336faafa4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:39.535823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-28bfc927-c510-4ecf-9f27-17f336faafa4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:39.542132 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28bfc927-c510-4ecf-9f27-17f336faafa4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:39.542580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28bfc927-c510-4ecf-9f27-17f336faafa4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:39.543372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28bfc927-c510-4ecf-9f27-17f336faafa4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:39.543807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28bfc927-c510-4ecf-9f27-17f336faafa4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:39.674908 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-28bfc927-c510-4ecf-9f27-17f336faafa4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:39.682314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-28bfc927-c510-4ecf-9f27-17f336faafa4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151653 May 10 21:17:39.684268 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 733/1509] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:39 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:17:39.687662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-16344cd3-9916-426e-9992-9ce90323a89a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:39.688574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-16344cd3-9916-426e-9992-9ce90323a89a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:39.694077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-16344cd3-9916-426e-9992-9ce90323a89a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:39.694784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-16344cd3-9916-426e-9992-9ce90323a89a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:39.695577 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-16344cd3-9916-426e-9992-9ce90323a89a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:39.696013 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-16344cd3-9916-426e-9992-9ce90323a89a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:39.726887 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-16344cd3-9916-426e-9992-9ce90323a89a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042974 May 10 21:17:39.727462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 734/1510] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:39 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:39.921535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ce4da2ff-9447-4903-8be0-3cab3e30bb77 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:39.922586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ce4da2ff-9447-4903-8be0-3cab3e30bb77 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:39.928458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ce4da2ff-9447-4903-8be0-3cab3e30bb77 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:39.928901 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ce4da2ff-9447-4903-8be0-3cab3e30bb77 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:39.929825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ce4da2ff-9447-4903-8be0-3cab3e30bb77 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:39.930258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ce4da2ff-9447-4903-8be0-3cab3e30bb77 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:39.960148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ce4da2ff-9447-4903-8be0-3cab3e30bb77 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042547 May 10 21:17:39.960687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 735/1511] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:39 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:17:40.700215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4e1ad6d3-9368-4828-9115-e4d125564dec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:40.700814 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4e1ad6d3-9368-4828-9115-e4d125564dec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:40.707143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4e1ad6d3-9368-4828-9115-e4d125564dec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:40.707599 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4e1ad6d3-9368-4828-9115-e4d125564dec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:40.708355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4e1ad6d3-9368-4828-9115-e4d125564dec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:40.708789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4e1ad6d3-9368-4828-9115-e4d125564dec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:40.841567 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4e1ad6d3-9368-4828-9115-e4d125564dec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:40.849649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4e1ad6d3-9368-4828-9115-e4d125564dec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.153326 May 10 21:17:40.850238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 736/1512] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:40 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:17:40.854728 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c60087e0-5828-4fcb-a42a-c79d6319dd80 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:40.855663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c60087e0-5828-4fcb-a42a-c79d6319dd80 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:40.861868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c60087e0-5828-4fcb-a42a-c79d6319dd80 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:40.862254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c60087e0-5828-4fcb-a42a-c79d6319dd80 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:40.863076 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c60087e0-5828-4fcb-a42a-c79d6319dd80 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:40.863534 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c60087e0-5828-4fcb-a42a-c79d6319dd80 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:40.891978 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c60087e0-5828-4fcb-a42a-c79d6319dd80 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040757 May 10 21:17:40.892528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 737/1513] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:40 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:40.971834 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-81cbdf20-92de-42f8-8dba-de76f80e6b70 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:40.972741 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-81cbdf20-92de-42f8-8dba-de76f80e6b70 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:40.978515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-81cbdf20-92de-42f8-8dba-de76f80e6b70 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:40.978960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-81cbdf20-92de-42f8-8dba-de76f80e6b70 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:40.979755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-81cbdf20-92de-42f8-8dba-de76f80e6b70 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:40.980193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-81cbdf20-92de-42f8-8dba-de76f80e6b70 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:41.008034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-81cbdf20-92de-42f8-8dba-de76f80e6b70 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040508 May 10 21:17:41.008564 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 738/1514] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:40 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:17:41.867754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4c2777ea-2e27-47fa-ab04-21c6610c1af4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:41.868371 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4c2777ea-2e27-47fa-ab04-21c6610c1af4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:41.875024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4c2777ea-2e27-47fa-ab04-21c6610c1af4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:41.875517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4c2777ea-2e27-47fa-ab04-21c6610c1af4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:41.876288 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4c2777ea-2e27-47fa-ab04-21c6610c1af4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:41.876726 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4c2777ea-2e27-47fa-ab04-21c6610c1af4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:42.005797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4c2777ea-2e27-47fa-ab04-21c6610c1af4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:42.013238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4c2777ea-2e27-47fa-ab04-21c6610c1af4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.149466 May 10 21:17:42.013831 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 739/1515] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:41 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:17:42.019913 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ce412f67-b4ba-41c5-8d82-8c93657fd34f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:42.020825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ce412f67-b4ba-41c5-8d82-8c93657fd34f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:42.026487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ce412f67-b4ba-41c5-8d82-8c93657fd34f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:42.026935 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ce412f67-b4ba-41c5-8d82-8c93657fd34f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:42.027729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ce412f67-b4ba-41c5-8d82-8c93657fd34f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:42.028166 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ce412f67-b4ba-41c5-8d82-8c93657fd34f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:42.057107 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ce412f67-b4ba-41c5-8d82-8c93657fd34f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042199 May 10 21:17:42.057663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 740/1516] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:42 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:42.062710 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f4658802-380f-438b-9239-c3bbc93e5a91 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:42.063647 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f4658802-380f-438b-9239-c3bbc93e5a91 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:42.069071 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4658802-380f-438b-9239-c3bbc93e5a91 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:42.069776 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4658802-380f-438b-9239-c3bbc93e5a91 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:42.070538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4658802-380f-438b-9239-c3bbc93e5a91 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:42.071007 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4658802-380f-438b-9239-c3bbc93e5a91 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:42.099521 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f4658802-380f-438b-9239-c3bbc93e5a91 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040840 May 10 21:17:42.100076 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 741/1517] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:42 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:43.030460 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fa37a07b-2fa8-4209-b08c-ed14d868cd5c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:43.031184 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fa37a07b-2fa8-4209-b08c-ed14d868cd5c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:43.037385 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fa37a07b-2fa8-4209-b08c-ed14d868cd5c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:43.037834 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fa37a07b-2fa8-4209-b08c-ed14d868cd5c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:43.038590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fa37a07b-2fa8-4209-b08c-ed14d868cd5c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:43.039026 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fa37a07b-2fa8-4209-b08c-ed14d868cd5c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:43.169054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fa37a07b-2fa8-4209-b08c-ed14d868cd5c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:43.177155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fa37a07b-2fa8-4209-b08c-ed14d868cd5c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.150712 May 10 21:17:43.177711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 742/1518] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:43 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:17:43.182508 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ab495fa7-20d3-4503-ae1e-34e222fecaad tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:43.183439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ab495fa7-20d3-4503-ae1e-34e222fecaad tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:43.189914 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab495fa7-20d3-4503-ae1e-34e222fecaad tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:43.190364 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab495fa7-20d3-4503-ae1e-34e222fecaad tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:43.191161 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab495fa7-20d3-4503-ae1e-34e222fecaad tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:43.191600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab495fa7-20d3-4503-ae1e-34e222fecaad tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:43.220418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ab495fa7-20d3-4503-ae1e-34e222fecaad tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041725 May 10 21:17:43.220965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 743/1519] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:43 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:43.225344 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0847334a-45fd-44f4-84db-c792fd3143f9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:43.226228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0847334a-45fd-44f4-84db-c792fd3143f9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:43.232514 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0847334a-45fd-44f4-84db-c792fd3143f9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:43.232951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0847334a-45fd-44f4-84db-c792fd3143f9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:43.234263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0847334a-45fd-44f4-84db-c792fd3143f9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:43.234722 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0847334a-45fd-44f4-84db-c792fd3143f9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:43.263217 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0847334a-45fd-44f4-84db-c792fd3143f9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041252 May 10 21:17:43.263765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 744/1520] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:43 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:44.196481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0e951370-5bd7-4b3d-a652-a7a1586ed8ca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:44.197182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0e951370-5bd7-4b3d-a652-a7a1586ed8ca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:44.203399 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0e951370-5bd7-4b3d-a652-a7a1586ed8ca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:44.203853 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0e951370-5bd7-4b3d-a652-a7a1586ed8ca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:44.204631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0e951370-5bd7-4b3d-a652-a7a1586ed8ca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:44.205072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0e951370-5bd7-4b3d-a652-a7a1586ed8ca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:44.234872 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:17:44.235249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Tue May 10 21:17:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f (ip 10.222.0.49) !!! May 10 21:17:44.334984 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0e951370-5bd7-4b3d-a652-a7a1586ed8ca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:44.342409 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0e951370-5bd7-4b3d-a652-a7a1586ed8ca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.150191 May 10 21:17:44.343721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 745/1521] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:44 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:17:44.348559 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-960232f6-3428-4395-9351-40a4e59fbecd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:44.349466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-960232f6-3428-4395-9351-40a4e59fbecd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:44.355000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-960232f6-3428-4395-9351-40a4e59fbecd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:44.355483 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-960232f6-3428-4395-9351-40a4e59fbecd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:44.356248 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-960232f6-3428-4395-9351-40a4e59fbecd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:44.356685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-960232f6-3428-4395-9351-40a4e59fbecd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:44.386538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-960232f6-3428-4395-9351-40a4e59fbecd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041826 May 10 21:17:44.387077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 746/1522] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:44 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:44.391798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fdc1c870-a71b-4f57-b636-3d00e450c4b4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:44.392683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fdc1c870-a71b-4f57-b636-3d00e450c4b4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:44.397993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fdc1c870-a71b-4f57-b636-3d00e450c4b4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:44.398443 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fdc1c870-a71b-4f57-b636-3d00e450c4b4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:44.399229 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fdc1c870-a71b-4f57-b636-3d00e450c4b4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:44.399671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fdc1c870-a71b-4f57-b636-3d00e450c4b4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:44.428787 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fdc1c870-a71b-4f57-b636-3d00e450c4b4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040617 May 10 21:17:44.429339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 747/1523] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:44 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:45.361634 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c2ee8bf3-61d5-4aa0-b6ea-6ae4c98363ac tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:45.362310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c2ee8bf3-61d5-4aa0-b6ea-6ae4c98363ac tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:45.368672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c2ee8bf3-61d5-4aa0-b6ea-6ae4c98363ac tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:45.369124 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c2ee8bf3-61d5-4aa0-b6ea-6ae4c98363ac tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:45.369922 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c2ee8bf3-61d5-4aa0-b6ea-6ae4c98363ac tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:45.370361 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c2ee8bf3-61d5-4aa0-b6ea-6ae4c98363ac tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:45.497729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c2ee8bf3-61d5-4aa0-b6ea-6ae4c98363ac tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:45.505308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c2ee8bf3-61d5-4aa0-b6ea-6ae4c98363ac tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.148547 May 10 21:17:45.505871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 748/1524] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:45 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:17:45.510388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1891c106-cd58-4b4e-aec5-7bbc6186ad1f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:45.511391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1891c106-cd58-4b4e-aec5-7bbc6186ad1f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:45.517336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1891c106-cd58-4b4e-aec5-7bbc6186ad1f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:45.517788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1891c106-cd58-4b4e-aec5-7bbc6186ad1f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:45.518561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1891c106-cd58-4b4e-aec5-7bbc6186ad1f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:45.519000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1891c106-cd58-4b4e-aec5-7bbc6186ad1f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:45.548674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1891c106-cd58-4b4e-aec5-7bbc6186ad1f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041811 May 10 21:17:45.549223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 749/1525] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:45 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:45.553618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5548af26-1afd-421e-878d-d332a1076e3a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:45.554613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5548af26-1afd-421e-878d-d332a1076e3a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:45.560003 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5548af26-1afd-421e-878d-d332a1076e3a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:45.560458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5548af26-1afd-421e-878d-d332a1076e3a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:45.561223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5548af26-1afd-421e-878d-d332a1076e3a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:45.561670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5548af26-1afd-421e-878d-d332a1076e3a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:45.591061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5548af26-1afd-421e-878d-d332a1076e3a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040827 May 10 21:17:45.591645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 750/1526] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:45 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:46.523228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-772c858c-d047-4cf0-ae9d-c1aa4792bc31 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:46.523862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-772c858c-d047-4cf0-ae9d-c1aa4792bc31 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:46.530171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-772c858c-d047-4cf0-ae9d-c1aa4792bc31 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:46.530677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-772c858c-d047-4cf0-ae9d-c1aa4792bc31 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:46.531482 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-772c858c-d047-4cf0-ae9d-c1aa4792bc31 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:46.531923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-772c858c-d047-4cf0-ae9d-c1aa4792bc31 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:46.663506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-772c858c-d047-4cf0-ae9d-c1aa4792bc31 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:46.670772 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-772c858c-d047-4cf0-ae9d-c1aa4792bc31 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151522 May 10 21:17:46.672186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 751/1527] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:46 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:17:46.676644 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dc060176-f8b7-4651-b7bf-237cd683f924 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:46.677554 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dc060176-f8b7-4651-b7bf-237cd683f924 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:46.683317 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dc060176-f8b7-4651-b7bf-237cd683f924 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:46.683805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dc060176-f8b7-4651-b7bf-237cd683f924 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:46.684588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dc060176-f8b7-4651-b7bf-237cd683f924 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:46.685030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dc060176-f8b7-4651-b7bf-237cd683f924 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:46.713618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dc060176-f8b7-4651-b7bf-237cd683f924 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040495 May 10 21:17:46.714172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 752/1528] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:46 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:46.719293 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d625e00a-036a-4bf0-ae4c-56d4fe59b87c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:46.720185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d625e00a-036a-4bf0-ae4c-56d4fe59b87c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:46.725585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d625e00a-036a-4bf0-ae4c-56d4fe59b87c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:46.726038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d625e00a-036a-4bf0-ae4c-56d4fe59b87c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:46.726801 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d625e00a-036a-4bf0-ae4c-56d4fe59b87c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:46.727274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d625e00a-036a-4bf0-ae4c-56d4fe59b87c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:46.755880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d625e00a-036a-4bf0-ae4c-56d4fe59b87c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040748 May 10 21:17:46.756427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 753/1529] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:46 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:47.688968 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-39eaf9b6-ccfd-4e10-861d-dda6c6ae982b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:47.689574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-39eaf9b6-ccfd-4e10-861d-dda6c6ae982b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:47.696251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39eaf9b6-ccfd-4e10-861d-dda6c6ae982b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:47.696706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39eaf9b6-ccfd-4e10-861d-dda6c6ae982b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:47.697473 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39eaf9b6-ccfd-4e10-861d-dda6c6ae982b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:47.697909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39eaf9b6-ccfd-4e10-861d-dda6c6ae982b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:47.826200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-39eaf9b6-ccfd-4e10-861d-dda6c6ae982b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:47.834113 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-39eaf9b6-ccfd-4e10-861d-dda6c6ae982b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.149163 May 10 21:17:47.834668 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 754/1530] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:47 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:17:47.839172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-612a2b63-b9d2-488f-b43b-b71852577752 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:47.840093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-612a2b63-b9d2-488f-b43b-b71852577752 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:47.846032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-612a2b63-b9d2-488f-b43b-b71852577752 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:47.846475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-612a2b63-b9d2-488f-b43b-b71852577752 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:47.847266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-612a2b63-b9d2-488f-b43b-b71852577752 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:47.847700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-612a2b63-b9d2-488f-b43b-b71852577752 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:47.876916 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-612a2b63-b9d2-488f-b43b-b71852577752 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041143 May 10 21:17:47.877386 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 755/1531] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:47 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:47.881795 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-aeb3a977-874b-4f9b-b5cf-655d062ae754 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:47.882689 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-aeb3a977-874b-4f9b-b5cf-655d062ae754 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:47.888401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aeb3a977-874b-4f9b-b5cf-655d062ae754 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:47.888838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aeb3a977-874b-4f9b-b5cf-655d062ae754 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:47.889590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aeb3a977-874b-4f9b-b5cf-655d062ae754 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:47.890650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aeb3a977-874b-4f9b-b5cf-655d062ae754 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:47.918829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-aeb3a977-874b-4f9b-b5cf-655d062ae754 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040481 May 10 21:17:47.919408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 756/1532] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:47 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:48.851907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-01e7393e-480c-4961-b037-84e7145ac8c0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:48.852556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-01e7393e-480c-4961-b037-84e7145ac8c0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:48.859909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01e7393e-480c-4961-b037-84e7145ac8c0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:48.860352 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01e7393e-480c-4961-b037-84e7145ac8c0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:48.861196 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01e7393e-480c-4961-b037-84e7145ac8c0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:48.861644 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01e7393e-480c-4961-b037-84e7145ac8c0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:48.994275 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-01e7393e-480c-4961-b037-84e7145ac8c0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:49.002084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-01e7393e-480c-4961-b037-84e7145ac8c0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.154054 May 10 21:17:49.002640 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 757/1533] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:48 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:17:49.007161 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e1c46757-82d9-4d3f-808a-1192c2c520cb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:49.008067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e1c46757-82d9-4d3f-808a-1192c2c520cb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:49.013515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e1c46757-82d9-4d3f-808a-1192c2c520cb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:49.013963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e1c46757-82d9-4d3f-808a-1192c2c520cb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:49.014732 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e1c46757-82d9-4d3f-808a-1192c2c520cb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:49.015772 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e1c46757-82d9-4d3f-808a-1192c2c520cb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:49.044383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e1c46757-82d9-4d3f-808a-1192c2c520cb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040729 May 10 21:17:49.044925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 758/1534] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:49 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:49.050426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8ce74461-75a3-4c1d-b69b-6c126139a083 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:49.051370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8ce74461-75a3-4c1d-b69b-6c126139a083 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:49.056785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ce74461-75a3-4c1d-b69b-6c126139a083 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:49.057232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ce74461-75a3-4c1d-b69b-6c126139a083 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:49.057993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ce74461-75a3-4c1d-b69b-6c126139a083 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:49.058462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ce74461-75a3-4c1d-b69b-6c126139a083 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:49.086743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8ce74461-75a3-4c1d-b69b-6c126139a083 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040857 May 10 21:17:49.087312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 759/1535] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:49 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:50.020048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-452a6a7c-b8fa-4c3b-bebe-dce4dd9fe819 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:50.020723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-452a6a7c-b8fa-4c3b-bebe-dce4dd9fe819 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:50.027022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-452a6a7c-b8fa-4c3b-bebe-dce4dd9fe819 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:50.027505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-452a6a7c-b8fa-4c3b-bebe-dce4dd9fe819 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:50.028273 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-452a6a7c-b8fa-4c3b-bebe-dce4dd9fe819 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:50.028709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-452a6a7c-b8fa-4c3b-bebe-dce4dd9fe819 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:50.159041 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-452a6a7c-b8fa-4c3b-bebe-dce4dd9fe819 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:50.166435 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-452a6a7c-b8fa-4c3b-bebe-dce4dd9fe819 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.150468 May 10 21:17:50.166997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 760/1536] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:50 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:17:50.171690 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-276f608c-a85a-4891-af50-52bf793baf2a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:50.172590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-276f608c-a85a-4891-af50-52bf793baf2a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:50.177985 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-276f608c-a85a-4891-af50-52bf793baf2a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:50.178437 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-276f608c-a85a-4891-af50-52bf793baf2a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:50.179233 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-276f608c-a85a-4891-af50-52bf793baf2a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:50.179671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-276f608c-a85a-4891-af50-52bf793baf2a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:50.208384 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-276f608c-a85a-4891-af50-52bf793baf2a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040367 May 10 21:17:50.208936 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 761/1537] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:50 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:50.213335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-deb37d30-19c2-4664-8ff5-5ff39f015139 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:50.214222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-deb37d30-19c2-4664-8ff5-5ff39f015139 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:50.224038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-deb37d30-19c2-4664-8ff5-5ff39f015139 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:50.224497 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-deb37d30-19c2-4664-8ff5-5ff39f015139 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:50.227107 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-deb37d30-19c2-4664-8ff5-5ff39f015139 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:50.227816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-deb37d30-19c2-4664-8ff5-5ff39f015139 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:50.256968 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-deb37d30-19c2-4664-8ff5-5ff39f015139 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047064 May 10 21:17:50.257528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 762/1538] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:50 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:51.183456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e788795a-31f1-475e-afdd-a6ae1a429eca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:51.184181 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e788795a-31f1-475e-afdd-a6ae1a429eca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:51.191608 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e788795a-31f1-475e-afdd-a6ae1a429eca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:51.192070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e788795a-31f1-475e-afdd-a6ae1a429eca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:51.192860 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e788795a-31f1-475e-afdd-a6ae1a429eca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:51.193300 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e788795a-31f1-475e-afdd-a6ae1a429eca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:51.326262 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e788795a-31f1-475e-afdd-a6ae1a429eca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:51.334731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e788795a-31f1-475e-afdd-a6ae1a429eca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.155332 May 10 21:17:51.335343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 763/1539] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:51 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:17:51.339898 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e11c6e32-0a26-4715-b9dc-7ce266b2af6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:51.340809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e11c6e32-0a26-4715-b9dc-7ce266b2af6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:51.346419 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e11c6e32-0a26-4715-b9dc-7ce266b2af6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:51.346867 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e11c6e32-0a26-4715-b9dc-7ce266b2af6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:51.347675 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e11c6e32-0a26-4715-b9dc-7ce266b2af6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:51.348115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e11c6e32-0a26-4715-b9dc-7ce266b2af6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:51.378211 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e11c6e32-0a26-4715-b9dc-7ce266b2af6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041855 May 10 21:17:51.378759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 764/1540] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:51 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:51.383141 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2288e79c-3e75-4ccb-b0a9-6aecccc0ee61 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:51.384030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2288e79c-3e75-4ccb-b0a9-6aecccc0ee61 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:51.389353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2288e79c-3e75-4ccb-b0a9-6aecccc0ee61 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:51.390928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2288e79c-3e75-4ccb-b0a9-6aecccc0ee61 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:51.391729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2288e79c-3e75-4ccb-b0a9-6aecccc0ee61 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:51.392176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2288e79c-3e75-4ccb-b0a9-6aecccc0ee61 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:51.420129 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2288e79c-3e75-4ccb-b0a9-6aecccc0ee61 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040387 May 10 21:17:51.420667 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 765/1541] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:51 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:52.352299 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-df8970a9-4437-4651-aae8-8209ac566abd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:52.352915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-df8970a9-4437-4651-aae8-8209ac566abd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:52.359318 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df8970a9-4437-4651-aae8-8209ac566abd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:52.359763 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df8970a9-4437-4651-aae8-8209ac566abd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:52.360522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df8970a9-4437-4651-aae8-8209ac566abd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:52.360951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df8970a9-4437-4651-aae8-8209ac566abd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:52.490638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-df8970a9-4437-4651-aae8-8209ac566abd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:52.498922 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-df8970a9-4437-4651-aae8-8209ac566abd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.150408 May 10 21:17:52.503023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 766/1542] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:52 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:17:52.504924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-74ca3a84-5a6d-4b8b-b662-928a365ed65f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:52.505815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-74ca3a84-5a6d-4b8b-b662-928a365ed65f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:52.511871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74ca3a84-5a6d-4b8b-b662-928a365ed65f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:52.512319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74ca3a84-5a6d-4b8b-b662-928a365ed65f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:52.513077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74ca3a84-5a6d-4b8b-b662-928a365ed65f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:52.513502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74ca3a84-5a6d-4b8b-b662-928a365ed65f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:52.542651 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-74ca3a84-5a6d-4b8b-b662-928a365ed65f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041579 May 10 21:17:52.543319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 767/1543] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:52 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:52.548232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-42cba3ec-de2d-43f2-8f40-3b11fd5894e2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:52.549124 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-42cba3ec-de2d-43f2-8f40-3b11fd5894e2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:52.554565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-42cba3ec-de2d-43f2-8f40-3b11fd5894e2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:52.555006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-42cba3ec-de2d-43f2-8f40-3b11fd5894e2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:52.555797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-42cba3ec-de2d-43f2-8f40-3b11fd5894e2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:52.556231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-42cba3ec-de2d-43f2-8f40-3b11fd5894e2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:52.585669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-42cba3ec-de2d-43f2-8f40-3b11fd5894e2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041307 May 10 21:17:52.586153 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 768/1544] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:52 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:53.517373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9769b5e7-ec18-4ec8-9837-eeaaa2f22d5a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:53.518077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9769b5e7-ec18-4ec8-9837-eeaaa2f22d5a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:53.524404 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9769b5e7-ec18-4ec8-9837-eeaaa2f22d5a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:53.524855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9769b5e7-ec18-4ec8-9837-eeaaa2f22d5a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:53.525627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9769b5e7-ec18-4ec8-9837-eeaaa2f22d5a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:53.526074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9769b5e7-ec18-4ec8-9837-eeaaa2f22d5a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:53.663699 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9769b5e7-ec18-4ec8-9837-eeaaa2f22d5a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:53.671731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9769b5e7-ec18-4ec8-9837-eeaaa2f22d5a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.158310 May 10 21:17:53.672515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 769/1545] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:53 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:17:53.677062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-90502e74-b76e-4f65-a279-54b936fac7eb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:53.678030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-90502e74-b76e-4f65-a279-54b936fac7eb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:53.683710 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-90502e74-b76e-4f65-a279-54b936fac7eb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:53.684154 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-90502e74-b76e-4f65-a279-54b936fac7eb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:53.684912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-90502e74-b76e-4f65-a279-54b936fac7eb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:53.685346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-90502e74-b76e-4f65-a279-54b936fac7eb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:53.714531 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-90502e74-b76e-4f65-a279-54b936fac7eb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041016 May 10 21:17:53.715074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 770/1546] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:53 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:53.719561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-12f1b966-6608-496b-91e2-19faf93d739e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:53.720437 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-12f1b966-6608-496b-91e2-19faf93d739e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:53.725781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-12f1b966-6608-496b-91e2-19faf93d739e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:53.726226 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-12f1b966-6608-496b-91e2-19faf93d739e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:53.726977 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-12f1b966-6608-496b-91e2-19faf93d739e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:53.727436 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-12f1b966-6608-496b-91e2-19faf93d739e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:53.756835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-12f1b966-6608-496b-91e2-19faf93d739e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040658 May 10 21:17:53.757380 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 771/1547] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:53 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:54.689338 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-abbc2ba5-3a05-4399-b7aa-7e6e9e4b031f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:54.689983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-abbc2ba5-3a05-4399-b7aa-7e6e9e4b031f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:54.696603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-abbc2ba5-3a05-4399-b7aa-7e6e9e4b031f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:54.697206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-abbc2ba5-3a05-4399-b7aa-7e6e9e4b031f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:54.697817 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-abbc2ba5-3a05-4399-b7aa-7e6e9e4b031f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:54.698259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-abbc2ba5-3a05-4399-b7aa-7e6e9e4b031f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:54.833325 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-abbc2ba5-3a05-4399-b7aa-7e6e9e4b031f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:54.840664 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-abbc2ba5-3a05-4399-b7aa-7e6e9e4b031f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.155452 May 10 21:17:54.841222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 772/1548] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:54 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:17:54.845873 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-44dd41aa-d297-4e8e-98a3-b28e74fa710d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:54.846777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-44dd41aa-d297-4e8e-98a3-b28e74fa710d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:54.852305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44dd41aa-d297-4e8e-98a3-b28e74fa710d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:54.852749 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44dd41aa-d297-4e8e-98a3-b28e74fa710d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:54.853508 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44dd41aa-d297-4e8e-98a3-b28e74fa710d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:54.853942 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44dd41aa-d297-4e8e-98a3-b28e74fa710d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:54.883739 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-44dd41aa-d297-4e8e-98a3-b28e74fa710d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041383 May 10 21:17:54.884195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 773/1549] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:54 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:54.888665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-91358a34-6f0d-4254-9265-1193558872ed tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:54.889556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-91358a34-6f0d-4254-9265-1193558872ed tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:54.896019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91358a34-6f0d-4254-9265-1193558872ed tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:54.897347 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91358a34-6f0d-4254-9265-1193558872ed tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:54.897347 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91358a34-6f0d-4254-9265-1193558872ed tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:54.897714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91358a34-6f0d-4254-9265-1193558872ed tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:54.925631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-91358a34-6f0d-4254-9265-1193558872ed tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040438 May 10 21:17:54.926183 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 774/1550] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:54 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:55.857742 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-43c7d2b6-9da5-4a09-9bd7-e6e5da26744f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:55.858454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-43c7d2b6-9da5-4a09-9bd7-e6e5da26744f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:55.865298 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-43c7d2b6-9da5-4a09-9bd7-e6e5da26744f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:55.865746 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-43c7d2b6-9da5-4a09-9bd7-e6e5da26744f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:55.866510 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-43c7d2b6-9da5-4a09-9bd7-e6e5da26744f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:55.866946 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-43c7d2b6-9da5-4a09-9bd7-e6e5da26744f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:55.994687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-43c7d2b6-9da5-4a09-9bd7-e6e5da26744f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:56.002144 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-43c7d2b6-9da5-4a09-9bd7-e6e5da26744f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.148351 May 10 21:17:56.002698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 775/1551] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:55 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:17:56.007290 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2c96c358-3877-44cd-9b29-3313bfc2fc6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:56.008197 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2c96c358-3877-44cd-9b29-3313bfc2fc6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:56.013566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c96c358-3877-44cd-9b29-3313bfc2fc6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:56.014008 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c96c358-3877-44cd-9b29-3313bfc2fc6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:56.015457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c96c358-3877-44cd-9b29-3313bfc2fc6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:56.015854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c96c358-3877-44cd-9b29-3313bfc2fc6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:56.043630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2c96c358-3877-44cd-9b29-3313bfc2fc6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039847 May 10 21:17:56.044185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 776/1552] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:56 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:56.049479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9df92194-d4e0-4aa0-9e22-fddb8c77f3ca tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:56.050380 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9df92194-d4e0-4aa0-9e22-fddb8c77f3ca tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:56.056070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9df92194-d4e0-4aa0-9e22-fddb8c77f3ca tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:56.062343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9df92194-d4e0-4aa0-9e22-fddb8c77f3ca tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:56.062343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9df92194-d4e0-4aa0-9e22-fddb8c77f3ca tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:56.062343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9df92194-d4e0-4aa0-9e22-fddb8c77f3ca tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:56.093219 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9df92194-d4e0-4aa0-9e22-fddb8c77f3ca tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047915 May 10 21:17:56.093778 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 777/1553] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:56 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:57.019951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-be1e4e34-0ffd-4878-80ce-8e33b0ea96dc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:57.020585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-be1e4e34-0ffd-4878-80ce-8e33b0ea96dc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:57.026770 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be1e4e34-0ffd-4878-80ce-8e33b0ea96dc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:57.027318 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be1e4e34-0ffd-4878-80ce-8e33b0ea96dc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:57.028086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be1e4e34-0ffd-4878-80ce-8e33b0ea96dc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:57.028551 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be1e4e34-0ffd-4878-80ce-8e33b0ea96dc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:57.162741 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-be1e4e34-0ffd-4878-80ce-8e33b0ea96dc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:57.170196 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-be1e4e34-0ffd-4878-80ce-8e33b0ea96dc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.154503 May 10 21:17:57.170757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 778/1554] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:57 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:17:57.175958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-119c128e-da90-4554-9111-f126d469979e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:57.176956 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-119c128e-da90-4554-9111-f126d469979e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:57.182384 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-119c128e-da90-4554-9111-f126d469979e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:57.182822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-119c128e-da90-4554-9111-f126d469979e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:57.183605 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-119c128e-da90-4554-9111-f126d469979e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:57.184039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-119c128e-da90-4554-9111-f126d469979e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:57.213172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-119c128e-da90-4554-9111-f126d469979e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040637 May 10 21:17:57.213725 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 779/1555] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:57 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:57.219006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1864b162-818f-4ac4-8282-b6332c49a4be tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:57.219945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1864b162-818f-4ac4-8282-b6332c49a4be tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:57.225539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1864b162-818f-4ac4-8282-b6332c49a4be tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:57.225983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1864b162-818f-4ac4-8282-b6332c49a4be tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:57.226744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1864b162-818f-4ac4-8282-b6332c49a4be tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:57.227199 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1864b162-818f-4ac4-8282-b6332c49a4be tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:57.257644 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1864b162-818f-4ac4-8282-b6332c49a4be tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042919 May 10 21:17:57.258203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 780/1556] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:57 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:58.187295 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-52d22ce8-144d-4942-9d36-5f5701ce4864 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:58.187963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-52d22ce8-144d-4942-9d36-5f5701ce4864 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:58.194337 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52d22ce8-144d-4942-9d36-5f5701ce4864 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:58.195044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52d22ce8-144d-4942-9d36-5f5701ce4864 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:58.195845 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52d22ce8-144d-4942-9d36-5f5701ce4864 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:58.196280 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52d22ce8-144d-4942-9d36-5f5701ce4864 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:58.335714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-52d22ce8-144d-4942-9d36-5f5701ce4864 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:58.343577 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-52d22ce8-144d-4942-9d36-5f5701ce4864 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.159707 May 10 21:17:58.344242 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 781/1557] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:58 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:17:58.348753 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-956b7054-83c2-4121-912c-ffd2b9c1edc8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:58.349655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-956b7054-83c2-4121-912c-ffd2b9c1edc8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:58.355104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-956b7054-83c2-4121-912c-ffd2b9c1edc8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:58.355572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-956b7054-83c2-4121-912c-ffd2b9c1edc8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:58.356334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-956b7054-83c2-4121-912c-ffd2b9c1edc8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:58.356771 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-956b7054-83c2-4121-912c-ffd2b9c1edc8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:58.386080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-956b7054-83c2-4121-912c-ffd2b9c1edc8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040873 May 10 21:17:58.386613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 782/1558] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:58 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:58.391587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e06b1b5f-1bb1-43f7-829b-165e9a32e846 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:58.392463 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e06b1b5f-1bb1-43f7-829b-165e9a32e846 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:58.397811 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e06b1b5f-1bb1-43f7-829b-165e9a32e846 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:58.398257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e06b1b5f-1bb1-43f7-829b-165e9a32e846 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:58.399009 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e06b1b5f-1bb1-43f7-829b-165e9a32e846 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:58.399479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e06b1b5f-1bb1-43f7-829b-165e9a32e846 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:58.428271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e06b1b5f-1bb1-43f7-829b-165e9a32e846 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040668 May 10 21:17:58.428817 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 783/1559] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:58 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:17:59.360953 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-44d05b81-abdf-490f-9b72-c27bb07e50ff tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:59.361607 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-44d05b81-abdf-490f-9b72-c27bb07e50ff tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:59.368014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44d05b81-abdf-490f-9b72-c27bb07e50ff tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:59.368465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44d05b81-abdf-490f-9b72-c27bb07e50ff tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:59.369235 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44d05b81-abdf-490f-9b72-c27bb07e50ff tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:59.369675 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44d05b81-abdf-490f-9b72-c27bb07e50ff tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:59.498367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-44d05b81-abdf-490f-9b72-c27bb07e50ff tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:17:59.506414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-44d05b81-abdf-490f-9b72-c27bb07e50ff tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.149581 May 10 21:17:59.506976 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 784/1560] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:17:59 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:17:59.511638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bfb3e8a2-8fee-4e6a-9a8e-368e209749b9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:59.512533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bfb3e8a2-8fee-4e6a-9a8e-368e209749b9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:59.518663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfb3e8a2-8fee-4e6a-9a8e-368e209749b9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:59.519107 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfb3e8a2-8fee-4e6a-9a8e-368e209749b9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:59.519892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfb3e8a2-8fee-4e6a-9a8e-368e209749b9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:59.520328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfb3e8a2-8fee-4e6a-9a8e-368e209749b9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:59.548698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bfb3e8a2-8fee-4e6a-9a8e-368e209749b9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040689 May 10 21:17:59.549261 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 785/1561] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:17:59 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:17:59.553734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4f18aed3-ba4a-4ab2-be8b-829f9b69be54 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:17:59.554629 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4f18aed3-ba4a-4ab2-be8b-829f9b69be54 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:17:59.560095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f18aed3-ba4a-4ab2-be8b-829f9b69be54 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:59.560560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f18aed3-ba4a-4ab2-be8b-829f9b69be54 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:59.561328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f18aed3-ba4a-4ab2-be8b-829f9b69be54 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:17:59.562362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f18aed3-ba4a-4ab2-be8b-829f9b69be54 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:17:59.590820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4f18aed3-ba4a-4ab2-be8b-829f9b69be54 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040594 May 10 21:17:59.591395 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 786/1562] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:17:59 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:00.524120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-71ccc17c-9f71-4f11-aeb7-9f854c2e64f2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:00.524747 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-71ccc17c-9f71-4f11-aeb7-9f854c2e64f2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:00.531538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71ccc17c-9f71-4f11-aeb7-9f854c2e64f2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:00.532014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71ccc17c-9f71-4f11-aeb7-9f854c2e64f2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:00.532783 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71ccc17c-9f71-4f11-aeb7-9f854c2e64f2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:00.533223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71ccc17c-9f71-4f11-aeb7-9f854c2e64f2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:00.667760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-71ccc17c-9f71-4f11-aeb7-9f854c2e64f2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:00.675337 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-71ccc17c-9f71-4f11-aeb7-9f854c2e64f2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.155118 May 10 21:18:00.675897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 787/1563] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:00 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:00.680566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0f8290d1-d848-4fed-895a-32fa2776919c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:00.681469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0f8290d1-d848-4fed-895a-32fa2776919c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:00.687215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f8290d1-d848-4fed-895a-32fa2776919c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:00.687660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f8290d1-d848-4fed-895a-32fa2776919c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:00.688418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f8290d1-d848-4fed-895a-32fa2776919c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:00.688846 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f8290d1-d848-4fed-895a-32fa2776919c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:00.716999 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0f8290d1-d848-4fed-895a-32fa2776919c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040131 May 10 21:18:00.717542 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 788/1564] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:00 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:00.722817 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0c44b386-2fb1-49fb-9293-09fb09b3c93b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:00.723727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0c44b386-2fb1-49fb-9293-09fb09b3c93b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:00.729064 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c44b386-2fb1-49fb-9293-09fb09b3c93b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:00.729506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c44b386-2fb1-49fb-9293-09fb09b3c93b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:00.730253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c44b386-2fb1-49fb-9293-09fb09b3c93b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:00.730684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c44b386-2fb1-49fb-9293-09fb09b3c93b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:00.758799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0c44b386-2fb1-49fb-9293-09fb09b3c93b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039645 May 10 21:18:00.759353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 789/1565] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:00 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:01.693044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-95edcee4-cad3-4a9d-859a-26cdd478e65e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:01.693672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-95edcee4-cad3-4a9d-859a-26cdd478e65e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:01.700184 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-95edcee4-cad3-4a9d-859a-26cdd478e65e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:01.700630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-95edcee4-cad3-4a9d-859a-26cdd478e65e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:01.701387 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-95edcee4-cad3-4a9d-859a-26cdd478e65e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:01.701821 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-95edcee4-cad3-4a9d-859a-26cdd478e65e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:01.833911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-95edcee4-cad3-4a9d-859a-26cdd478e65e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:01.841210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-95edcee4-cad3-4a9d-859a-26cdd478e65e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.152115 May 10 21:18:01.841939 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 790/1566] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:01 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:01.846750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b5f0248f-a3df-4d86-8260-3ac5ee7c0e49 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:01.847678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b5f0248f-a3df-4d86-8260-3ac5ee7c0e49 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:01.853445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5f0248f-a3df-4d86-8260-3ac5ee7c0e49 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:01.853915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5f0248f-a3df-4d86-8260-3ac5ee7c0e49 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:01.854719 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5f0248f-a3df-4d86-8260-3ac5ee7c0e49 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:01.855237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5f0248f-a3df-4d86-8260-3ac5ee7c0e49 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:01.884887 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b5f0248f-a3df-4d86-8260-3ac5ee7c0e49 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041878 May 10 21:18:01.885372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 791/1567] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:01 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:01.890373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ed210a72-98a3-4089-9a00-7b00f752017a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:01.891308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ed210a72-98a3-4089-9a00-7b00f752017a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:01.896828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed210a72-98a3-4089-9a00-7b00f752017a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:01.897279 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed210a72-98a3-4089-9a00-7b00f752017a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:01.898044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed210a72-98a3-4089-9a00-7b00f752017a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:01.898486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed210a72-98a3-4089-9a00-7b00f752017a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:01.926774 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ed210a72-98a3-4089-9a00-7b00f752017a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040429 May 10 21:18:01.927539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 792/1568] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:01 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:02.857989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6787c570-9925-4c7d-a4aa-27470f850857 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:02.859620 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6787c570-9925-4c7d-a4aa-27470f850857 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:02.865990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6787c570-9925-4c7d-a4aa-27470f850857 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:02.866445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6787c570-9925-4c7d-a4aa-27470f850857 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:02.867260 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6787c570-9925-4c7d-a4aa-27470f850857 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:02.867699 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6787c570-9925-4c7d-a4aa-27470f850857 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:02.996740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6787c570-9925-4c7d-a4aa-27470f850857 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:03.005732 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6787c570-9925-4c7d-a4aa-27470f850857 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151221 May 10 21:18:03.005732 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 793/1569] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:02 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:03.010385 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-67b8cac6-986f-449d-b2d2-f2143f7ad744 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:03.011338 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-67b8cac6-986f-449d-b2d2-f2143f7ad744 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:03.017972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-67b8cac6-986f-449d-b2d2-f2143f7ad744 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:03.018430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-67b8cac6-986f-449d-b2d2-f2143f7ad744 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:03.019272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-67b8cac6-986f-449d-b2d2-f2143f7ad744 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:03.019718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-67b8cac6-986f-449d-b2d2-f2143f7ad744 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:03.049139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-67b8cac6-986f-449d-b2d2-f2143f7ad744 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042348 May 10 21:18:03.049693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 794/1570] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:03 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:03.054364 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0656efd9-e1a8-47e2-9c7a-b719d4890170 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:03.055318 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0656efd9-e1a8-47e2-9c7a-b719d4890170 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:03.060818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0656efd9-e1a8-47e2-9c7a-b719d4890170 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:03.061272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0656efd9-e1a8-47e2-9c7a-b719d4890170 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:03.062075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0656efd9-e1a8-47e2-9c7a-b719d4890170 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:03.062511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0656efd9-e1a8-47e2-9c7a-b719d4890170 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:03.090325 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0656efd9-e1a8-47e2-9c7a-b719d4890170 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039659 May 10 21:18:03.090876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 795/1571] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:03 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:04.022646 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-27454c02-1434-4e8c-977d-73790213df84 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:04.023330 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-27454c02-1434-4e8c-977d-73790213df84 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:04.030191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27454c02-1434-4e8c-977d-73790213df84 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:04.030846 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27454c02-1434-4e8c-977d-73790213df84 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:04.031473 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27454c02-1434-4e8c-977d-73790213df84 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:04.031917 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27454c02-1434-4e8c-977d-73790213df84 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:04.164943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-27454c02-1434-4e8c-977d-73790213df84 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:04.172897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-27454c02-1434-4e8c-977d-73790213df84 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.155006 May 10 21:18:04.173469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 796/1572] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:04 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:04.178003 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ade8a19f-08cd-49f0-9a61-085e07baeb01 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:04.178921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ade8a19f-08cd-49f0-9a61-085e07baeb01 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:04.184863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ade8a19f-08cd-49f0-9a61-085e07baeb01 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:04.185319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ade8a19f-08cd-49f0-9a61-085e07baeb01 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:04.186088 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ade8a19f-08cd-49f0-9a61-085e07baeb01 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:04.187825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ade8a19f-08cd-49f0-9a61-085e07baeb01 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:04.217434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ade8a19f-08cd-49f0-9a61-085e07baeb01 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042930 May 10 21:18:04.218266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 797/1573] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:04 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:04.223172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ac031deb-9b7e-4057-8fa2-13e1d5366786 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:04.224129 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ac031deb-9b7e-4057-8fa2-13e1d5366786 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:04.230129 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ac031deb-9b7e-4057-8fa2-13e1d5366786 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:04.230589 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ac031deb-9b7e-4057-8fa2-13e1d5366786 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:04.231588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ac031deb-9b7e-4057-8fa2-13e1d5366786 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:04.232033 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ac031deb-9b7e-4057-8fa2-13e1d5366786 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:04.263533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ac031deb-9b7e-4057-8fa2-13e1d5366786 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044302 May 10 21:18:04.264092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 798/1574] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:04 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:05.190310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-986a876a-cf74-4915-9e8e-cc27d13c684b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:05.191021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-986a876a-cf74-4915-9e8e-cc27d13c684b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:05.197709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-986a876a-cf74-4915-9e8e-cc27d13c684b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:05.198157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-986a876a-cf74-4915-9e8e-cc27d13c684b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:05.198913 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-986a876a-cf74-4915-9e8e-cc27d13c684b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:05.199372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-986a876a-cf74-4915-9e8e-cc27d13c684b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:05.330500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-986a876a-cf74-4915-9e8e-cc27d13c684b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:05.337863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-986a876a-cf74-4915-9e8e-cc27d13c684b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.152002 May 10 21:18:05.338435 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 799/1575] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:05 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:05.343272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-eaf60e92-811d-470d-b882-0cb18c7883b7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:05.344184 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-eaf60e92-811d-470d-b882-0cb18c7883b7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:05.349940 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eaf60e92-811d-470d-b882-0cb18c7883b7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:05.350382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eaf60e92-811d-470d-b882-0cb18c7883b7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:05.351162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eaf60e92-811d-470d-b882-0cb18c7883b7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:05.351600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eaf60e92-811d-470d-b882-0cb18c7883b7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:05.381350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-eaf60e92-811d-470d-b882-0cb18c7883b7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041860 May 10 21:18:05.381890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 800/1576] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:05 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:05.386390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bfb1995f-b886-462e-a69d-aa5a7c8e7968 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:05.387302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bfb1995f-b886-462e-a69d-aa5a7c8e7968 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:05.393193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfb1995f-b886-462e-a69d-aa5a7c8e7968 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:05.393631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfb1995f-b886-462e-a69d-aa5a7c8e7968 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:05.394381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfb1995f-b886-462e-a69d-aa5a7c8e7968 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:05.394812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfb1995f-b886-462e-a69d-aa5a7c8e7968 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:05.422448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bfb1995f-b886-462e-a69d-aa5a7c8e7968 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039597 May 10 21:18:05.422995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 801/1577] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:05 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:06.355702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ed4bb264-a6bd-4821-8f61-56235e8297eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:06.356316 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ed4bb264-a6bd-4821-8f61-56235e8297eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:06.363766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed4bb264-a6bd-4821-8f61-56235e8297eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:06.364248 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed4bb264-a6bd-4821-8f61-56235e8297eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:06.365016 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed4bb264-a6bd-4821-8f61-56235e8297eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:06.365483 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed4bb264-a6bd-4821-8f61-56235e8297eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:06.492743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ed4bb264-a6bd-4821-8f61-56235e8297eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:06.500698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ed4bb264-a6bd-4821-8f61-56235e8297eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.148939 May 10 21:18:06.501267 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 802/1578] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:06 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:06.505848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3d7311dd-3e4c-4bcf-af49-3bff552bf151 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:06.506773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3d7311dd-3e4c-4bcf-af49-3bff552bf151 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:06.512365 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d7311dd-3e4c-4bcf-af49-3bff552bf151 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:06.512815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d7311dd-3e4c-4bcf-af49-3bff552bf151 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:06.513591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d7311dd-3e4c-4bcf-af49-3bff552bf151 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:06.514031 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d7311dd-3e4c-4bcf-af49-3bff552bf151 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:06.543063 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3d7311dd-3e4c-4bcf-af49-3bff552bf151 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040799 May 10 21:18:06.543635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 803/1579] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:06 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:06.548165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-151fa66c-83cd-448a-aa6d-7fafe426d80d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:06.549051 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-151fa66c-83cd-448a-aa6d-7fafe426d80d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:06.554496 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-151fa66c-83cd-448a-aa6d-7fafe426d80d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:06.554947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-151fa66c-83cd-448a-aa6d-7fafe426d80d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:06.555748 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-151fa66c-83cd-448a-aa6d-7fafe426d80d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:06.556213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-151fa66c-83cd-448a-aa6d-7fafe426d80d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:06.584836 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-151fa66c-83cd-448a-aa6d-7fafe426d80d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040171 May 10 21:18:06.585308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 804/1580] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:06 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:07.518404 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c7713625-bb9e-4fcb-a4b4-308856ea07e0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:07.519075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c7713625-bb9e-4fcb-a4b4-308856ea07e0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:07.525363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c7713625-bb9e-4fcb-a4b4-308856ea07e0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:07.525806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c7713625-bb9e-4fcb-a4b4-308856ea07e0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:07.526560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c7713625-bb9e-4fcb-a4b4-308856ea07e0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:07.526993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c7713625-bb9e-4fcb-a4b4-308856ea07e0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:07.659327 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c7713625-bb9e-4fcb-a4b4-308856ea07e0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:07.666908 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c7713625-bb9e-4fcb-a4b4-308856ea07e0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.152968 May 10 21:18:07.667521 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 805/1581] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:07 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:07.673371 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a643bee6-edf9-4070-a43a-c1205c9526da tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:07.674290 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a643bee6-edf9-4070-a43a-c1205c9526da tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:07.681509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a643bee6-edf9-4070-a43a-c1205c9526da tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:07.682096 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a643bee6-edf9-4070-a43a-c1205c9526da tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:07.682937 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a643bee6-edf9-4070-a43a-c1205c9526da tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:07.683815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a643bee6-edf9-4070-a43a-c1205c9526da tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:07.712448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a643bee6-edf9-4070-a43a-c1205c9526da tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043922 May 10 21:18:07.713003 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 806/1582] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:07 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:07.717496 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-aa1f50de-2646-42db-8577-8e95f217d82e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:07.718941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-aa1f50de-2646-42db-8577-8e95f217d82e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:07.724353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aa1f50de-2646-42db-8577-8e95f217d82e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:07.724856 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aa1f50de-2646-42db-8577-8e95f217d82e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:07.725623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aa1f50de-2646-42db-8577-8e95f217d82e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:07.726097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aa1f50de-2646-42db-8577-8e95f217d82e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:07.754278 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-aa1f50de-2646-42db-8577-8e95f217d82e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040309 May 10 21:18:07.754822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 807/1583] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:07 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:08.684800 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3e0e4363-fa2c-4d5f-9490-4a279279b185 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:08.685408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3e0e4363-fa2c-4d5f-9490-4a279279b185 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:08.692350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3e0e4363-fa2c-4d5f-9490-4a279279b185 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:08.692797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3e0e4363-fa2c-4d5f-9490-4a279279b185 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:08.693555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3e0e4363-fa2c-4d5f-9490-4a279279b185 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:08.693986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3e0e4363-fa2c-4d5f-9490-4a279279b185 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:08.825366 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3e0e4363-fa2c-4d5f-9490-4a279279b185 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:08.832622 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3e0e4363-fa2c-4d5f-9490-4a279279b185 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151721 May 10 21:18:08.833210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 808/1584] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:08 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:08.837687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e51216e4-831c-4811-b8f4-b5ddd396dfbf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:08.838581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e51216e4-831c-4811-b8f4-b5ddd396dfbf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:08.844087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e51216e4-831c-4811-b8f4-b5ddd396dfbf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:08.844532 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e51216e4-831c-4811-b8f4-b5ddd396dfbf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:08.845289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e51216e4-831c-4811-b8f4-b5ddd396dfbf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:08.845727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e51216e4-831c-4811-b8f4-b5ddd396dfbf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:08.876255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e51216e4-831c-4811-b8f4-b5ddd396dfbf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041965 May 10 21:18:08.876726 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 809/1585] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:08 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:08.881155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-271cf68a-b718-465b-91c2-31a95eb68aea tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:08.882043 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-271cf68a-b718-465b-91c2-31a95eb68aea tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:08.887511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-271cf68a-b718-465b-91c2-31a95eb68aea tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:08.887960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-271cf68a-b718-465b-91c2-31a95eb68aea tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:08.888713 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-271cf68a-b718-465b-91c2-31a95eb68aea tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:08.889150 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-271cf68a-b718-465b-91c2-31a95eb68aea tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:08.916759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-271cf68a-b718-465b-91c2-31a95eb68aea tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039057 May 10 21:18:08.917296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 810/1586] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:08 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:09.850431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-daa5cd65-c4dc-47f6-8a87-9c97f9bd0ac7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:09.851079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-daa5cd65-c4dc-47f6-8a87-9c97f9bd0ac7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:09.857315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-daa5cd65-c4dc-47f6-8a87-9c97f9bd0ac7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:09.864020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-daa5cd65-c4dc-47f6-8a87-9c97f9bd0ac7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:09.864020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-daa5cd65-c4dc-47f6-8a87-9c97f9bd0ac7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:09.864020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-daa5cd65-c4dc-47f6-8a87-9c97f9bd0ac7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:09.988733 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-daa5cd65-c4dc-47f6-8a87-9c97f9bd0ac7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:09.995971 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-daa5cd65-c4dc-47f6-8a87-9c97f9bd0ac7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.149946 May 10 21:18:09.996703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 811/1587] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:09 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:18:10.001678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d2828bff-4613-40bb-a798-ebf4441cfa5c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:10.002569 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d2828bff-4613-40bb-a798-ebf4441cfa5c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:10.007987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2828bff-4613-40bb-a798-ebf4441cfa5c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:10.008433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2828bff-4613-40bb-a798-ebf4441cfa5c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:10.009189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2828bff-4613-40bb-a798-ebf4441cfa5c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:10.009622 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2828bff-4613-40bb-a798-ebf4441cfa5c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:10.038001 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d2828bff-4613-40bb-a798-ebf4441cfa5c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040320 May 10 21:18:10.038536 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 812/1588] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:09 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:10.043001 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9e563403-ab0a-4d49-bbdc-50d6f0db2326 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:10.043901 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9e563403-ab0a-4d49-bbdc-50d6f0db2326 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:10.049489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9e563403-ab0a-4d49-bbdc-50d6f0db2326 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:10.049930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9e563403-ab0a-4d49-bbdc-50d6f0db2326 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:10.050699 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9e563403-ab0a-4d49-bbdc-50d6f0db2326 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:10.051114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9e563403-ab0a-4d49-bbdc-50d6f0db2326 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:10.080423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9e563403-ab0a-4d49-bbdc-50d6f0db2326 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040925 May 10 21:18:10.080962 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 813/1589] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:10 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:11.014040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e619b749-ccb0-43ca-a386-e0514e8c332d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:11.015256 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e619b749-ccb0-43ca-a386-e0514e8c332d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:11.021378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e619b749-ccb0-43ca-a386-e0514e8c332d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:11.021829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e619b749-ccb0-43ca-a386-e0514e8c332d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:11.022586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e619b749-ccb0-43ca-a386-e0514e8c332d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:11.023019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e619b749-ccb0-43ca-a386-e0514e8c332d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:11.156084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e619b749-ccb0-43ca-a386-e0514e8c332d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:11.163447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e619b749-ccb0-43ca-a386-e0514e8c332d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.153496 May 10 21:18:11.163989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 814/1590] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:11 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:11.168451 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3a23f63d-9ed7-4a69-849b-dba1e42f8d2b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:11.169349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3a23f63d-9ed7-4a69-849b-dba1e42f8d2b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:11.175017 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3a23f63d-9ed7-4a69-849b-dba1e42f8d2b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:11.175492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3a23f63d-9ed7-4a69-849b-dba1e42f8d2b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:11.176256 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3a23f63d-9ed7-4a69-849b-dba1e42f8d2b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:11.176690 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3a23f63d-9ed7-4a69-849b-dba1e42f8d2b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:11.206164 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3a23f63d-9ed7-4a69-849b-dba1e42f8d2b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041150 May 10 21:18:11.206728 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 815/1591] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:11 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:11.212308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f0d1e92b-b403-44b8-a79b-344fc207cd6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:11.213229 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f0d1e92b-b403-44b8-a79b-344fc207cd6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:11.219404 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0d1e92b-b403-44b8-a79b-344fc207cd6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:11.219855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0d1e92b-b403-44b8-a79b-344fc207cd6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:11.220623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0d1e92b-b403-44b8-a79b-344fc207cd6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:11.221068 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0d1e92b-b403-44b8-a79b-344fc207cd6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:11.249411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f0d1e92b-b403-44b8-a79b-344fc207cd6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041162 May 10 21:18:11.250053 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 816/1592] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:11 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:12.180394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c9d0b244-39b0-4e2c-a9cd-f038be1d8d10 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:12.181034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c9d0b244-39b0-4e2c-a9cd-f038be1d8d10 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:12.188334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9d0b244-39b0-4e2c-a9cd-f038be1d8d10 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:12.188785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9d0b244-39b0-4e2c-a9cd-f038be1d8d10 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:12.189560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9d0b244-39b0-4e2c-a9cd-f038be1d8d10 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:12.190002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9d0b244-39b0-4e2c-a9cd-f038be1d8d10 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:12.317956 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c9d0b244-39b0-4e2c-a9cd-f038be1d8d10 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:12.325463 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c9d0b244-39b0-4e2c-a9cd-f038be1d8d10 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.148960 May 10 21:18:12.326027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 817/1593] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:12 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:12.331609 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c5998ad6-7819-4f1f-bce1-d57f901d8d2b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:12.332517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c5998ad6-7819-4f1f-bce1-d57f901d8d2b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:12.338141 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5998ad6-7819-4f1f-bce1-d57f901d8d2b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:12.338585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5998ad6-7819-4f1f-bce1-d57f901d8d2b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:12.339388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5998ad6-7819-4f1f-bce1-d57f901d8d2b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:12.339801 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5998ad6-7819-4f1f-bce1-d57f901d8d2b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:12.368832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c5998ad6-7819-4f1f-bce1-d57f901d8d2b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041823 May 10 21:18:12.369369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 818/1594] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:12 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:12.373721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a72fab25-f7c9-455e-bc4a-cd974db15519 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:12.375376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a72fab25-f7c9-455e-bc4a-cd974db15519 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:12.380976 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a72fab25-f7c9-455e-bc4a-cd974db15519 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:12.381416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a72fab25-f7c9-455e-bc4a-cd974db15519 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:12.382175 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a72fab25-f7c9-455e-bc4a-cd974db15519 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:12.382605 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a72fab25-f7c9-455e-bc4a-cd974db15519 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:12.411959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a72fab25-f7c9-455e-bc4a-cd974db15519 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041596 May 10 21:18:12.412515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 819/1595] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:12 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:13.344814 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6deb99d8-ec6e-49c7-9fb2-e649dfc9b16e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:13.345490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6deb99d8-ec6e-49c7-9fb2-e649dfc9b16e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:13.351801 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6deb99d8-ec6e-49c7-9fb2-e649dfc9b16e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:13.352253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6deb99d8-ec6e-49c7-9fb2-e649dfc9b16e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:13.353011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6deb99d8-ec6e-49c7-9fb2-e649dfc9b16e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:13.353446 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6deb99d8-ec6e-49c7-9fb2-e649dfc9b16e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:13.486478 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6deb99d8-ec6e-49c7-9fb2-e649dfc9b16e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:13.493819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6deb99d8-ec6e-49c7-9fb2-e649dfc9b16e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.153689 May 10 21:18:13.494380 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 820/1596] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:13 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:13.499593 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c7e5dd44-281d-4fe1-b9cd-98b97a5970ff tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:13.500532 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c7e5dd44-281d-4fe1-b9cd-98b97a5970ff tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:13.506066 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c7e5dd44-281d-4fe1-b9cd-98b97a5970ff tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:13.506517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c7e5dd44-281d-4fe1-b9cd-98b97a5970ff tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:13.507310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c7e5dd44-281d-4fe1-b9cd-98b97a5970ff tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:13.507755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c7e5dd44-281d-4fe1-b9cd-98b97a5970ff tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:13.535824 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c7e5dd44-281d-4fe1-b9cd-98b97a5970ff tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040459 May 10 21:18:13.536365 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 821/1597] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:13 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:13.540776 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-30678aad-7110-4893-a96c-526369bbb13a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:13.541667 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-30678aad-7110-4893-a96c-526369bbb13a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:13.547782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-30678aad-7110-4893-a96c-526369bbb13a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:13.548231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-30678aad-7110-4893-a96c-526369bbb13a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:13.548996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-30678aad-7110-4893-a96c-526369bbb13a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:13.549435 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-30678aad-7110-4893-a96c-526369bbb13a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:13.579456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-30678aad-7110-4893-a96c-526369bbb13a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039862 May 10 21:18:13.580008 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 822/1598] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:13 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:14.512417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0cad79f5-ad52-4f31-b763-72ca38095838 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:14.513240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0cad79f5-ad52-4f31-b763-72ca38095838 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:14.519552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0cad79f5-ad52-4f31-b763-72ca38095838 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:14.520002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0cad79f5-ad52-4f31-b763-72ca38095838 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:14.520772 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0cad79f5-ad52-4f31-b763-72ca38095838 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:14.522079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0cad79f5-ad52-4f31-b763-72ca38095838 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:14.657718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0cad79f5-ad52-4f31-b763-72ca38095838 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:14.665641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0cad79f5-ad52-4f31-b763-72ca38095838 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.157106 May 10 21:18:14.666227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 823/1599] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:14 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:14.672362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-763d2f03-e51d-4279-9bd3-0d5f77741a03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:14.673285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-763d2f03-e51d-4279-9bd3-0d5f77741a03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:14.681758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-763d2f03-e51d-4279-9bd3-0d5f77741a03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:14.682212 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-763d2f03-e51d-4279-9bd3-0d5f77741a03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:14.682993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-763d2f03-e51d-4279-9bd3-0d5f77741a03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:14.683458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-763d2f03-e51d-4279-9bd3-0d5f77741a03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:14.718128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-763d2f03-e51d-4279-9bd3-0d5f77741a03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049265 May 10 21:18:14.719095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 824/1600] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:14 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:14.726585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1d375eee-16b6-406f-8d33-7a8cf84bb59b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:14.728135 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1d375eee-16b6-406f-8d33-7a8cf84bb59b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:14.734841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d375eee-16b6-406f-8d33-7a8cf84bb59b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:14.736274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d375eee-16b6-406f-8d33-7a8cf84bb59b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:14.737063 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d375eee-16b6-406f-8d33-7a8cf84bb59b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:14.737513 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d375eee-16b6-406f-8d33-7a8cf84bb59b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:14.768210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1d375eee-16b6-406f-8d33-7a8cf84bb59b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048052 May 10 21:18:14.769020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 825/1601] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:14 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:15.683147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e9a54ae0-3af3-4124-a088-d9ba115dd597 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:15.683755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e9a54ae0-3af3-4124-a088-d9ba115dd597 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:15.690161 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e9a54ae0-3af3-4124-a088-d9ba115dd597 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:15.690615 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e9a54ae0-3af3-4124-a088-d9ba115dd597 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:15.691427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e9a54ae0-3af3-4124-a088-d9ba115dd597 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:15.691874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e9a54ae0-3af3-4124-a088-d9ba115dd597 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:15.821919 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e9a54ae0-3af3-4124-a088-d9ba115dd597 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:15.830103 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e9a54ae0-3af3-4124-a088-d9ba115dd597 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.150847 May 10 21:18:15.830678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 826/1602] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:15 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:15.835337 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7c87a320-7292-4c6c-818f-e79c76f90939 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:15.836317 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7c87a320-7292-4c6c-818f-e79c76f90939 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:15.841880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c87a320-7292-4c6c-818f-e79c76f90939 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:15.842335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c87a320-7292-4c6c-818f-e79c76f90939 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:15.843316 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c87a320-7292-4c6c-818f-e79c76f90939 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:15.843762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c87a320-7292-4c6c-818f-e79c76f90939 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:15.871787 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7c87a320-7292-4c6c-818f-e79c76f90939 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039987 May 10 21:18:15.872265 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 827/1603] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:15 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:15.877662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-affdff89-b0d3-470a-a660-a161b7fc5af8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:15.878569 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-affdff89-b0d3-470a-a660-a161b7fc5af8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:15.884092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-affdff89-b0d3-470a-a660-a161b7fc5af8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:15.884546 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-affdff89-b0d3-470a-a660-a161b7fc5af8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:15.885315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-affdff89-b0d3-470a-a660-a161b7fc5af8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:15.885757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-affdff89-b0d3-470a-a660-a161b7fc5af8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:15.915264 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-affdff89-b0d3-470a-a660-a161b7fc5af8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041799 May 10 21:18:15.915825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 828/1604] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:15 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:16.847610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8dc49fb8-ca0e-4465-a541-937c1827120d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:16.848299 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8dc49fb8-ca0e-4465-a541-937c1827120d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:16.854523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8dc49fb8-ca0e-4465-a541-937c1827120d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:16.854973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8dc49fb8-ca0e-4465-a541-937c1827120d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:16.855764 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8dc49fb8-ca0e-4465-a541-937c1827120d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:16.856198 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8dc49fb8-ca0e-4465-a541-937c1827120d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:16.985389 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8dc49fb8-ca0e-4465-a541-937c1827120d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:16.992736 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8dc49fb8-ca0e-4465-a541-937c1827120d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.148958 May 10 21:18:16.993328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 829/1605] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:16 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:16.997873 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e9337f4f-3a67-472e-aef1-08022fe28c77 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:16.998870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e9337f4f-3a67-472e-aef1-08022fe28c77 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:17.004587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e9337f4f-3a67-472e-aef1-08022fe28c77 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:17.005027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e9337f4f-3a67-472e-aef1-08022fe28c77 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:17.005784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e9337f4f-3a67-472e-aef1-08022fe28c77 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:17.006215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e9337f4f-3a67-472e-aef1-08022fe28c77 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:17.034847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e9337f4f-3a67-472e-aef1-08022fe28c77 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040544 May 10 21:18:17.035417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 830/1606] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:16 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:17.040000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d44d7ae7-33c0-40c9-b3fc-b87dd0a984f2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:17.040875 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d44d7ae7-33c0-40c9-b3fc-b87dd0a984f2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:17.046283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d44d7ae7-33c0-40c9-b3fc-b87dd0a984f2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:17.046727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d44d7ae7-33c0-40c9-b3fc-b87dd0a984f2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:17.047499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d44d7ae7-33c0-40c9-b3fc-b87dd0a984f2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:17.047933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d44d7ae7-33c0-40c9-b3fc-b87dd0a984f2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:17.075555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d44d7ae7-33c0-40c9-b3fc-b87dd0a984f2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039145 May 10 21:18:17.076098 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 831/1607] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:17 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:18.010113 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3ff5efed-eeba-4218-8337-8e331298304f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:18.010753 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3ff5efed-eeba-4218-8337-8e331298304f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:18.017730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ff5efed-eeba-4218-8337-8e331298304f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:18.018172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ff5efed-eeba-4218-8337-8e331298304f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:18.018934 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ff5efed-eeba-4218-8337-8e331298304f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:18.019429 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ff5efed-eeba-4218-8337-8e331298304f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:18.149421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3ff5efed-eeba-4218-8337-8e331298304f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:18.156951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3ff5efed-eeba-4218-8337-8e331298304f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.150869 May 10 21:18:18.157511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 832/1608] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:18 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:18.162208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-de7ac2c7-7017-4c31-a746-0d6bdff6495f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:18.163114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-de7ac2c7-7017-4c31-a746-0d6bdff6495f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:18.168548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de7ac2c7-7017-4c31-a746-0d6bdff6495f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:18.168997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de7ac2c7-7017-4c31-a746-0d6bdff6495f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:18.169756 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de7ac2c7-7017-4c31-a746-0d6bdff6495f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:18.170194 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de7ac2c7-7017-4c31-a746-0d6bdff6495f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:18.199351 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-de7ac2c7-7017-4c31-a746-0d6bdff6495f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040821 May 10 21:18:18.199891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 833/1609] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:18 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:18.204432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-81936b93-b954-4915-8ea3-d5234827a759 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:18.205309 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-81936b93-b954-4915-8ea3-d5234827a759 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:18.210627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-81936b93-b954-4915-8ea3-d5234827a759 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:18.211070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-81936b93-b954-4915-8ea3-d5234827a759 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:18.211855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-81936b93-b954-4915-8ea3-d5234827a759 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:18.212286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-81936b93-b954-4915-8ea3-d5234827a759 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:18.239892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-81936b93-b954-4915-8ea3-d5234827a759 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039056 May 10 21:18:18.240556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 834/1610] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:18 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:19.174433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9446ab74-3567-41ab-8c1a-1cdca75b1847 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:19.175075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9446ab74-3567-41ab-8c1a-1cdca75b1847 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:19.181401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9446ab74-3567-41ab-8c1a-1cdca75b1847 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:19.181846 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9446ab74-3567-41ab-8c1a-1cdca75b1847 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:19.182605 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9446ab74-3567-41ab-8c1a-1cdca75b1847 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:19.183040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9446ab74-3567-41ab-8c1a-1cdca75b1847 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:19.312976 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9446ab74-3567-41ab-8c1a-1cdca75b1847 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:19.320512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9446ab74-3567-41ab-8c1a-1cdca75b1847 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.150390 May 10 21:18:19.321073 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 835/1611] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:19 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:19.325540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-48701aab-a092-404a-bd51-67b396b9a870 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:19.326437 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-48701aab-a092-404a-bd51-67b396b9a870 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:19.332058 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-48701aab-a092-404a-bd51-67b396b9a870 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:19.332504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-48701aab-a092-404a-bd51-67b396b9a870 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:19.333265 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-48701aab-a092-404a-bd51-67b396b9a870 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:19.333697 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-48701aab-a092-404a-bd51-67b396b9a870 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:19.362640 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-48701aab-a092-404a-bd51-67b396b9a870 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040563 May 10 21:18:19.363227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 836/1612] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:19 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:19.367677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4a23b2d1-e833-41bc-ab8e-ce636784476e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:19.368563 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4a23b2d1-e833-41bc-ab8e-ce636784476e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:19.374205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a23b2d1-e833-41bc-ab8e-ce636784476e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:19.374807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a23b2d1-e833-41bc-ab8e-ce636784476e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:19.375605 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a23b2d1-e833-41bc-ab8e-ce636784476e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:19.376052 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a23b2d1-e833-41bc-ab8e-ce636784476e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:19.404663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4a23b2d1-e833-41bc-ab8e-ce636784476e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040484 May 10 21:18:19.405877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 837/1613] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:19 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:20.337556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2a3bff28-b1e9-4a1c-98b1-45187a5629b6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:20.338174 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2a3bff28-b1e9-4a1c-98b1-45187a5629b6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:20.344890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2a3bff28-b1e9-4a1c-98b1-45187a5629b6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:20.348464 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2a3bff28-b1e9-4a1c-98b1-45187a5629b6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:20.348464 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2a3bff28-b1e9-4a1c-98b1-45187a5629b6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:20.348464 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2a3bff28-b1e9-4a1c-98b1-45187a5629b6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:20.478484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2a3bff28-b1e9-4a1c-98b1-45187a5629b6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:20.486528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2a3bff28-b1e9-4a1c-98b1-45187a5629b6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.152853 May 10 21:18:20.487203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 838/1614] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:20 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:18:20.491685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1f2ad37f-36c9-4c45-8ee8-054daea1cf4f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:20.492590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1f2ad37f-36c9-4c45-8ee8-054daea1cf4f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:20.498107 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1f2ad37f-36c9-4c45-8ee8-054daea1cf4f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:20.498555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1f2ad37f-36c9-4c45-8ee8-054daea1cf4f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:20.499948 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1f2ad37f-36c9-4c45-8ee8-054daea1cf4f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:20.500398 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1f2ad37f-36c9-4c45-8ee8-054daea1cf4f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:20.528834 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1f2ad37f-36c9-4c45-8ee8-054daea1cf4f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040708 May 10 21:18:20.529372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 839/1615] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:20 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:20.534919 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fd45a324-ed52-42ce-aac6-983da622bc50 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:20.535840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fd45a324-ed52-42ce-aac6-983da622bc50 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:20.541210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fd45a324-ed52-42ce-aac6-983da622bc50 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:20.541660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fd45a324-ed52-42ce-aac6-983da622bc50 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:20.542411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fd45a324-ed52-42ce-aac6-983da622bc50 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:20.542848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fd45a324-ed52-42ce-aac6-983da622bc50 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:20.571798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fd45a324-ed52-42ce-aac6-983da622bc50 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041460 May 10 21:18:20.572343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 840/1616] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:20 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:21.504763 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bcdb0fd0-6f26-4dcc-8473-688846c17629 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:21.505439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bcdb0fd0-6f26-4dcc-8473-688846c17629 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:21.511959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bcdb0fd0-6f26-4dcc-8473-688846c17629 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:21.512439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bcdb0fd0-6f26-4dcc-8473-688846c17629 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:21.513226 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bcdb0fd0-6f26-4dcc-8473-688846c17629 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:21.513678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bcdb0fd0-6f26-4dcc-8473-688846c17629 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:21.644875 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bcdb0fd0-6f26-4dcc-8473-688846c17629 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:21.652431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bcdb0fd0-6f26-4dcc-8473-688846c17629 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151557 May 10 21:18:21.653001 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 841/1617] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:21 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:18:21.657768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7b9cc091-6dea-4b42-a75f-03e100b76c2b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:21.658719 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7b9cc091-6dea-4b42-a75f-03e100b76c2b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:21.664268 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b9cc091-6dea-4b42-a75f-03e100b76c2b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:21.664720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b9cc091-6dea-4b42-a75f-03e100b76c2b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:21.665527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b9cc091-6dea-4b42-a75f-03e100b76c2b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:21.665967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b9cc091-6dea-4b42-a75f-03e100b76c2b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:21.694452 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7b9cc091-6dea-4b42-a75f-03e100b76c2b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040454 May 10 21:18:21.695006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 842/1618] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:21 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:21.699847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0effba81-c98d-4595-8fd6-7cd1d30583a4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:21.700738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0effba81-c98d-4595-8fd6-7cd1d30583a4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:21.706782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0effba81-c98d-4595-8fd6-7cd1d30583a4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:21.707268 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0effba81-c98d-4595-8fd6-7cd1d30583a4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:21.708040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0effba81-c98d-4595-8fd6-7cd1d30583a4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:21.708475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0effba81-c98d-4595-8fd6-7cd1d30583a4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:21.736812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0effba81-c98d-4595-8fd6-7cd1d30583a4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040578 May 10 21:18:21.737357 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 843/1619] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:21 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:22.669302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7c2bf49d-e7b8-4b62-a446-102fb4ccb4af tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:22.669923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7c2bf49d-e7b8-4b62-a446-102fb4ccb4af tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:22.676403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c2bf49d-e7b8-4b62-a446-102fb4ccb4af tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:22.676889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c2bf49d-e7b8-4b62-a446-102fb4ccb4af tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:22.677665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c2bf49d-e7b8-4b62-a446-102fb4ccb4af tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:22.678105 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c2bf49d-e7b8-4b62-a446-102fb4ccb4af tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:22.806062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7c2bf49d-e7b8-4b62-a446-102fb4ccb4af tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:22.813978 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7c2bf49d-e7b8-4b62-a446-102fb4ccb4af tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.148597 May 10 21:18:22.814552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 844/1620] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:22 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:22.819275 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ae7d0bcf-7d7c-4d77-89b9-5d041319bc7f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:22.820448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ae7d0bcf-7d7c-4d77-89b9-5d041319bc7f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:22.825995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae7d0bcf-7d7c-4d77-89b9-5d041319bc7f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:22.826449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae7d0bcf-7d7c-4d77-89b9-5d041319bc7f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:22.827250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae7d0bcf-7d7c-4d77-89b9-5d041319bc7f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:22.827696 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae7d0bcf-7d7c-4d77-89b9-5d041319bc7f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:22.855555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ae7d0bcf-7d7c-4d77-89b9-5d041319bc7f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039974 May 10 21:18:22.856100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 845/1621] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:22 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:22.861220 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9936600c-4fc8-486f-8e99-c7a8f08319fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:22.862065 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9936600c-4fc8-486f-8e99-c7a8f08319fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:22.867569 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9936600c-4fc8-486f-8e99-c7a8f08319fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:22.868023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9936600c-4fc8-486f-8e99-c7a8f08319fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:22.868790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9936600c-4fc8-486f-8e99-c7a8f08319fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:22.869235 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9936600c-4fc8-486f-8e99-c7a8f08319fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:22.898885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9936600c-4fc8-486f-8e99-c7a8f08319fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041796 May 10 21:18:22.899476 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 846/1622] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:22 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:23.831752 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-158c0ab4-8481-4f9a-adef-9780f63c238c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:23.832458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-158c0ab4-8481-4f9a-adef-9780f63c238c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:23.838727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-158c0ab4-8481-4f9a-adef-9780f63c238c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:23.839220 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-158c0ab4-8481-4f9a-adef-9780f63c238c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:23.839996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-158c0ab4-8481-4f9a-adef-9780f63c238c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:23.840439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-158c0ab4-8481-4f9a-adef-9780f63c238c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:23.970592 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-158c0ab4-8481-4f9a-adef-9780f63c238c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:23.977910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-158c0ab4-8481-4f9a-adef-9780f63c238c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.150186 May 10 21:18:23.978517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 847/1623] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:23 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:23.983031 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f772d12d-2813-4f5a-8a2b-b718496253a5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:23.984537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f772d12d-2813-4f5a-8a2b-b718496253a5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:23.990056 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f772d12d-2813-4f5a-8a2b-b718496253a5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:23.990514 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f772d12d-2813-4f5a-8a2b-b718496253a5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:23.991323 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f772d12d-2813-4f5a-8a2b-b718496253a5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:23.991771 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f772d12d-2813-4f5a-8a2b-b718496253a5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:24.020315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f772d12d-2813-4f5a-8a2b-b718496253a5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040804 May 10 21:18:24.020861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 848/1624] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:23 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:24.025252 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-16b61163-ef24-4713-99cb-d0e0e390c92b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:24.026139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-16b61163-ef24-4713-99cb-d0e0e390c92b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:24.032132 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-16b61163-ef24-4713-99cb-d0e0e390c92b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:24.032588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-16b61163-ef24-4713-99cb-d0e0e390c92b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:24.033350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-16b61163-ef24-4713-99cb-d0e0e390c92b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:24.033794 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-16b61163-ef24-4713-99cb-d0e0e390c92b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:24.061523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-16b61163-ef24-4713-99cb-d0e0e390c92b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039678 May 10 21:18:24.062076 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 849/1625] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:24 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:24.996265 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a01a6e99-aa83-48ca-ab28-d3d0e708fff7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:24.996917 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a01a6e99-aa83-48ca-ab28-d3d0e708fff7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:25.003753 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a01a6e99-aa83-48ca-ab28-d3d0e708fff7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:25.004199 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a01a6e99-aa83-48ca-ab28-d3d0e708fff7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:25.004953 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a01a6e99-aa83-48ca-ab28-d3d0e708fff7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:25.005385 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a01a6e99-aa83-48ca-ab28-d3d0e708fff7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:25.138492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a01a6e99-aa83-48ca-ab28-d3d0e708fff7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:25.146322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a01a6e99-aa83-48ca-ab28-d3d0e708fff7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.154063 May 10 21:18:25.146896 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 850/1626] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:24 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:25.151531 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fb1fddae-cf0c-463a-ad14-05123feb7d20 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:25.152428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fb1fddae-cf0c-463a-ad14-05123feb7d20 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:25.158568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb1fddae-cf0c-463a-ad14-05123feb7d20 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:25.159022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb1fddae-cf0c-463a-ad14-05123feb7d20 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:25.159832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb1fddae-cf0c-463a-ad14-05123feb7d20 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:25.160279 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb1fddae-cf0c-463a-ad14-05123feb7d20 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:25.188799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fb1fddae-cf0c-463a-ad14-05123feb7d20 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040878 May 10 21:18:25.189346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 851/1627] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:25 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:25.193909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d3a6110f-ff0b-4318-920b-cfc769ab03bf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:25.194813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d3a6110f-ff0b-4318-920b-cfc769ab03bf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:25.200501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d3a6110f-ff0b-4318-920b-cfc769ab03bf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:25.200957 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d3a6110f-ff0b-4318-920b-cfc769ab03bf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:25.201720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d3a6110f-ff0b-4318-920b-cfc769ab03bf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:25.202440 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d3a6110f-ff0b-4318-920b-cfc769ab03bf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:25.230319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d3a6110f-ff0b-4318-920b-cfc769ab03bf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040013 May 10 21:18:25.230867 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 852/1628] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:25 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:26.164159 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-76ca31d2-5c75-4b05-b632-ee99029bf817 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:26.164857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-76ca31d2-5c75-4b05-b632-ee99029bf817 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:26.173096 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76ca31d2-5c75-4b05-b632-ee99029bf817 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:26.173556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76ca31d2-5c75-4b05-b632-ee99029bf817 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:26.174375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76ca31d2-5c75-4b05-b632-ee99029bf817 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:26.174823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76ca31d2-5c75-4b05-b632-ee99029bf817 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:26.306010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-76ca31d2-5c75-4b05-b632-ee99029bf817 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:26.313744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-76ca31d2-5c75-4b05-b632-ee99029bf817 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.153548 May 10 21:18:26.314424 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 853/1629] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:26 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:26.319102 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-722c9015-edf8-4b66-be85-0bd63ea5ceaa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:26.320032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-722c9015-edf8-4b66-be85-0bd63ea5ceaa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:26.326148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-722c9015-edf8-4b66-be85-0bd63ea5ceaa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:26.326593 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-722c9015-edf8-4b66-be85-0bd63ea5ceaa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:26.328075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-722c9015-edf8-4b66-be85-0bd63ea5ceaa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:26.328508 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-722c9015-edf8-4b66-be85-0bd63ea5ceaa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:26.358720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-722c9015-edf8-4b66-be85-0bd63ea5ceaa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043272 May 10 21:18:26.359295 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 854/1630] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:26 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:26.363750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-24f335b2-f3e1-4d48-816c-13f652cfe504 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:26.364656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-24f335b2-f3e1-4d48-816c-13f652cfe504 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:26.370081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-24f335b2-f3e1-4d48-816c-13f652cfe504 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:26.370535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-24f335b2-f3e1-4d48-816c-13f652cfe504 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:26.371335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-24f335b2-f3e1-4d48-816c-13f652cfe504 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:26.371788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-24f335b2-f3e1-4d48-816c-13f652cfe504 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:26.401592 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-24f335b2-f3e1-4d48-816c-13f652cfe504 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041311 May 10 21:18:26.402147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 855/1631] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:26 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:27.331671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5c800835-2f8b-457f-af8f-5d38078f6a32 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:27.332369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5c800835-2f8b-457f-af8f-5d38078f6a32 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:27.338815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5c800835-2f8b-457f-af8f-5d38078f6a32 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:27.339299 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5c800835-2f8b-457f-af8f-5d38078f6a32 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:27.340060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5c800835-2f8b-457f-af8f-5d38078f6a32 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:27.340491 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5c800835-2f8b-457f-af8f-5d38078f6a32 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:27.476835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5c800835-2f8b-457f-af8f-5d38078f6a32 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:27.484184 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5c800835-2f8b-457f-af8f-5d38078f6a32 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.156851 May 10 21:18:27.484768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 856/1632] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:27 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:27.489307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cbe0f5fc-4f37-4a46-bb65-2f6824577074 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:27.490218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cbe0f5fc-4f37-4a46-bb65-2f6824577074 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:27.495956 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbe0f5fc-4f37-4a46-bb65-2f6824577074 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:27.496405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbe0f5fc-4f37-4a46-bb65-2f6824577074 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:27.497169 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbe0f5fc-4f37-4a46-bb65-2f6824577074 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:27.497608 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbe0f5fc-4f37-4a46-bb65-2f6824577074 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:27.526222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cbe0f5fc-4f37-4a46-bb65-2f6824577074 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040491 May 10 21:18:27.526763 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 857/1633] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:27 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:27.531383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-abb1963d-296f-403a-b3f1-18a4d5aefb54 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:27.532278 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-abb1963d-296f-403a-b3f1-18a4d5aefb54 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:27.537649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-abb1963d-296f-403a-b3f1-18a4d5aefb54 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:27.538093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-abb1963d-296f-403a-b3f1-18a4d5aefb54 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:27.538847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-abb1963d-296f-403a-b3f1-18a4d5aefb54 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:27.539322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-abb1963d-296f-403a-b3f1-18a4d5aefb54 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:27.568241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-abb1963d-296f-403a-b3f1-18a4d5aefb54 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040486 May 10 21:18:27.568780 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 858/1634] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:27 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:28.501925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-51f4fba2-a73e-4c6e-9bb1-5580573cd2b4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:28.502594 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-51f4fba2-a73e-4c6e-9bb1-5580573cd2b4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:28.508884 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51f4fba2-a73e-4c6e-9bb1-5580573cd2b4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:28.509336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51f4fba2-a73e-4c6e-9bb1-5580573cd2b4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:28.510104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51f4fba2-a73e-4c6e-9bb1-5580573cd2b4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:28.510547 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51f4fba2-a73e-4c6e-9bb1-5580573cd2b4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:28.641047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-51f4fba2-a73e-4c6e-9bb1-5580573cd2b4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:28.648445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-51f4fba2-a73e-4c6e-9bb1-5580573cd2b4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.150874 May 10 21:18:28.649005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 859/1635] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:28 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:28.653520 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f08526e5-3e14-4c47-ae71-2ebd2ccc6339 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:28.654434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f08526e5-3e14-4c47-ae71-2ebd2ccc6339 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:28.660313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f08526e5-3e14-4c47-ae71-2ebd2ccc6339 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:28.660768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f08526e5-3e14-4c47-ae71-2ebd2ccc6339 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:28.661540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f08526e5-3e14-4c47-ae71-2ebd2ccc6339 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:28.661981 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f08526e5-3e14-4c47-ae71-2ebd2ccc6339 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:28.690786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f08526e5-3e14-4c47-ae71-2ebd2ccc6339 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040785 May 10 21:18:28.691375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 860/1636] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:28 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:28.696044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1e51582b-dcd3-4a42-86ff-4b626f07c996 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:28.696937 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1e51582b-dcd3-4a42-86ff-4b626f07c996 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:28.703200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1e51582b-dcd3-4a42-86ff-4b626f07c996 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:28.703660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1e51582b-dcd3-4a42-86ff-4b626f07c996 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:28.704432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1e51582b-dcd3-4a42-86ff-4b626f07c996 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:28.704876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1e51582b-dcd3-4a42-86ff-4b626f07c996 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:28.733266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1e51582b-dcd3-4a42-86ff-4b626f07c996 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040881 May 10 21:18:28.733918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 861/1637] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:28 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:29.664969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-49e40f98-46f5-4ac9-97f8-44af6e075992 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:29.665587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-49e40f98-46f5-4ac9-97f8-44af6e075992 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:29.672508 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-49e40f98-46f5-4ac9-97f8-44af6e075992 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:29.672950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-49e40f98-46f5-4ac9-97f8-44af6e075992 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:29.673740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-49e40f98-46f5-4ac9-97f8-44af6e075992 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:29.674175 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-49e40f98-46f5-4ac9-97f8-44af6e075992 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:29.806191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-49e40f98-46f5-4ac9-97f8-44af6e075992 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:29.813948 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-49e40f98-46f5-4ac9-97f8-44af6e075992 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.152904 May 10 21:18:29.814511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 862/1638] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:29 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:29.819085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-651c6102-6afe-4696-ba76-cad13f3dd1be tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:29.820045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-651c6102-6afe-4696-ba76-cad13f3dd1be tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:29.826134 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-651c6102-6afe-4696-ba76-cad13f3dd1be tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:29.826588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-651c6102-6afe-4696-ba76-cad13f3dd1be tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:29.828062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-651c6102-6afe-4696-ba76-cad13f3dd1be tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:29.828507 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-651c6102-6afe-4696-ba76-cad13f3dd1be tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:29.857773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-651c6102-6afe-4696-ba76-cad13f3dd1be tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042186 May 10 21:18:29.858330 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 863/1639] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:29 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:29.862933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1d38ac2d-bafd-43e7-99da-e5c1a1602b2e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:29.863894 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1d38ac2d-bafd-43e7-99da-e5c1a1602b2e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:29.869354 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d38ac2d-bafd-43e7-99da-e5c1a1602b2e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:29.887004 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d38ac2d-bafd-43e7-99da-e5c1a1602b2e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:29.887004 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d38ac2d-bafd-43e7-99da-e5c1a1602b2e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:29.887004 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d38ac2d-bafd-43e7-99da-e5c1a1602b2e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:29.900905 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1d38ac2d-bafd-43e7-99da-e5c1a1602b2e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041592 May 10 21:18:29.901452 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 864/1640] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:29 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:30.832410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1f5a1521-9283-4a78-b05f-6d945dc14457 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:30.833488 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1f5a1521-9283-4a78-b05f-6d945dc14457 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:30.839921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1f5a1521-9283-4a78-b05f-6d945dc14457 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:30.840363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1f5a1521-9283-4a78-b05f-6d945dc14457 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:30.841118 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1f5a1521-9283-4a78-b05f-6d945dc14457 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:30.841548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1f5a1521-9283-4a78-b05f-6d945dc14457 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:30.970240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1f5a1521-9283-4a78-b05f-6d945dc14457 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:30.977547 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1f5a1521-9283-4a78-b05f-6d945dc14457 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.148995 May 10 21:18:30.978108 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 865/1641] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:30 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:30.982848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-75cff64d-8be8-467e-8c88-d6b1ce3c2cec tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:30.983860 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-75cff64d-8be8-467e-8c88-d6b1ce3c2cec tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:30.989629 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-75cff64d-8be8-467e-8c88-d6b1ce3c2cec tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:30.990088 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-75cff64d-8be8-467e-8c88-d6b1ce3c2cec tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:30.990858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-75cff64d-8be8-467e-8c88-d6b1ce3c2cec tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:30.991349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-75cff64d-8be8-467e-8c88-d6b1ce3c2cec tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:31.020378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-75cff64d-8be8-467e-8c88-d6b1ce3c2cec tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041283 May 10 21:18:31.020931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 866/1642] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:30 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:31.025341 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4f83f7b7-7a86-4daa-9f9d-6769f9d813de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:31.026233 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4f83f7b7-7a86-4daa-9f9d-6769f9d813de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:31.031917 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f83f7b7-7a86-4daa-9f9d-6769f9d813de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:31.032372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f83f7b7-7a86-4daa-9f9d-6769f9d813de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:31.033137 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f83f7b7-7a86-4daa-9f9d-6769f9d813de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:31.033583 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f83f7b7-7a86-4daa-9f9d-6769f9d813de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:31.061703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4f83f7b7-7a86-4daa-9f9d-6769f9d813de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039299 May 10 21:18:31.062237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 867/1643] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:31 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:31.994993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4f53b7f4-d240-49ec-af48-5b70b26551e2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:31.995668 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4f53b7f4-d240-49ec-af48-5b70b26551e2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:32.002345 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f53b7f4-d240-49ec-af48-5b70b26551e2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:32.002807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f53b7f4-d240-49ec-af48-5b70b26551e2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:32.003619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f53b7f4-d240-49ec-af48-5b70b26551e2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:32.004060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f53b7f4-d240-49ec-af48-5b70b26551e2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:32.133385 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4f53b7f4-d240-49ec-af48-5b70b26551e2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:32.141353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4f53b7f4-d240-49ec-af48-5b70b26551e2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.150342 May 10 21:18:32.141924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 868/1644] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:31 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:32.146577 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bad0c1b0-f597-480b-bc79-babfa291211b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:32.147547 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bad0c1b0-f597-480b-bc79-babfa291211b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:32.153006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bad0c1b0-f597-480b-bc79-babfa291211b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:32.153458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bad0c1b0-f597-480b-bc79-babfa291211b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:32.154229 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bad0c1b0-f597-480b-bc79-babfa291211b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:32.154672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bad0c1b0-f597-480b-bc79-babfa291211b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:32.183156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bad0c1b0-f597-480b-bc79-babfa291211b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040222 May 10 21:18:32.183703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 869/1645] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:32 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:32.188265 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9ecb825e-c6c7-4ddc-9958-3fc8336cba1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:32.189163 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9ecb825e-c6c7-4ddc-9958-3fc8336cba1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:32.194522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ecb825e-c6c7-4ddc-9958-3fc8336cba1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:32.194968 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ecb825e-c6c7-4ddc-9958-3fc8336cba1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:32.196098 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ecb825e-c6c7-4ddc-9958-3fc8336cba1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:32.196539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ecb825e-c6c7-4ddc-9958-3fc8336cba1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:32.225129 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9ecb825e-c6c7-4ddc-9958-3fc8336cba1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040457 May 10 21:18:32.225673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 870/1646] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:32 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:33.158870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-be885fd3-6f93-4a39-b77e-99af2ccd9d2a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:33.159589 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-be885fd3-6f93-4a39-b77e-99af2ccd9d2a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:33.165878 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be885fd3-6f93-4a39-b77e-99af2ccd9d2a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:33.166322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be885fd3-6f93-4a39-b77e-99af2ccd9d2a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:33.167080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be885fd3-6f93-4a39-b77e-99af2ccd9d2a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:33.167547 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be885fd3-6f93-4a39-b77e-99af2ccd9d2a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:33.300214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-be885fd3-6f93-4a39-b77e-99af2ccd9d2a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:33.307512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-be885fd3-6f93-4a39-b77e-99af2ccd9d2a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.153076 May 10 21:18:33.308072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 871/1647] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:33 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:33.312847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-afba5955-1d67-4ecf-82ff-7ee5b1d2cd3f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:33.313747 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-afba5955-1d67-4ecf-82ff-7ee5b1d2cd3f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:33.319176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-afba5955-1d67-4ecf-82ff-7ee5b1d2cd3f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:33.319622 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-afba5955-1d67-4ecf-82ff-7ee5b1d2cd3f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:33.320640 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-afba5955-1d67-4ecf-82ff-7ee5b1d2cd3f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:33.321070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-afba5955-1d67-4ecf-82ff-7ee5b1d2cd3f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:33.349091 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-afba5955-1d67-4ecf-82ff-7ee5b1d2cd3f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040053 May 10 21:18:33.349630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 872/1648] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:33 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:33.353966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5be00733-5cd4-41a2-9ba3-ee0fb765bf08 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:33.354840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5be00733-5cd4-41a2-9ba3-ee0fb765bf08 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:33.360959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5be00733-5cd4-41a2-9ba3-ee0fb765bf08 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:33.361401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5be00733-5cd4-41a2-9ba3-ee0fb765bf08 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:33.362149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5be00733-5cd4-41a2-9ba3-ee0fb765bf08 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:33.362578 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5be00733-5cd4-41a2-9ba3-ee0fb765bf08 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:33.391063 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5be00733-5cd4-41a2-9ba3-ee0fb765bf08 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040488 May 10 21:18:33.391628 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 873/1649] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:33 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:34.324595 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9af15698-2f52-4913-aef4-eef51fc74a78 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:34.325263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9af15698-2f52-4913-aef4-eef51fc74a78 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:34.331669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9af15698-2f52-4913-aef4-eef51fc74a78 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:34.332117 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9af15698-2f52-4913-aef4-eef51fc74a78 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:34.332873 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9af15698-2f52-4913-aef4-eef51fc74a78 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:34.333305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9af15698-2f52-4913-aef4-eef51fc74a78 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:34.463373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9af15698-2f52-4913-aef4-eef51fc74a78 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:34.471089 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9af15698-2f52-4913-aef4-eef51fc74a78 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.150644 May 10 21:18:34.471707 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 874/1650] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:34 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:18:34.476501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f661c04f-30b4-4129-818f-db21de8147df tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:34.477413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f661c04f-30b4-4129-818f-db21de8147df tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:34.483730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f661c04f-30b4-4129-818f-db21de8147df tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:34.484193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f661c04f-30b4-4129-818f-db21de8147df tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:34.485072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f661c04f-30b4-4129-818f-db21de8147df tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:34.485523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f661c04f-30b4-4129-818f-db21de8147df tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:34.517338 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f661c04f-30b4-4129-818f-db21de8147df tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044379 May 10 21:18:34.518114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 875/1651] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:34 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:34.522447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-083d7814-4a6d-4878-b199-746a049e4c6e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:34.523827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-083d7814-4a6d-4878-b199-746a049e4c6e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:34.528963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-083d7814-4a6d-4878-b199-746a049e4c6e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:34.529417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-083d7814-4a6d-4878-b199-746a049e4c6e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:34.531333 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-083d7814-4a6d-4878-b199-746a049e4c6e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:34.531781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-083d7814-4a6d-4878-b199-746a049e4c6e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:34.563338 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-083d7814-4a6d-4878-b199-746a049e4c6e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044328 May 10 21:18:34.563903 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 876/1652] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:34 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:35.489414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0008fe25-c2ca-45b1-bb60-65098605dba7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:35.490060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0008fe25-c2ca-45b1-bb60-65098605dba7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:35.496391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0008fe25-c2ca-45b1-bb60-65098605dba7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:35.496845 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0008fe25-c2ca-45b1-bb60-65098605dba7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:35.497609 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0008fe25-c2ca-45b1-bb60-65098605dba7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:35.498044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0008fe25-c2ca-45b1-bb60-65098605dba7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:35.636321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0008fe25-c2ca-45b1-bb60-65098605dba7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:35.644293 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0008fe25-c2ca-45b1-bb60-65098605dba7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.158808 May 10 21:18:35.644862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 877/1653] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:35 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:35.649430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5af187df-83e9-4f5c-9f09-883d461c12e2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:35.650338 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5af187df-83e9-4f5c-9f09-883d461c12e2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:35.656652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5af187df-83e9-4f5c-9f09-883d461c12e2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:35.657099 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5af187df-83e9-4f5c-9f09-883d461c12e2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:35.657860 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5af187df-83e9-4f5c-9f09-883d461c12e2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:35.658330 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5af187df-83e9-4f5c-9f09-883d461c12e2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:35.686732 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5af187df-83e9-4f5c-9f09-883d461c12e2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040871 May 10 21:18:35.687310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 878/1654] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:35 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:35.691872 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5078fed1-827d-4e36-b1c9-abfb879c9f04 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:35.692772 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5078fed1-827d-4e36-b1c9-abfb879c9f04 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:35.698397 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5078fed1-827d-4e36-b1c9-abfb879c9f04 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:35.698853 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5078fed1-827d-4e36-b1c9-abfb879c9f04 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:35.699665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5078fed1-827d-4e36-b1c9-abfb879c9f04 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:35.700091 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5078fed1-827d-4e36-b1c9-abfb879c9f04 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:35.728931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5078fed1-827d-4e36-b1c9-abfb879c9f04 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040584 May 10 21:18:35.729479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 879/1655] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:35 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:36.230471 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2623d579-1d33-406e-8dcc-d280441cf29b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:36.231467 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2623d579-1d33-406e-8dcc-d280441cf29b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:36.238181 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2623d579-1d33-406e-8dcc-d280441cf29b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:36.238637 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2623d579-1d33-406e-8dcc-d280441cf29b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:36.239513 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2623d579-1d33-406e-8dcc-d280441cf29b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:36.239959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2623d579-1d33-406e-8dcc-d280441cf29b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:36.268480 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2623d579-1d33-406e-8dcc-d280441cf29b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042394 May 10 21:18:36.269102 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 880/1656] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:36 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:36.662084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1dbe9065-3498-40b8-bc1e-697bc0a4bb23 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:36.662701 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1dbe9065-3498-40b8-bc1e-697bc0a4bb23 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:36.669039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1dbe9065-3498-40b8-bc1e-697bc0a4bb23 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:36.669486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1dbe9065-3498-40b8-bc1e-697bc0a4bb23 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:36.670257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1dbe9065-3498-40b8-bc1e-697bc0a4bb23 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:36.671097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1dbe9065-3498-40b8-bc1e-697bc0a4bb23 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:36.801191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1dbe9065-3498-40b8-bc1e-697bc0a4bb23 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:36.808552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1dbe9065-3498-40b8-bc1e-697bc0a4bb23 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.150344 May 10 21:18:36.809119 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 881/1657] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:36 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:36.815879 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d37bd8c5-abad-40aa-b37b-a7a4c1cc6017 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:36.816786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d37bd8c5-abad-40aa-b37b-a7a4c1cc6017 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:36.822565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d37bd8c5-abad-40aa-b37b-a7a4c1cc6017 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:36.822999 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d37bd8c5-abad-40aa-b37b-a7a4c1cc6017 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:36.823796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d37bd8c5-abad-40aa-b37b-a7a4c1cc6017 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:36.824236 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d37bd8c5-abad-40aa-b37b-a7a4c1cc6017 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:36.854506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d37bd8c5-abad-40aa-b37b-a7a4c1cc6017 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044388 May 10 21:18:36.855052 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 882/1658] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:36 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:36.859639 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6a56da1d-4be5-4999-a9dc-2e2c1ed29e3a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:36.860478 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6a56da1d-4be5-4999-a9dc-2e2c1ed29e3a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:36.865898 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a56da1d-4be5-4999-a9dc-2e2c1ed29e3a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:36.866348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a56da1d-4be5-4999-a9dc-2e2c1ed29e3a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:36.867108 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a56da1d-4be5-4999-a9dc-2e2c1ed29e3a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:36.867569 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a56da1d-4be5-4999-a9dc-2e2c1ed29e3a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:36.896627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6a56da1d-4be5-4999-a9dc-2e2c1ed29e3a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040565 May 10 21:18:36.897171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 883/1659] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:36 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:37.280307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d605c818-9922-431a-80eb-c6a9360df18c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:37.281238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d605c818-9922-431a-80eb-c6a9360df18c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:37.287361 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d605c818-9922-431a-80eb-c6a9360df18c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:37.287816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d605c818-9922-431a-80eb-c6a9360df18c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:37.288580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d605c818-9922-431a-80eb-c6a9360df18c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:37.289017 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d605c818-9922-431a-80eb-c6a9360df18c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:37.318129 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d605c818-9922-431a-80eb-c6a9360df18c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041872 May 10 21:18:37.318670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 884/1660] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:37 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:18:37.825909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-51687584-188c-4795-9491-19e4326f97c0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:37.826576 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-51687584-188c-4795-9491-19e4326f97c0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:37.832972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51687584-188c-4795-9491-19e4326f97c0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:37.833423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51687584-188c-4795-9491-19e4326f97c0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:37.834186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51687584-188c-4795-9491-19e4326f97c0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:37.834611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51687584-188c-4795-9491-19e4326f97c0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:37.963687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-51687584-188c-4795-9491-19e4326f97c0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:37.971784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-51687584-188c-4795-9491-19e4326f97c0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.149714 May 10 21:18:37.972346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 885/1661] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:37 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:37.976860 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-88aeaac0-49c6-4f1a-b4c6-6db7877534b8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:37.977765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-88aeaac0-49c6-4f1a-b4c6-6db7877534b8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:37.983319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-88aeaac0-49c6-4f1a-b4c6-6db7877534b8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:37.983852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-88aeaac0-49c6-4f1a-b4c6-6db7877534b8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:37.984617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-88aeaac0-49c6-4f1a-b4c6-6db7877534b8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:37.985056 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-88aeaac0-49c6-4f1a-b4c6-6db7877534b8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:38.012771 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-88aeaac0-49c6-4f1a-b4c6-6db7877534b8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039445 May 10 21:18:38.013323 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 886/1662] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:37 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:38.018192 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-47275238-3c2d-445f-b458-c6f95e320cee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:38.019077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-47275238-3c2d-445f-b458-c6f95e320cee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:38.024458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47275238-3c2d-445f-b458-c6f95e320cee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:38.024909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47275238-3c2d-445f-b458-c6f95e320cee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:38.025671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47275238-3c2d-445f-b458-c6f95e320cee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:38.026108 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47275238-3c2d-445f-b458-c6f95e320cee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:38.054243 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-47275238-3c2d-445f-b458-c6f95e320cee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039951 May 10 21:18:38.054794 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 887/1663] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:38 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:38.330938 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-988e5335-9fe0-4464-b756-d4dd04713956 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:38.331820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-988e5335-9fe0-4464-b756-d4dd04713956 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:38.337787 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-988e5335-9fe0-4464-b756-d4dd04713956 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:38.338234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-988e5335-9fe0-4464-b756-d4dd04713956 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:38.338999 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-988e5335-9fe0-4464-b756-d4dd04713956 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:38.339467 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-988e5335-9fe0-4464-b756-d4dd04713956 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:38.369024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-988e5335-9fe0-4464-b756-d4dd04713956 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043230 May 10 21:18:38.369572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 888/1664] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:38 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:18:38.989666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-11f51311-f339-4a58-a19c-3db307e88dfc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:38.990308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-11f51311-f339-4a58-a19c-3db307e88dfc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:38.996852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-11f51311-f339-4a58-a19c-3db307e88dfc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:38.997300 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-11f51311-f339-4a58-a19c-3db307e88dfc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:38.998093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-11f51311-f339-4a58-a19c-3db307e88dfc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:38.998578 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-11f51311-f339-4a58-a19c-3db307e88dfc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:39.129762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-11f51311-f339-4a58-a19c-3db307e88dfc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:39.137022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-11f51311-f339-4a58-a19c-3db307e88dfc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151299 May 10 21:18:39.137581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 889/1665] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:38 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:39.142227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a1558b4c-a64a-4e16-9d3b-3ec91bfacf57 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:39.143141 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a1558b4c-a64a-4e16-9d3b-3ec91bfacf57 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:39.148587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a1558b4c-a64a-4e16-9d3b-3ec91bfacf57 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:39.149030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a1558b4c-a64a-4e16-9d3b-3ec91bfacf57 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:39.149784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a1558b4c-a64a-4e16-9d3b-3ec91bfacf57 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:39.150215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a1558b4c-a64a-4e16-9d3b-3ec91bfacf57 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:39.179090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a1558b4c-a64a-4e16-9d3b-3ec91bfacf57 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040535 May 10 21:18:39.179654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 890/1666] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:39 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:39.183991 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-59ec9603-16d0-469c-ac88-b8d651cf5df2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:39.184864 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-59ec9603-16d0-469c-ac88-b8d651cf5df2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:39.190238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-59ec9603-16d0-469c-ac88-b8d651cf5df2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:39.190683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-59ec9603-16d0-469c-ac88-b8d651cf5df2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:39.191467 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-59ec9603-16d0-469c-ac88-b8d651cf5df2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:39.191901 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-59ec9603-16d0-469c-ac88-b8d651cf5df2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:39.220289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-59ec9603-16d0-469c-ac88-b8d651cf5df2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039684 May 10 21:18:39.220826 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 891/1667] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:39 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:39.380245 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a9d8971c-bccf-4e7e-9ac1-2a9896bbabfb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:39.381306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a9d8971c-bccf-4e7e-9ac1-2a9896bbabfb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:39.387083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a9d8971c-bccf-4e7e-9ac1-2a9896bbabfb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:39.387555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a9d8971c-bccf-4e7e-9ac1-2a9896bbabfb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:39.388311 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a9d8971c-bccf-4e7e-9ac1-2a9896bbabfb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:39.388746 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a9d8971c-bccf-4e7e-9ac1-2a9896bbabfb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:39.417947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a9d8971c-bccf-4e7e-9ac1-2a9896bbabfb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041470 May 10 21:18:39.418484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 892/1668] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:39 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:18:40.154275 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-069b1368-f4cb-4deb-ba46-637c248433fc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:40.154987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-069b1368-f4cb-4deb-ba46-637c248433fc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:40.161312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-069b1368-f4cb-4deb-ba46-637c248433fc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:40.161786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-069b1368-f4cb-4deb-ba46-637c248433fc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:40.162559 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-069b1368-f4cb-4deb-ba46-637c248433fc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:40.163058 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-069b1368-f4cb-4deb-ba46-637c248433fc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:40.291649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-069b1368-f4cb-4deb-ba46-637c248433fc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:40.300103 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-069b1368-f4cb-4deb-ba46-637c248433fc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.149877 May 10 21:18:40.300669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 893/1669] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:40 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:40.305159 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4df228fa-ad39-49e4-968b-0f5e8af9b870 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:40.306059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4df228fa-ad39-49e4-968b-0f5e8af9b870 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:40.312232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4df228fa-ad39-49e4-968b-0f5e8af9b870 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:40.312683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4df228fa-ad39-49e4-968b-0f5e8af9b870 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:40.313446 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4df228fa-ad39-49e4-968b-0f5e8af9b870 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:40.313876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4df228fa-ad39-49e4-968b-0f5e8af9b870 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:40.343244 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4df228fa-ad39-49e4-968b-0f5e8af9b870 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040970 May 10 21:18:40.343816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 894/1670] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:40 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:40.348564 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6feb3c3d-1e4a-4121-8b19-72bca76a26a2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:40.349486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6feb3c3d-1e4a-4121-8b19-72bca76a26a2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:40.355176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6feb3c3d-1e4a-4121-8b19-72bca76a26a2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:40.355661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6feb3c3d-1e4a-4121-8b19-72bca76a26a2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:40.356477 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6feb3c3d-1e4a-4121-8b19-72bca76a26a2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:40.356915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6feb3c3d-1e4a-4121-8b19-72bca76a26a2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:40.387017 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6feb3c3d-1e4a-4121-8b19-72bca76a26a2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042213 May 10 21:18:40.387659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 895/1671] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:40 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:40.429950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e9d39ff3-3acb-4b68-ad63-035a1e3ad0e0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:40.430816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e9d39ff3-3acb-4b68-ad63-035a1e3ad0e0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:40.437374 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e9d39ff3-3acb-4b68-ad63-035a1e3ad0e0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:40.437816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e9d39ff3-3acb-4b68-ad63-035a1e3ad0e0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:40.438574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e9d39ff3-3acb-4b68-ad63-035a1e3ad0e0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:40.439050 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e9d39ff3-3acb-4b68-ad63-035a1e3ad0e0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:40.467902 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e9d39ff3-3acb-4b68-ad63-035a1e3ad0e0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041736 May 10 21:18:40.468449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 896/1672] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:40 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:18:41.318104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-62ef1e6f-4902-4bab-8cb2-6b47f4a2af9d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:41.318820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-62ef1e6f-4902-4bab-8cb2-6b47f4a2af9d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:41.325343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-62ef1e6f-4902-4bab-8cb2-6b47f4a2af9d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:41.325792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-62ef1e6f-4902-4bab-8cb2-6b47f4a2af9d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:41.326650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-62ef1e6f-4902-4bab-8cb2-6b47f4a2af9d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:41.328089 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-62ef1e6f-4902-4bab-8cb2-6b47f4a2af9d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:41.458086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-62ef1e6f-4902-4bab-8cb2-6b47f4a2af9d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:41.465351 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-62ef1e6f-4902-4bab-8cb2-6b47f4a2af9d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151248 May 10 21:18:41.465912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 897/1673] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:41 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:41.470607 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-682523c2-1db1-4d51-a243-f89e73d89309 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:41.471528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-682523c2-1db1-4d51-a243-f89e73d89309 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:41.477054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-682523c2-1db1-4d51-a243-f89e73d89309 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:41.477496 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-682523c2-1db1-4d51-a243-f89e73d89309 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:41.478251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-682523c2-1db1-4d51-a243-f89e73d89309 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:41.478684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-682523c2-1db1-4d51-a243-f89e73d89309 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:41.507285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-682523c2-1db1-4d51-a243-f89e73d89309 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040369 May 10 21:18:41.507830 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 898/1674] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:41 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:41.512175 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f3f5d1ad-9a32-4cc8-a936-28b9a13f39d2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:41.513047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f3f5d1ad-9a32-4cc8-a936-28b9a13f39d2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:41.518950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f3f5d1ad-9a32-4cc8-a936-28b9a13f39d2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:41.519432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f3f5d1ad-9a32-4cc8-a936-28b9a13f39d2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:41.520182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f3f5d1ad-9a32-4cc8-a936-28b9a13f39d2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:41.520614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f3f5d1ad-9a32-4cc8-a936-28b9a13f39d2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:41.547957 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f3f5d1ad-9a32-4cc8-a936-28b9a13f39d2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039195 May 10 21:18:41.548485 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 899/1675] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:41 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:41.552927 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-10c1d656-f180-437a-9f85-d1e7a10425d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:41.553802 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-10c1d656-f180-437a-9f85-d1e7a10425d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:41.559045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-10c1d656-f180-437a-9f85-d1e7a10425d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:41.559528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-10c1d656-f180-437a-9f85-d1e7a10425d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:41.560279 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-10c1d656-f180-437a-9f85-d1e7a10425d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:41.560717 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-10c1d656-f180-437a-9f85-d1e7a10425d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:41.590114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-10c1d656-f180-437a-9f85-d1e7a10425d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040677 May 10 21:18:41.590656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 900/1676] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:41 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:42.482459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-77326755-0ccb-4c8b-b199-b40f95be1591 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:42.483755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-77326755-0ccb-4c8b-b199-b40f95be1591 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:42.490145 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-77326755-0ccb-4c8b-b199-b40f95be1591 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:42.490598 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-77326755-0ccb-4c8b-b199-b40f95be1591 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:42.491582 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-77326755-0ccb-4c8b-b199-b40f95be1591 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:42.491838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-77326755-0ccb-4c8b-b199-b40f95be1591 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:42.623392 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-77326755-0ccb-4c8b-b199-b40f95be1591 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:42.632149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-77326755-0ccb-4c8b-b199-b40f95be1591 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.153509 May 10 21:18:42.632715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 901/1677] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:42 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:42.637214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0bd4e29a-6b0d-44a9-be30-22f4b73f5ed8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:42.638126 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0bd4e29a-6b0d-44a9-be30-22f4b73f5ed8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:42.644109 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0bd4e29a-6b0d-44a9-be30-22f4b73f5ed8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:42.644558 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0bd4e29a-6b0d-44a9-be30-22f4b73f5ed8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:42.645322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0bd4e29a-6b0d-44a9-be30-22f4b73f5ed8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:42.645760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0bd4e29a-6b0d-44a9-be30-22f4b73f5ed8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:42.674740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0bd4e29a-6b0d-44a9-be30-22f4b73f5ed8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041035 May 10 21:18:42.675319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 902/1678] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:42 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:42.679702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-195d1b8f-ff16-422e-bd1e-26e7a0c80169 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:42.680603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-195d1b8f-ff16-422e-bd1e-26e7a0c80169 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:42.686993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-195d1b8f-ff16-422e-bd1e-26e7a0c80169 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:42.688066 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-195d1b8f-ff16-422e-bd1e-26e7a0c80169 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:42.688836 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-195d1b8f-ff16-422e-bd1e-26e7a0c80169 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:42.689274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-195d1b8f-ff16-422e-bd1e-26e7a0c80169 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:42.719049 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-195d1b8f-ff16-422e-bd1e-26e7a0c80169 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042760 May 10 21:18:42.719626 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 903/1679] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:42 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:42.724074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8a1cf45e-7a9b-481a-8221-0af7d5866154 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:42.724964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8a1cf45e-7a9b-481a-8221-0af7d5866154 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:42.730267 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8a1cf45e-7a9b-481a-8221-0af7d5866154 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:42.730722 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8a1cf45e-7a9b-481a-8221-0af7d5866154 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:42.731512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8a1cf45e-7a9b-481a-8221-0af7d5866154 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:42.731955 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8a1cf45e-7a9b-481a-8221-0af7d5866154 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:42.761112 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8a1cf45e-7a9b-481a-8221-0af7d5866154 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040533 May 10 21:18:42.761652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 904/1680] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:42 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:43.650089 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bd332189-5147-4987-9075-d749fe963d7b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:43.650701 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bd332189-5147-4987-9075-d749fe963d7b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:43.657239 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bd332189-5147-4987-9075-d749fe963d7b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:43.657692 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bd332189-5147-4987-9075-d749fe963d7b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:43.658450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bd332189-5147-4987-9075-d749fe963d7b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:43.658883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bd332189-5147-4987-9075-d749fe963d7b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:43.796906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bd332189-5147-4987-9075-d749fe963d7b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:43.804277 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bd332189-5147-4987-9075-d749fe963d7b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.158353 May 10 21:18:43.804839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 905/1681] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:43 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:43.809382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ac2d9d1f-130a-497d-9a44-a57ef28ea992 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:43.810283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ac2d9d1f-130a-497d-9a44-a57ef28ea992 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:43.816053 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ac2d9d1f-130a-497d-9a44-a57ef28ea992 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:43.816500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ac2d9d1f-130a-497d-9a44-a57ef28ea992 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:43.817258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ac2d9d1f-130a-497d-9a44-a57ef28ea992 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:43.817693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ac2d9d1f-130a-497d-9a44-a57ef28ea992 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:43.846357 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ac2d9d1f-130a-497d-9a44-a57ef28ea992 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040535 May 10 21:18:43.846896 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 906/1682] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:43 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:43.851418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e00211e6-c425-43e9-a2a0-5da7d322e274 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:43.852296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e00211e6-c425-43e9-a2a0-5da7d322e274 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:43.857699 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e00211e6-c425-43e9-a2a0-5da7d322e274 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:43.859014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e00211e6-c425-43e9-a2a0-5da7d322e274 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:43.859593 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e00211e6-c425-43e9-a2a0-5da7d322e274 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:43.860024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e00211e6-c425-43e9-a2a0-5da7d322e274 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:43.888129 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e00211e6-c425-43e9-a2a0-5da7d322e274 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040235 May 10 21:18:43.888673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 907/1683] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:43 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:43.893156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-89c2b92d-55d1-4417-8886-55f6871d6977 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:43.894045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-89c2b92d-55d1-4417-8886-55f6871d6977 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:43.899317 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89c2b92d-55d1-4417-8886-55f6871d6977 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:43.899766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89c2b92d-55d1-4417-8886-55f6871d6977 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:43.900513 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89c2b92d-55d1-4417-8886-55f6871d6977 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:43.900946 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89c2b92d-55d1-4417-8886-55f6871d6977 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:43.929423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-89c2b92d-55d1-4417-8886-55f6871d6977 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039735 May 10 21:18:43.929979 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 908/1684] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:43 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:44.821746 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b2894a93-438c-4fe2-92c7-8cc5f353f3e7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:44.822383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b2894a93-438c-4fe2-92c7-8cc5f353f3e7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:44.828732 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b2894a93-438c-4fe2-92c7-8cc5f353f3e7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:44.829175 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b2894a93-438c-4fe2-92c7-8cc5f353f3e7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:44.829935 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b2894a93-438c-4fe2-92c7-8cc5f353f3e7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:44.830367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b2894a93-438c-4fe2-92c7-8cc5f353f3e7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:44.969815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b2894a93-438c-4fe2-92c7-8cc5f353f3e7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:44.977213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b2894a93-438c-4fe2-92c7-8cc5f353f3e7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.159599 May 10 21:18:44.977779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 909/1685] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:44 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:44.982264 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-eea0238a-2743-47c0-b7fc-022bf63aeab1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:44.986807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-eea0238a-2743-47c0-b7fc-022bf63aeab1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:44.989280 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eea0238a-2743-47c0-b7fc-022bf63aeab1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:44.989712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eea0238a-2743-47c0-b7fc-022bf63aeab1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:44.990475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eea0238a-2743-47c0-b7fc-022bf63aeab1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:44.990912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eea0238a-2743-47c0-b7fc-022bf63aeab1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:45.019547 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-eea0238a-2743-47c0-b7fc-022bf63aeab1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040744 May 10 21:18:45.020096 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 910/1686] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:44 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:45.024465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f9a5c437-7b33-4037-a902-747f9831157d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:45.025359 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f9a5c437-7b33-4037-a902-747f9831157d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:45.031479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f9a5c437-7b33-4037-a902-747f9831157d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:45.031930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f9a5c437-7b33-4037-a902-747f9831157d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:45.032691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f9a5c437-7b33-4037-a902-747f9831157d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:45.033125 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f9a5c437-7b33-4037-a902-747f9831157d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:45.060597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f9a5c437-7b33-4037-a902-747f9831157d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039551 May 10 21:18:45.061675 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 911/1687] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:45 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:45.066058 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8b44e279-5d29-4fca-a87d-815a46594e74 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:45.066942 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8b44e279-5d29-4fca-a87d-815a46594e74 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:45.072644 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8b44e279-5d29-4fca-a87d-815a46594e74 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:45.073095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8b44e279-5d29-4fca-a87d-815a46594e74 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:45.073854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8b44e279-5d29-4fca-a87d-815a46594e74 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:45.074293 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8b44e279-5d29-4fca-a87d-815a46594e74 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:45.103531 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8b44e279-5d29-4fca-a87d-815a46594e74 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040849 May 10 21:18:45.104096 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 912/1688] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:45 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:45.995414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9fba09e2-06f5-4499-af88-02b6c33cba53 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:45.996046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9fba09e2-06f5-4499-af88-02b6c33cba53 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:46.002542 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9fba09e2-06f5-4499-af88-02b6c33cba53 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:46.002984 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9fba09e2-06f5-4499-af88-02b6c33cba53 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:46.003765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9fba09e2-06f5-4499-af88-02b6c33cba53 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:46.004198 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9fba09e2-06f5-4499-af88-02b6c33cba53 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:46.133875 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9fba09e2-06f5-4499-af88-02b6c33cba53 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:46.141202 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9fba09e2-06f5-4499-af88-02b6c33cba53 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.149765 May 10 21:18:46.141771 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 913/1689] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:45 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:46.146247 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-524200e0-ba70-42c0-8bce-68049b3ca42f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:46.147168 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-524200e0-ba70-42c0-8bce-68049b3ca42f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:46.152947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-524200e0-ba70-42c0-8bce-68049b3ca42f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:46.153407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-524200e0-ba70-42c0-8bce-68049b3ca42f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:46.154179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-524200e0-ba70-42c0-8bce-68049b3ca42f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:46.155177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-524200e0-ba70-42c0-8bce-68049b3ca42f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:46.183334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-524200e0-ba70-42c0-8bce-68049b3ca42f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040514 May 10 21:18:46.184061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 914/1690] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:46 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:46.188413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5a942aac-a133-4c8d-a41a-14dffb0a99c3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:46.193668 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5a942aac-a133-4c8d-a41a-14dffb0a99c3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:46.195029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5a942aac-a133-4c8d-a41a-14dffb0a99c3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:46.195776 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5a942aac-a133-4c8d-a41a-14dffb0a99c3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:46.196546 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5a942aac-a133-4c8d-a41a-14dffb0a99c3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:46.196994 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5a942aac-a133-4c8d-a41a-14dffb0a99c3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:46.226503 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5a942aac-a133-4c8d-a41a-14dffb0a99c3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041612 May 10 21:18:46.227176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 915/1691] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:46 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:46.231573 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f46d850e-e977-4c4d-910a-7544077a436a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:46.232500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f46d850e-e977-4c4d-910a-7544077a436a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:46.238125 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f46d850e-e977-4c4d-910a-7544077a436a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:46.238581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f46d850e-e977-4c4d-910a-7544077a436a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:46.239394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f46d850e-e977-4c4d-910a-7544077a436a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:46.239910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f46d850e-e977-4c4d-910a-7544077a436a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:46.268976 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f46d850e-e977-4c4d-910a-7544077a436a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040827 May 10 21:18:46.269458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 916/1692] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:46 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:47.158625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-17c9f4e7-e466-4080-9e62-daa25a606cf0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:47.159317 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-17c9f4e7-e466-4080-9e62-daa25a606cf0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:47.165565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17c9f4e7-e466-4080-9e62-daa25a606cf0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:47.166011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17c9f4e7-e466-4080-9e62-daa25a606cf0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:47.166771 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17c9f4e7-e466-4080-9e62-daa25a606cf0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:47.167231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17c9f4e7-e466-4080-9e62-daa25a606cf0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:47.298528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-17c9f4e7-e466-4080-9e62-daa25a606cf0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:47.305765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-17c9f4e7-e466-4080-9e62-daa25a606cf0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151078 May 10 21:18:47.306328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 917/1693] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:47 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:47.310782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d239e494-56b4-4f0c-a7c9-684e34ae0a2c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:47.311968 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d239e494-56b4-4f0c-a7c9-684e34ae0a2c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:47.317466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d239e494-56b4-4f0c-a7c9-684e34ae0a2c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:47.317909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d239e494-56b4-4f0c-a7c9-684e34ae0a2c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:47.318666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d239e494-56b4-4f0c-a7c9-684e34ae0a2c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:47.319099 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d239e494-56b4-4f0c-a7c9-684e34ae0a2c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:47.347611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d239e494-56b4-4f0c-a7c9-684e34ae0a2c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040276 May 10 21:18:47.348148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 918/1694] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:47 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:47.352472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2de82852-b68d-4095-a52b-ab3cdfc4997e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:47.353388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2de82852-b68d-4095-a52b-ab3cdfc4997e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:47.359586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2de82852-b68d-4095-a52b-ab3cdfc4997e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:47.360029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2de82852-b68d-4095-a52b-ab3cdfc4997e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:47.360788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2de82852-b68d-4095-a52b-ab3cdfc4997e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:47.361222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2de82852-b68d-4095-a52b-ab3cdfc4997e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:47.388237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2de82852-b68d-4095-a52b-ab3cdfc4997e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039158 May 10 21:18:47.388773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 919/1695] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:47 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:47.393244 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0f09274c-8057-4c6a-b2a8-258f19432fc9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:47.394116 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0f09274c-8057-4c6a-b2a8-258f19432fc9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:47.399358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f09274c-8057-4c6a-b2a8-258f19432fc9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:47.399804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f09274c-8057-4c6a-b2a8-258f19432fc9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:47.400550 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f09274c-8057-4c6a-b2a8-258f19432fc9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:47.400984 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f09274c-8057-4c6a-b2a8-258f19432fc9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:47.429528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0f09274c-8057-4c6a-b2a8-258f19432fc9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039569 May 10 21:18:47.430006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 920/1696] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:47 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:48.323544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a79fd29d-b325-4b03-914d-9e9a1aa59d29 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:48.324217 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a79fd29d-b325-4b03-914d-9e9a1aa59d29 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:48.331419 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a79fd29d-b325-4b03-914d-9e9a1aa59d29 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:48.331868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a79fd29d-b325-4b03-914d-9e9a1aa59d29 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:48.332621 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a79fd29d-b325-4b03-914d-9e9a1aa59d29 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:48.333053 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a79fd29d-b325-4b03-914d-9e9a1aa59d29 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:48.461899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a79fd29d-b325-4b03-914d-9e9a1aa59d29 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:48.469959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a79fd29d-b325-4b03-914d-9e9a1aa59d29 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.150537 May 10 21:18:48.470515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 921/1697] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:48 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:48.475009 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7ea8e81c-6d4c-40e3-97c1-ca97c817f550 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:48.475936 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7ea8e81c-6d4c-40e3-97c1-ca97c817f550 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:48.481359 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ea8e81c-6d4c-40e3-97c1-ca97c817f550 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:48.481801 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ea8e81c-6d4c-40e3-97c1-ca97c817f550 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:48.482562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ea8e81c-6d4c-40e3-97c1-ca97c817f550 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:48.483570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ea8e81c-6d4c-40e3-97c1-ca97c817f550 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:48.510733 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7ea8e81c-6d4c-40e3-97c1-ca97c817f550 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039255 May 10 21:18:48.511301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 922/1698] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:48 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:48.516350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c4757278-76d0-4309-bb04-7d891bd4bce1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:48.517253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c4757278-76d0-4309-bb04-7d891bd4bce1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:48.522765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4757278-76d0-4309-bb04-7d891bd4bce1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:48.523238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4757278-76d0-4309-bb04-7d891bd4bce1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:48.523996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4757278-76d0-4309-bb04-7d891bd4bce1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:48.524431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4757278-76d0-4309-bb04-7d891bd4bce1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:48.552586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c4757278-76d0-4309-bb04-7d891bd4bce1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040341 May 10 21:18:48.553131 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 923/1699] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:48 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:48.557473 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d79af2c7-27d1-4680-98f1-67b634b78631 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:48.558364 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d79af2c7-27d1-4680-98f1-67b634b78631 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:48.563724 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d79af2c7-27d1-4680-98f1-67b634b78631 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:48.564168 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d79af2c7-27d1-4680-98f1-67b634b78631 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:48.564918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d79af2c7-27d1-4680-98f1-67b634b78631 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:48.565353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d79af2c7-27d1-4680-98f1-67b634b78631 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:48.594298 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d79af2c7-27d1-4680-98f1-67b634b78631 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040200 May 10 21:18:48.594844 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 924/1700] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:48 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:49.487696 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f6a280f3-6d1e-4520-a3e6-abb4e493d3c4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:49.488342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f6a280f3-6d1e-4520-a3e6-abb4e493d3c4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:49.494680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6a280f3-6d1e-4520-a3e6-abb4e493d3c4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:49.495141 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6a280f3-6d1e-4520-a3e6-abb4e493d3c4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:49.495907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6a280f3-6d1e-4520-a3e6-abb4e493d3c4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:49.496342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6a280f3-6d1e-4520-a3e6-abb4e493d3c4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:49.626911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f6a280f3-6d1e-4520-a3e6-abb4e493d3c4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:49.634274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f6a280f3-6d1e-4520-a3e6-abb4e493d3c4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.150529 May 10 21:18:49.634835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 925/1701] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:49 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:49.639359 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e4ddeb3e-4983-48df-a03e-a1dcf773a6c4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:49.640258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e4ddeb3e-4983-48df-a03e-a1dcf773a6c4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:49.645661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4ddeb3e-4983-48df-a03e-a1dcf773a6c4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:49.646105 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4ddeb3e-4983-48df-a03e-a1dcf773a6c4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:49.646862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4ddeb3e-4983-48df-a03e-a1dcf773a6c4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:49.647323 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4ddeb3e-4983-48df-a03e-a1dcf773a6c4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:49.675976 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e4ddeb3e-4983-48df-a03e-a1dcf773a6c4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040136 May 10 21:18:49.676515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 926/1702] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:49 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:49.680852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3c7125dc-6167-4d5f-97b6-dfe9d4ff221f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:49.681726 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3c7125dc-6167-4d5f-97b6-dfe9d4ff221f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:49.687552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3c7125dc-6167-4d5f-97b6-dfe9d4ff221f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:49.687990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3c7125dc-6167-4d5f-97b6-dfe9d4ff221f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:49.688751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3c7125dc-6167-4d5f-97b6-dfe9d4ff221f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:49.689220 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3c7125dc-6167-4d5f-97b6-dfe9d4ff221f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:49.716859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3c7125dc-6167-4d5f-97b6-dfe9d4ff221f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039401 May 10 21:18:49.718129 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 927/1703] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:49 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:49.722750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0ea1e2c7-7cc0-4fa8-af47-553afd188c3c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:49.723664 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0ea1e2c7-7cc0-4fa8-af47-553afd188c3c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:49.729108 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ea1e2c7-7cc0-4fa8-af47-553afd188c3c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:49.729548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ea1e2c7-7cc0-4fa8-af47-553afd188c3c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:49.730298 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ea1e2c7-7cc0-4fa8-af47-553afd188c3c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:49.730730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ea1e2c7-7cc0-4fa8-af47-553afd188c3c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:49.758999 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0ea1e2c7-7cc0-4fa8-af47-553afd188c3c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039647 May 10 21:18:49.765751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 928/1704] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:49 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:50.651351 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a611223d-86f9-4335-bd25-52083be21765 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:50.651970 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a611223d-86f9-4335-bd25-52083be21765 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:50.658815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a611223d-86f9-4335-bd25-52083be21765 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:50.659310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a611223d-86f9-4335-bd25-52083be21765 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:50.660078 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a611223d-86f9-4335-bd25-52083be21765 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:50.660515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a611223d-86f9-4335-bd25-52083be21765 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:50.789219 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a611223d-86f9-4335-bd25-52083be21765 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:50.797155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a611223d-86f9-4335-bd25-52083be21765 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.149756 May 10 21:18:50.797733 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 929/1705] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:50 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:50.802309 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-793f6ede-cd04-4ca8-8e7a-90d13b5f6beb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:50.803237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-793f6ede-cd04-4ca8-8e7a-90d13b5f6beb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:50.808814 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-793f6ede-cd04-4ca8-8e7a-90d13b5f6beb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:50.809256 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-793f6ede-cd04-4ca8-8e7a-90d13b5f6beb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:50.810013 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-793f6ede-cd04-4ca8-8e7a-90d13b5f6beb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:50.810442 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-793f6ede-cd04-4ca8-8e7a-90d13b5f6beb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:50.839455 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-793f6ede-cd04-4ca8-8e7a-90d13b5f6beb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040725 May 10 21:18:50.840002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 930/1706] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:50 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:50.844523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-99f9182b-ad09-4bc0-b378-936c4938e2a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:50.845405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-99f9182b-ad09-4bc0-b378-936c4938e2a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:50.850780 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-99f9182b-ad09-4bc0-b378-936c4938e2a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:50.851376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-99f9182b-ad09-4bc0-b378-936c4938e2a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:50.852132 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-99f9182b-ad09-4bc0-b378-936c4938e2a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:50.852566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-99f9182b-ad09-4bc0-b378-936c4938e2a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:50.882244 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-99f9182b-ad09-4bc0-b378-936c4938e2a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041136 May 10 21:18:50.882715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 931/1707] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:50 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:50.887262 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dfbdcccc-587f-41e4-b7c9-30bcc363a61f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:50.888147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dfbdcccc-587f-41e4-b7c9-30bcc363a61f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:50.893908 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dfbdcccc-587f-41e4-b7c9-30bcc363a61f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:50.894354 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dfbdcccc-587f-41e4-b7c9-30bcc363a61f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:50.895111 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dfbdcccc-587f-41e4-b7c9-30bcc363a61f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:50.895574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dfbdcccc-587f-41e4-b7c9-30bcc363a61f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:50.923778 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dfbdcccc-587f-41e4-b7c9-30bcc363a61f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040055 May 10 21:18:50.924348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 932/1708] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:50 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:51.814719 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-07ef499d-da14-49e7-bf4d-b39176a23bee tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:51.815344 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-07ef499d-da14-49e7-bf4d-b39176a23bee tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:51.821947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07ef499d-da14-49e7-bf4d-b39176a23bee tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:51.822391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07ef499d-da14-49e7-bf4d-b39176a23bee tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:51.823176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07ef499d-da14-49e7-bf4d-b39176a23bee tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:51.823613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07ef499d-da14-49e7-bf4d-b39176a23bee tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:51.951350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-07ef499d-da14-49e7-bf4d-b39176a23bee tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:51.959239 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-07ef499d-da14-49e7-bf4d-b39176a23bee tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.148951 May 10 21:18:51.959802 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 933/1709] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:51 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:51.964282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d2e76527-4faf-4cca-9084-f65abd8eb7a7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:51.965179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d2e76527-4faf-4cca-9084-f65abd8eb7a7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:51.970857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2e76527-4faf-4cca-9084-f65abd8eb7a7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:51.971343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2e76527-4faf-4cca-9084-f65abd8eb7a7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:51.972098 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2e76527-4faf-4cca-9084-f65abd8eb7a7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:51.972529 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2e76527-4faf-4cca-9084-f65abd8eb7a7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:52.000649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d2e76527-4faf-4cca-9084-f65abd8eb7a7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039867 May 10 21:18:52.001183 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 934/1710] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:51 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:52.005511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fba67e4a-278f-4ea2-b9a9-c1248d90569c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:52.006392 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fba67e4a-278f-4ea2-b9a9-c1248d90569c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:52.011698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fba67e4a-278f-4ea2-b9a9-c1248d90569c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:52.012142 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fba67e4a-278f-4ea2-b9a9-c1248d90569c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:52.012888 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fba67e4a-278f-4ea2-b9a9-c1248d90569c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:52.013320 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fba67e4a-278f-4ea2-b9a9-c1248d90569c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:52.041380 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fba67e4a-278f-4ea2-b9a9-c1248d90569c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039244 May 10 21:18:52.041916 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 935/1711] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:52 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:52.046270 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-368e5e6b-5857-4407-b5d5-ef1e8d39ac14 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:52.047163 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-368e5e6b-5857-4407-b5d5-ef1e8d39ac14 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:52.052441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-368e5e6b-5857-4407-b5d5-ef1e8d39ac14 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:52.052885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-368e5e6b-5857-4407-b5d5-ef1e8d39ac14 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:52.053637 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-368e5e6b-5857-4407-b5d5-ef1e8d39ac14 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:52.054070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-368e5e6b-5857-4407-b5d5-ef1e8d39ac14 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:52.082781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-368e5e6b-5857-4407-b5d5-ef1e8d39ac14 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039923 May 10 21:18:52.083569 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 936/1712] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:52 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:52.976879 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a1ea61a6-44f9-4022-aa56-303037e00fde tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:52.977524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a1ea61a6-44f9-4022-aa56-303037e00fde tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:52.983947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a1ea61a6-44f9-4022-aa56-303037e00fde tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:52.984402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a1ea61a6-44f9-4022-aa56-303037e00fde tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:52.985171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a1ea61a6-44f9-4022-aa56-303037e00fde tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:52.985614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a1ea61a6-44f9-4022-aa56-303037e00fde tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:53.116224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a1ea61a6-44f9-4022-aa56-303037e00fde tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:53.124192 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a1ea61a6-44f9-4022-aa56-303037e00fde tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.150617 May 10 21:18:53.124716 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 937/1713] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:52 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:53.129280 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c9eac16b-30d3-4a12-9a27-75c7e1301d10 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:53.130191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c9eac16b-30d3-4a12-9a27-75c7e1301d10 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:53.135784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9eac16b-30d3-4a12-9a27-75c7e1301d10 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:53.136238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9eac16b-30d3-4a12-9a27-75c7e1301d10 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:53.137007 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9eac16b-30d3-4a12-9a27-75c7e1301d10 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:53.137451 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9eac16b-30d3-4a12-9a27-75c7e1301d10 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:53.166408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c9eac16b-30d3-4a12-9a27-75c7e1301d10 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040679 May 10 21:18:53.166956 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 938/1714] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:53 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:53.171382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-47d95cd3-d288-47ef-b448-2a2108dd425f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:53.172278 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-47d95cd3-d288-47ef-b448-2a2108dd425f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:53.177713 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47d95cd3-d288-47ef-b448-2a2108dd425f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:53.178164 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47d95cd3-d288-47ef-b448-2a2108dd425f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:53.178923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47d95cd3-d288-47ef-b448-2a2108dd425f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:53.179389 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47d95cd3-d288-47ef-b448-2a2108dd425f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:53.208139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-47d95cd3-d288-47ef-b448-2a2108dd425f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040197 May 10 21:18:53.208687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 939/1715] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:53 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:53.213060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ab196bd2-d8e2-4aa0-8671-ea54835551c0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:53.213941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ab196bd2-d8e2-4aa0-8671-ea54835551c0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:53.219961 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab196bd2-d8e2-4aa0-8671-ea54835551c0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:53.220414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab196bd2-d8e2-4aa0-8671-ea54835551c0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:53.221181 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab196bd2-d8e2-4aa0-8671-ea54835551c0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:53.221626 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab196bd2-d8e2-4aa0-8671-ea54835551c0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:53.249494 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ab196bd2-d8e2-4aa0-8671-ea54835551c0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039794 May 10 21:18:53.249976 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 940/1716] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:53 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:54.141965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c16b1a18-b984-48cf-81c1-77cafe49c038 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:54.142607 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c16b1a18-b984-48cf-81c1-77cafe49c038 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:54.149021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c16b1a18-b984-48cf-81c1-77cafe49c038 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:54.149472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c16b1a18-b984-48cf-81c1-77cafe49c038 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:54.150241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c16b1a18-b984-48cf-81c1-77cafe49c038 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:54.150681 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c16b1a18-b984-48cf-81c1-77cafe49c038 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:54.280002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c16b1a18-b984-48cf-81c1-77cafe49c038 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:54.287427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c16b1a18-b984-48cf-81c1-77cafe49c038 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.149881 May 10 21:18:54.287999 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 941/1717] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:54 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:54.292518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f3faed18-1c03-4640-ad96-c8579c2e1321 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:54.293429 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f3faed18-1c03-4640-ad96-c8579c2e1321 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:54.299553 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f3faed18-1c03-4640-ad96-c8579c2e1321 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:54.300010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f3faed18-1c03-4640-ad96-c8579c2e1321 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:54.300809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f3faed18-1c03-4640-ad96-c8579c2e1321 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:54.301252 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f3faed18-1c03-4640-ad96-c8579c2e1321 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:54.330631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f3faed18-1c03-4640-ad96-c8579c2e1321 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041632 May 10 21:18:54.331210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 942/1718] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:54 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:54.335635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7a75e946-1144-47dd-952c-786a72295c8b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:54.336529 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7a75e946-1144-47dd-952c-786a72295c8b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:54.341962 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7a75e946-1144-47dd-952c-786a72295c8b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:54.343159 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7a75e946-1144-47dd-952c-786a72295c8b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:54.343917 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7a75e946-1144-47dd-952c-786a72295c8b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:54.344363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7a75e946-1144-47dd-952c-786a72295c8b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:54.375090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7a75e946-1144-47dd-952c-786a72295c8b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042862 May 10 21:18:54.375840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 943/1719] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:54 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:54.380483 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-20d73846-5c8b-4f34-830e-5b054612928e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:54.381384 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-20d73846-5c8b-4f34-830e-5b054612928e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:54.386806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20d73846-5c8b-4f34-830e-5b054612928e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:54.387298 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20d73846-5c8b-4f34-830e-5b054612928e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:54.388069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20d73846-5c8b-4f34-830e-5b054612928e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:54.388509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20d73846-5c8b-4f34-830e-5b054612928e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:54.417388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-20d73846-5c8b-4f34-830e-5b054612928e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040502 May 10 21:18:54.417861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 944/1720] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:54 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:55.305427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ea80f7b6-dfc0-475f-ba57-810136615a43 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:55.306114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ea80f7b6-dfc0-475f-ba57-810136615a43 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:55.312604 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ea80f7b6-dfc0-475f-ba57-810136615a43 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:55.313049 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ea80f7b6-dfc0-475f-ba57-810136615a43 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:55.313806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ea80f7b6-dfc0-475f-ba57-810136615a43 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:55.314245 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ea80f7b6-dfc0-475f-ba57-810136615a43 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:55.445959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ea80f7b6-dfc0-475f-ba57-810136615a43 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:55.454084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ea80f7b6-dfc0-475f-ba57-810136615a43 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.152817 May 10 21:18:55.454645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 945/1721] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:55 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:55.459228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3c20cf30-d7a9-4660-8576-a410dc23076f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:55.460142 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3c20cf30-d7a9-4660-8576-a410dc23076f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:55.465575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3c20cf30-d7a9-4660-8576-a410dc23076f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:55.466020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3c20cf30-d7a9-4660-8576-a410dc23076f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:55.466778 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3c20cf30-d7a9-4660-8576-a410dc23076f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:55.467821 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3c20cf30-d7a9-4660-8576-a410dc23076f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:55.496240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3c20cf30-d7a9-4660-8576-a410dc23076f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040519 May 10 21:18:55.496791 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 946/1722] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:55 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:55.501262 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-95162158-6cfa-4d27-a7a2-e2ba1c0b74fa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:55.502157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-95162158-6cfa-4d27-a7a2-e2ba1c0b74fa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:55.507695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-95162158-6cfa-4d27-a7a2-e2ba1c0b74fa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:55.508132 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-95162158-6cfa-4d27-a7a2-e2ba1c0b74fa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:55.508885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-95162158-6cfa-4d27-a7a2-e2ba1c0b74fa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:55.509317 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-95162158-6cfa-4d27-a7a2-e2ba1c0b74fa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:55.538244 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-95162158-6cfa-4d27-a7a2-e2ba1c0b74fa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040485 May 10 21:18:55.538781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 947/1723] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:55 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:55.543980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2e38a951-f702-43a9-9283-f9c55451852b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:55.545534 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2e38a951-f702-43a9-9283-f9c55451852b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:55.552143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e38a951-f702-43a9-9283-f9c55451852b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:55.552586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e38a951-f702-43a9-9283-f9c55451852b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:55.553347 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e38a951-f702-43a9-9283-f9c55451852b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:55.553779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e38a951-f702-43a9-9283-f9c55451852b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:55.583093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2e38a951-f702-43a9-9283-f9c55451852b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043266 May 10 21:18:55.583928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 948/1724] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:55 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:56.472033 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0ce204fd-8cf0-4379-89ef-c16797d94814 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:56.472683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0ce204fd-8cf0-4379-89ef-c16797d94814 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:56.478999 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ce204fd-8cf0-4379-89ef-c16797d94814 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:56.479487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ce204fd-8cf0-4379-89ef-c16797d94814 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:56.480256 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ce204fd-8cf0-4379-89ef-c16797d94814 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:56.480693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ce204fd-8cf0-4379-89ef-c16797d94814 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:56.612341 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0ce204fd-8cf0-4379-89ef-c16797d94814 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:56.619782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0ce204fd-8cf0-4379-89ef-c16797d94814 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151719 May 10 21:18:56.620348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 949/1725] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:56 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:56.626374 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-56ab1e96-3909-4447-8a6d-906fbc8fb307 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:56.627319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-56ab1e96-3909-4447-8a6d-906fbc8fb307 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:56.632890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-56ab1e96-3909-4447-8a6d-906fbc8fb307 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:56.633344 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-56ab1e96-3909-4447-8a6d-906fbc8fb307 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:56.634113 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-56ab1e96-3909-4447-8a6d-906fbc8fb307 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:56.634552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-56ab1e96-3909-4447-8a6d-906fbc8fb307 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:56.662890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-56ab1e96-3909-4447-8a6d-906fbc8fb307 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041566 May 10 21:18:56.663473 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 950/1726] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:56 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:56.667827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-45ac0bfe-7f8c-4167-b5c1-13de8a581c78 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:56.668714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-45ac0bfe-7f8c-4167-b5c1-13de8a581c78 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:56.674850 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-45ac0bfe-7f8c-4167-b5c1-13de8a581c78 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:56.675359 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-45ac0bfe-7f8c-4167-b5c1-13de8a581c78 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:56.676101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-45ac0bfe-7f8c-4167-b5c1-13de8a581c78 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:56.676542 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-45ac0bfe-7f8c-4167-b5c1-13de8a581c78 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:56.705910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-45ac0bfe-7f8c-4167-b5c1-13de8a581c78 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041477 May 10 21:18:56.706462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 951/1727] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:56 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:56.710813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1fdbc63f-38b1-406c-a4cb-2ba087dd8c7a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:56.711721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1fdbc63f-38b1-406c-a4cb-2ba087dd8c7a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:56.717603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1fdbc63f-38b1-406c-a4cb-2ba087dd8c7a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:56.718066 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1fdbc63f-38b1-406c-a4cb-2ba087dd8c7a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:56.718823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1fdbc63f-38b1-406c-a4cb-2ba087dd8c7a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:56.719303 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1fdbc63f-38b1-406c-a4cb-2ba087dd8c7a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:56.747197 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1fdbc63f-38b1-406c-a4cb-2ba087dd8c7a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039740 May 10 21:18:56.747750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 952/1728] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:56 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:57.637377 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-759c39ed-b83a-4260-a392-7074fe0f8c8e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:57.637979 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-759c39ed-b83a-4260-a392-7074fe0f8c8e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:57.644826 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-759c39ed-b83a-4260-a392-7074fe0f8c8e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:57.645272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-759c39ed-b83a-4260-a392-7074fe0f8c8e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:57.646042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-759c39ed-b83a-4260-a392-7074fe0f8c8e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:57.646474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-759c39ed-b83a-4260-a392-7074fe0f8c8e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:57.776436 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-759c39ed-b83a-4260-a392-7074fe0f8c8e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:57.784483 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-759c39ed-b83a-4260-a392-7074fe0f8c8e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151091 May 10 21:18:57.785047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 953/1729] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:57 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:57.789523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7c6c500a-2219-4fda-93fc-ecef62a6d172 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:57.790419 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7c6c500a-2219-4fda-93fc-ecef62a6d172 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:57.796118 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c6c500a-2219-4fda-93fc-ecef62a6d172 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:57.796561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c6c500a-2219-4fda-93fc-ecef62a6d172 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:57.797319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c6c500a-2219-4fda-93fc-ecef62a6d172 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:57.797750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c6c500a-2219-4fda-93fc-ecef62a6d172 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:57.827499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7c6c500a-2219-4fda-93fc-ecef62a6d172 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040665 May 10 21:18:57.828043 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 954/1730] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:57 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:57.832437 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e70545a3-776f-44cc-9eee-369ca7c2b5f7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:57.833324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e70545a3-776f-44cc-9eee-369ca7c2b5f7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:57.838736 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e70545a3-776f-44cc-9eee-369ca7c2b5f7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:57.839221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e70545a3-776f-44cc-9eee-369ca7c2b5f7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:57.839984 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e70545a3-776f-44cc-9eee-369ca7c2b5f7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:57.840420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e70545a3-776f-44cc-9eee-369ca7c2b5f7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:57.869262 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e70545a3-776f-44cc-9eee-369ca7c2b5f7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040260 May 10 21:18:57.869803 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 955/1731] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:57 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:57.874335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6180bdc6-41b6-4be8-bc5c-d8682e15677e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:57.875242 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6180bdc6-41b6-4be8-bc5c-d8682e15677e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:57.880592 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6180bdc6-41b6-4be8-bc5c-d8682e15677e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:57.881045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6180bdc6-41b6-4be8-bc5c-d8682e15677e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:57.881807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6180bdc6-41b6-4be8-bc5c-d8682e15677e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:57.882250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6180bdc6-41b6-4be8-bc5c-d8682e15677e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:57.910553 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6180bdc6-41b6-4be8-bc5c-d8682e15677e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039711 May 10 21:18:57.911043 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 956/1732] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:57 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:58.801709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-321cd16a-60d4-4adb-90c6-9ef8b6ccc5cf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:58.802456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-321cd16a-60d4-4adb-90c6-9ef8b6ccc5cf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:58.809082 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-321cd16a-60d4-4adb-90c6-9ef8b6ccc5cf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:58.809556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-321cd16a-60d4-4adb-90c6-9ef8b6ccc5cf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:58.810341 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-321cd16a-60d4-4adb-90c6-9ef8b6ccc5cf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:58.811368 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-321cd16a-60d4-4adb-90c6-9ef8b6ccc5cf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:58.943794 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-321cd16a-60d4-4adb-90c6-9ef8b6ccc5cf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:18:58.952082 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-321cd16a-60d4-4adb-90c6-9ef8b6ccc5cf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.153664 May 10 21:18:58.952643 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 957/1733] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:58 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:18:58.957168 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8b255b41-6b1c-45c5-8a06-407ca8cd20d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:58.958108 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8b255b41-6b1c-45c5-8a06-407ca8cd20d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:58.963803 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8b255b41-6b1c-45c5-8a06-407ca8cd20d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:58.964250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8b255b41-6b1c-45c5-8a06-407ca8cd20d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:58.965015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8b255b41-6b1c-45c5-8a06-407ca8cd20d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:58.965452 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8b255b41-6b1c-45c5-8a06-407ca8cd20d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:58.993943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8b255b41-6b1c-45c5-8a06-407ca8cd20d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040321 May 10 21:18:58.994546 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 958/1734] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:18:58 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:18:59.000351 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d3394d44-c1a8-4cbc-9c1f-caeb85d2344b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:59.001256 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d3394d44-c1a8-4cbc-9c1f-caeb85d2344b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:59.006809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d3394d44-c1a8-4cbc-9c1f-caeb85d2344b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:59.007302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d3394d44-c1a8-4cbc-9c1f-caeb85d2344b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:59.008069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d3394d44-c1a8-4cbc-9c1f-caeb85d2344b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:59.008504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d3394d44-c1a8-4cbc-9c1f-caeb85d2344b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:59.036212 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d3394d44-c1a8-4cbc-9c1f-caeb85d2344b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040708 May 10 21:18:59.036759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 959/1735] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:58 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:59.041124 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2432e51e-e677-4c19-81d4-30f76e8b878c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:59.042006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2432e51e-e677-4c19-81d4-30f76e8b878c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:59.048238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2432e51e-e677-4c19-81d4-30f76e8b878c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:59.048800 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2432e51e-e677-4c19-81d4-30f76e8b878c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:59.049607 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2432e51e-e677-4c19-81d4-30f76e8b878c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:59.050044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2432e51e-e677-4c19-81d4-30f76e8b878c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:59.079029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2432e51e-e677-4c19-81d4-30f76e8b878c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041294 May 10 21:18:59.079611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 960/1736] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:18:59 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:18:59.970147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-df9bef50-b31a-4ad9-81b2-c54cbe8fa3e7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:18:59.970829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-df9bef50-b31a-4ad9-81b2-c54cbe8fa3e7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:18:59.977066 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df9bef50-b31a-4ad9-81b2-c54cbe8fa3e7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:59.977512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df9bef50-b31a-4ad9-81b2-c54cbe8fa3e7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:18:59.978270 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df9bef50-b31a-4ad9-81b2-c54cbe8fa3e7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:18:59.978703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df9bef50-b31a-4ad9-81b2-c54cbe8fa3e7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:00.110635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-df9bef50-b31a-4ad9-81b2-c54cbe8fa3e7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:19:00.118241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-df9bef50-b31a-4ad9-81b2-c54cbe8fa3e7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.152765 May 10 21:19:00.118801 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 961/1737] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:18:59 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:19:00.123325 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3c7ee6d7-a1c7-450a-b34d-f9033ef55585 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:00.124309 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3c7ee6d7-a1c7-450a-b34d-f9033ef55585 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:00.129751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3c7ee6d7-a1c7-450a-b34d-f9033ef55585 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:00.130189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3c7ee6d7-a1c7-450a-b34d-f9033ef55585 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:00.130943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3c7ee6d7-a1c7-450a-b34d-f9033ef55585 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:00.131565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3c7ee6d7-a1c7-450a-b34d-f9033ef55585 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:00.160544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3c7ee6d7-a1c7-450a-b34d-f9033ef55585 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040704 May 10 21:19:00.161110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 962/1738] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:19:00 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:19:00.165591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b92fd827-fc91-478a-9acc-f6ed32db251c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:00.166488 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b92fd827-fc91-478a-9acc-f6ed32db251c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:00.172850 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b92fd827-fc91-478a-9acc-f6ed32db251c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:00.173304 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b92fd827-fc91-478a-9acc-f6ed32db251c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:00.174075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b92fd827-fc91-478a-9acc-f6ed32db251c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:00.174516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b92fd827-fc91-478a-9acc-f6ed32db251c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:00.202931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b92fd827-fc91-478a-9acc-f6ed32db251c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040834 May 10 21:19:00.203511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 963/1739] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:00 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:00.207938 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ec998ea9-7946-4e07-930f-6d41bf3d9254 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:00.208824 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ec998ea9-7946-4e07-930f-6d41bf3d9254 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:00.214189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec998ea9-7946-4e07-930f-6d41bf3d9254 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:00.214643 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec998ea9-7946-4e07-930f-6d41bf3d9254 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:00.215440 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec998ea9-7946-4e07-930f-6d41bf3d9254 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:00.215886 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec998ea9-7946-4e07-930f-6d41bf3d9254 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:00.245001 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ec998ea9-7946-4e07-930f-6d41bf3d9254 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040461 May 10 21:19:00.245487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 964/1740] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:00 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:01.135816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ebb8d343-8d53-4a2b-9cc1-e675208ec353 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:01.136972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ebb8d343-8d53-4a2b-9cc1-e675208ec353 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:01.143255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ebb8d343-8d53-4a2b-9cc1-e675208ec353 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:01.143705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ebb8d343-8d53-4a2b-9cc1-e675208ec353 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:01.144470 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ebb8d343-8d53-4a2b-9cc1-e675208ec353 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:01.144909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ebb8d343-8d53-4a2b-9cc1-e675208ec353 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:01.591372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ebb8d343-8d53-4a2b-9cc1-e675208ec353 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:19:01.599538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ebb8d343-8d53-4a2b-9cc1-e675208ec353 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.467636 May 10 21:19:01.600119 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 965/1741] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:19:01 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:19:01.605460 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f155c00d-8fc8-4619-b573-085021fd860d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:01.605951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f155c00d-8fc8-4619-b573-085021fd860d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:01.612946 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f155c00d-8fc8-4619-b573-085021fd860d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:01.613388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f155c00d-8fc8-4619-b573-085021fd860d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:01.614152 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f155c00d-8fc8-4619-b573-085021fd860d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:01.614584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f155c00d-8fc8-4619-b573-085021fd860d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:01.642796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f155c00d-8fc8-4619-b573-085021fd860d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041684 May 10 21:19:01.643380 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 966/1742] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:19:01 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:19:01.647740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cd8cd56f-d444-4421-923c-09dbc6206e28 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:01.648630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cd8cd56f-d444-4421-923c-09dbc6206e28 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:01.653978 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd8cd56f-d444-4421-923c-09dbc6206e28 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:01.654918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd8cd56f-d444-4421-923c-09dbc6206e28 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:01.655860 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd8cd56f-d444-4421-923c-09dbc6206e28 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:01.656295 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd8cd56f-d444-4421-923c-09dbc6206e28 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:01.684824 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cd8cd56f-d444-4421-923c-09dbc6206e28 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040481 May 10 21:19:01.685383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 967/1743] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:01 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:01.689800 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4af9e9c5-73c5-4ab0-bdfc-be8c025880fd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:01.690661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4af9e9c5-73c5-4ab0-bdfc-be8c025880fd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:01.696417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4af9e9c5-73c5-4ab0-bdfc-be8c025880fd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:01.696865 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4af9e9c5-73c5-4ab0-bdfc-be8c025880fd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:01.697623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4af9e9c5-73c5-4ab0-bdfc-be8c025880fd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:01.698082 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4af9e9c5-73c5-4ab0-bdfc-be8c025880fd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:01.726090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4af9e9c5-73c5-4ab0-bdfc-be8c025880fd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039706 May 10 21:19:01.726663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 968/1744] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:01 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:02.617009 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e036c648-7ff7-4c09-b586-09a2fa681a89 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:02.617623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e036c648-7ff7-4c09-b586-09a2fa681a89 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:02.624533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e036c648-7ff7-4c09-b586-09a2fa681a89 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:02.624975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e036c648-7ff7-4c09-b586-09a2fa681a89 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:02.625735 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e036c648-7ff7-4c09-b586-09a2fa681a89 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:02.626167 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e036c648-7ff7-4c09-b586-09a2fa681a89 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:02.756141 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e036c648-7ff7-4c09-b586-09a2fa681a89 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:19:02.763464 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e036c648-7ff7-4c09-b586-09a2fa681a89 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.150319 May 10 21:19:02.764093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 969/1745] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:19:02 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:19:02.768582 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-797db120-76f3-4992-a77e-1bc87573944e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:02.769495 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-797db120-76f3-4992-a77e-1bc87573944e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:02.774928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-797db120-76f3-4992-a77e-1bc87573944e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:02.775417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-797db120-76f3-4992-a77e-1bc87573944e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:02.776180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-797db120-76f3-4992-a77e-1bc87573944e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:02.776617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-797db120-76f3-4992-a77e-1bc87573944e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:02.805179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-797db120-76f3-4992-a77e-1bc87573944e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040093 May 10 21:19:02.805721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 970/1746] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:19:02 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:19:02.810091 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-85970d21-5827-4253-aba6-599e0824a433 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:02.812036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-85970d21-5827-4253-aba6-599e0824a433 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:02.819538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-85970d21-5827-4253-aba6-599e0824a433 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:02.819980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-85970d21-5827-4253-aba6-599e0824a433 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:02.821864 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-85970d21-5827-4253-aba6-599e0824a433 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:02.822310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-85970d21-5827-4253-aba6-599e0824a433 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:02.854795 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-85970d21-5827-4253-aba6-599e0824a433 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048071 May 10 21:19:02.855381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 971/1747] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:02 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:02.922784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4be72483-b29c-4486-b89c-66bce0d79765 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:02.923752 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4be72483-b29c-4486-b89c-66bce0d79765 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:02.929633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4be72483-b29c-4486-b89c-66bce0d79765 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:02.930081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4be72483-b29c-4486-b89c-66bce0d79765 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:02.930849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4be72483-b29c-4486-b89c-66bce0d79765 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:02.931322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4be72483-b29c-4486-b89c-66bce0d79765 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:02.960213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4be72483-b29c-4486-b89c-66bce0d79765 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103862 May 10 21:19:02.960765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 972/1748] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:02 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:03.781530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-19ee023b-9eb2-4faa-8fe4-8eb2e5093062 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:03.782206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-19ee023b-9eb2-4faa-8fe4-8eb2e5093062 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:03.788590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-19ee023b-9eb2-4faa-8fe4-8eb2e5093062 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:03.789089 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-19ee023b-9eb2-4faa-8fe4-8eb2e5093062 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:03.789881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-19ee023b-9eb2-4faa-8fe4-8eb2e5093062 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:03.790326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-19ee023b-9eb2-4faa-8fe4-8eb2e5093062 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:03.920671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-19ee023b-9eb2-4faa-8fe4-8eb2e5093062 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:19:03.928067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-19ee023b-9eb2-4faa-8fe4-8eb2e5093062 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151112 May 10 21:19:03.935162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 973/1749] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:19:03 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:19:03.935162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-871fc2a6-f996-49eb-8b08-da60e2810027 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:03.935162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-871fc2a6-f996-49eb-8b08-da60e2810027 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:03.940441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-871fc2a6-f996-49eb-8b08-da60e2810027 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:03.940886 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-871fc2a6-f996-49eb-8b08-da60e2810027 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:03.941649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-871fc2a6-f996-49eb-8b08-da60e2810027 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:03.942084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-871fc2a6-f996-49eb-8b08-da60e2810027 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:03.971241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-871fc2a6-f996-49eb-8b08-da60e2810027 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041554 May 10 21:19:03.971792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 974/1750] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:19:03 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:19:03.976351 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bd7b77f5-56b4-4c3e-9d7c-0f649f38e616 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:03.977261 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bd7b77f5-56b4-4c3e-9d7c-0f649f38e616 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:03.983286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bd7b77f5-56b4-4c3e-9d7c-0f649f38e616 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:03.983672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bd7b77f5-56b4-4c3e-9d7c-0f649f38e616 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:03.984442 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bd7b77f5-56b4-4c3e-9d7c-0f649f38e616 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:03.984875 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bd7b77f5-56b4-4c3e-9d7c-0f649f38e616 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:04.013702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bd7b77f5-56b4-4c3e-9d7c-0f649f38e616 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040804 May 10 21:19:04.014865 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 975/1751] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:03 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:04.019831 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e52c3f8a-c4a5-4118-b3ee-687cbd81027f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:04.020735 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e52c3f8a-c4a5-4118-b3ee-687cbd81027f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:04.026228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e52c3f8a-c4a5-4118-b3ee-687cbd81027f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:04.026820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e52c3f8a-c4a5-4118-b3ee-687cbd81027f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:04.027490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e52c3f8a-c4a5-4118-b3ee-687cbd81027f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:04.027917 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e52c3f8a-c4a5-4118-b3ee-687cbd81027f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:04.056684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e52c3f8a-c4a5-4118-b3ee-687cbd81027f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040763 May 10 21:19:04.057245 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 976/1752] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:04 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:04.946204 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5675ffa9-5fa6-4507-b727-ad6503aa2649 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:04.946850 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5675ffa9-5fa6-4507-b727-ad6503aa2649 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:04.953895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5675ffa9-5fa6-4507-b727-ad6503aa2649 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:04.954347 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5675ffa9-5fa6-4507-b727-ad6503aa2649 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:04.955131 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5675ffa9-5fa6-4507-b727-ad6503aa2649 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:04.955582 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5675ffa9-5fa6-4507-b727-ad6503aa2649 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:05.085571 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5675ffa9-5fa6-4507-b727-ad6503aa2649 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:19:05.093492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5675ffa9-5fa6-4507-b727-ad6503aa2649 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151530 May 10 21:19:05.094051 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 977/1753] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:19:04 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:19:05.098511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-18b2bba9-5d6a-4788-8105-964a8d96ad29 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:05.099449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-18b2bba9-5d6a-4788-8105-964a8d96ad29 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:05.105034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-18b2bba9-5d6a-4788-8105-964a8d96ad29 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:05.105479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-18b2bba9-5d6a-4788-8105-964a8d96ad29 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:05.106239 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-18b2bba9-5d6a-4788-8105-964a8d96ad29 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:05.106671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-18b2bba9-5d6a-4788-8105-964a8d96ad29 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:05.134357 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-18b2bba9-5d6a-4788-8105-964a8d96ad29 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039330 May 10 21:19:05.134902 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 978/1754] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:19:05 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:19:05.139845 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-44f25b42-947b-47a2-8fca-26ff81b5deb7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:05.140725 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-44f25b42-947b-47a2-8fca-26ff81b5deb7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:05.146178 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44f25b42-947b-47a2-8fca-26ff81b5deb7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:05.146623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44f25b42-947b-47a2-8fca-26ff81b5deb7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:05.147410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44f25b42-947b-47a2-8fca-26ff81b5deb7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:05.147844 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44f25b42-947b-47a2-8fca-26ff81b5deb7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:05.175729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-44f25b42-947b-47a2-8fca-26ff81b5deb7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039838 May 10 21:19:05.176284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 979/1755] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:05 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:05.180609 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bbcfd4e1-9165-416b-875e-08896f0bcf46 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:05.181487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bbcfd4e1-9165-416b-875e-08896f0bcf46 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:05.186908 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bbcfd4e1-9165-416b-875e-08896f0bcf46 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:05.187392 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bbcfd4e1-9165-416b-875e-08896f0bcf46 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:05.188144 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bbcfd4e1-9165-416b-875e-08896f0bcf46 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:05.188576 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bbcfd4e1-9165-416b-875e-08896f0bcf46 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:05.216457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bbcfd4e1-9165-416b-875e-08896f0bcf46 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039181 May 10 21:19:05.217525 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 980/1756] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:05 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:06.111432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c62a9ff5-4cdf-4142-94b1-0f78782f3fa2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:06.112126 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c62a9ff5-4cdf-4142-94b1-0f78782f3fa2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:06.118766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c62a9ff5-4cdf-4142-94b1-0f78782f3fa2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:06.119247 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c62a9ff5-4cdf-4142-94b1-0f78782f3fa2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:06.120021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c62a9ff5-4cdf-4142-94b1-0f78782f3fa2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:06.120452 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c62a9ff5-4cdf-4142-94b1-0f78782f3fa2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:06.254303 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c62a9ff5-4cdf-4142-94b1-0f78782f3fa2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:19:06.262009 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c62a9ff5-4cdf-4142-94b1-0f78782f3fa2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.154525 May 10 21:19:06.262587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 981/1757] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:19:06 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:19:06.268160 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2f845354-8328-4c1a-8a79-13752af256c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:06.273701 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2f845354-8328-4c1a-8a79-13752af256c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:06.274819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2f845354-8328-4c1a-8a79-13752af256c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:06.275304 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2f845354-8328-4c1a-8a79-13752af256c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:06.276182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2f845354-8328-4c1a-8a79-13752af256c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:06.276620 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2f845354-8328-4c1a-8a79-13752af256c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:06.305372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2f845354-8328-4c1a-8a79-13752af256c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041794 May 10 21:19:06.305918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 982/1758] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:19:06 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:19:06.311221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e1ff52ec-50b4-4fc3-b896-ea9ca5d761cc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:06.312109 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e1ff52ec-50b4-4fc3-b896-ea9ca5d761cc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:06.317719 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e1ff52ec-50b4-4fc3-b896-ea9ca5d761cc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:06.319255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e1ff52ec-50b4-4fc3-b896-ea9ca5d761cc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:06.319255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e1ff52ec-50b4-4fc3-b896-ea9ca5d761cc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:06.319528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e1ff52ec-50b4-4fc3-b896-ea9ca5d761cc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:06.349058 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e1ff52ec-50b4-4fc3-b896-ea9ca5d761cc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041781 May 10 21:19:06.349599 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 983/1759] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:06 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:06.354689 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-663d55e0-a314-4290-afa4-e23519ac18e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:06.355350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-663d55e0-a314-4290-afa4-e23519ac18e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:06.361138 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-663d55e0-a314-4290-afa4-e23519ac18e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:06.361636 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-663d55e0-a314-4290-afa4-e23519ac18e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:06.362350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-663d55e0-a314-4290-afa4-e23519ac18e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:06.362782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-663d55e0-a314-4290-afa4-e23519ac18e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:06.391453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-663d55e0-a314-4290-afa4-e23519ac18e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040699 May 10 21:19:06.391991 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 984/1760] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:06 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:07.280985 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-be6deaa6-ce06-4fde-b8d1-b36e2f4a9d57 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:07.281656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-be6deaa6-ce06-4fde-b8d1-b36e2f4a9d57 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:07.288264 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be6deaa6-ce06-4fde-b8d1-b36e2f4a9d57 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:07.288728 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be6deaa6-ce06-4fde-b8d1-b36e2f4a9d57 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:07.289472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be6deaa6-ce06-4fde-b8d1-b36e2f4a9d57 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:07.289907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be6deaa6-ce06-4fde-b8d1-b36e2f4a9d57 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:07.416558 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-be6deaa6-ce06-4fde-b8d1-b36e2f4a9d57 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:19:07.423867 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-be6deaa6-ce06-4fde-b8d1-b36e2f4a9d57 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.147804 May 10 21:19:07.424428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 985/1761] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:19:07 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:19:07.429280 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-909afb33-c4c8-4c10-925f-2cde505d531c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:07.430175 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-909afb33-c4c8-4c10-925f-2cde505d531c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:07.435934 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-909afb33-c4c8-4c10-925f-2cde505d531c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:07.436517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-909afb33-c4c8-4c10-925f-2cde505d531c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:07.437278 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-909afb33-c4c8-4c10-925f-2cde505d531c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:07.437708 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-909afb33-c4c8-4c10-925f-2cde505d531c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:07.466202 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-909afb33-c4c8-4c10-925f-2cde505d531c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040710 May 10 21:19:07.466747 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 986/1762] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:19:07 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:19:07.471851 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4694402b-ccdc-428f-9c67-d6b6907d720b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:07.472731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4694402b-ccdc-428f-9c67-d6b6907d720b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:07.478081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4694402b-ccdc-428f-9c67-d6b6907d720b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:07.478524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4694402b-ccdc-428f-9c67-d6b6907d720b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:07.479303 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4694402b-ccdc-428f-9c67-d6b6907d720b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:07.479736 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4694402b-ccdc-428f-9c67-d6b6907d720b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:07.507849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4694402b-ccdc-428f-9c67-d6b6907d720b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039488 May 10 21:19:07.508388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 987/1763] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:07 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:07.512817 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cd7080f2-fb46-4a12-bf3e-b3bb515f8b47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:07.513687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cd7080f2-fb46-4a12-bf3e-b3bb515f8b47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:07.519554 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd7080f2-fb46-4a12-bf3e-b3bb515f8b47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:07.520000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd7080f2-fb46-4a12-bf3e-b3bb515f8b47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:07.520748 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd7080f2-fb46-4a12-bf3e-b3bb515f8b47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:07.521181 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd7080f2-fb46-4a12-bf3e-b3bb515f8b47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:07.549076 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cd7080f2-fb46-4a12-bf3e-b3bb515f8b47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039696 May 10 21:19:07.549561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 988/1764] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:07 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:08.440990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7aaee3db-db33-4389-88a2-6832455950ae tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:08.441608 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7aaee3db-db33-4389-88a2-6832455950ae tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:08.448221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7aaee3db-db33-4389-88a2-6832455950ae tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:08.448666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7aaee3db-db33-4389-88a2-6832455950ae tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:08.449421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7aaee3db-db33-4389-88a2-6832455950ae tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:08.449851 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7aaee3db-db33-4389-88a2-6832455950ae tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:08.581515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7aaee3db-db33-4389-88a2-6832455950ae tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:19:08.588957 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7aaee3db-db33-4389-88a2-6832455950ae tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151870 May 10 21:19:08.589560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 989/1765] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:19:08 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:19:08.594701 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-affb41a0-4f36-45b3-bc39-569db6a926ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:08.595648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-affb41a0-4f36-45b3-bc39-569db6a926ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:08.601307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-affb41a0-4f36-45b3-bc39-569db6a926ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:08.601757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-affb41a0-4f36-45b3-bc39-569db6a926ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:08.602541 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-affb41a0-4f36-45b3-bc39-569db6a926ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:08.602989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-affb41a0-4f36-45b3-bc39-569db6a926ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:08.632711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-affb41a0-4f36-45b3-bc39-569db6a926ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042132 May 10 21:19:08.633267 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 990/1766] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:19:08 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:19:08.637687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-be1984b3-4c44-4c0b-a0e2-5ef340916a6b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:08.638587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-be1984b3-4c44-4c0b-a0e2-5ef340916a6b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:08.644661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be1984b3-4c44-4c0b-a0e2-5ef340916a6b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:08.645114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be1984b3-4c44-4c0b-a0e2-5ef340916a6b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:08.645874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be1984b3-4c44-4c0b-a0e2-5ef340916a6b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:08.646315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be1984b3-4c44-4c0b-a0e2-5ef340916a6b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:08.676117 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-be1984b3-4c44-4c0b-a0e2-5ef340916a6b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041863 May 10 21:19:08.676666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 991/1767] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:08 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:08.681060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-42cc303a-3da1-4ffb-b060-16ad075a7655 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:08.681951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-42cc303a-3da1-4ffb-b060-16ad075a7655 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:08.687280 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-42cc303a-3da1-4ffb-b060-16ad075a7655 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:08.687733 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-42cc303a-3da1-4ffb-b060-16ad075a7655 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:08.688497 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-42cc303a-3da1-4ffb-b060-16ad075a7655 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:08.688939 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-42cc303a-3da1-4ffb-b060-16ad075a7655 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:08.718021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-42cc303a-3da1-4ffb-b060-16ad075a7655 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040370 May 10 21:19:08.718561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 992/1768] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:08 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:09.607238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-15f6f7fc-6ede-4261-83d9-ede2e2f20e2d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:09.609538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-15f6f7fc-6ede-4261-83d9-ede2e2f20e2d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:09.615658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-15f6f7fc-6ede-4261-83d9-ede2e2f20e2d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:09.616111 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-15f6f7fc-6ede-4261-83d9-ede2e2f20e2d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:09.616885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-15f6f7fc-6ede-4261-83d9-ede2e2f20e2d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:09.617325 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-15f6f7fc-6ede-4261-83d9-ede2e2f20e2d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:09.746044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-15f6f7fc-6ede-4261-83d9-ede2e2f20e2d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:19:09.754394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-15f6f7fc-6ede-4261-83d9-ede2e2f20e2d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151350 May 10 21:19:09.755014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 993/1769] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:19:09 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:19:09.759881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-71820916-8c25-4c5b-8a40-f34fe56abfa9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:09.760785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-71820916-8c25-4c5b-8a40-f34fe56abfa9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:09.767446 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71820916-8c25-4c5b-8a40-f34fe56abfa9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:09.767900 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71820916-8c25-4c5b-8a40-f34fe56abfa9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:09.768675 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71820916-8c25-4c5b-8a40-f34fe56abfa9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:09.769119 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71820916-8c25-4c5b-8a40-f34fe56abfa9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:09.798911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-71820916-8c25-4c5b-8a40-f34fe56abfa9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042811 May 10 21:19:09.799491 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 994/1770] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:19:09 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:19:09.803899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7de9145a-f0c9-47ce-9026-a1eee0989877 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:09.804796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7de9145a-f0c9-47ce-9026-a1eee0989877 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:09.810417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7de9145a-f0c9-47ce-9026-a1eee0989877 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:09.811450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7de9145a-f0c9-47ce-9026-a1eee0989877 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:09.812227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7de9145a-f0c9-47ce-9026-a1eee0989877 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:09.812671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7de9145a-f0c9-47ce-9026-a1eee0989877 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:09.841310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7de9145a-f0c9-47ce-9026-a1eee0989877 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040846 May 10 21:19:09.842374 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 995/1771] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:09 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:09.846856 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d862e24e-db93-40fa-8eb2-b2baa08f5e42 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:09.847785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d862e24e-db93-40fa-8eb2-b2baa08f5e42 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:09.853191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d862e24e-db93-40fa-8eb2-b2baa08f5e42 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:09.853642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d862e24e-db93-40fa-8eb2-b2baa08f5e42 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:09.854402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d862e24e-db93-40fa-8eb2-b2baa08f5e42 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:09.854847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d862e24e-db93-40fa-8eb2-b2baa08f5e42 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:09.883343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d862e24e-db93-40fa-8eb2-b2baa08f5e42 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039839 May 10 21:19:09.883824 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 996/1772] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:09 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:10.771812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-06ad16ad-78d9-43fd-98d0-c2537991ed84 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:10.772482 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-06ad16ad-78d9-43fd-98d0-c2537991ed84 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:10.778696 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-06ad16ad-78d9-43fd-98d0-c2537991ed84 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:10.779197 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-06ad16ad-78d9-43fd-98d0-c2537991ed84 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:10.780302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-06ad16ad-78d9-43fd-98d0-c2537991ed84 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:10.780947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-06ad16ad-78d9-43fd-98d0-c2537991ed84 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:10.911606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-06ad16ad-78d9-43fd-98d0-c2537991ed84 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:19:10.918935 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-06ad16ad-78d9-43fd-98d0-c2537991ed84 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151048 May 10 21:19:10.919531 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 997/1773] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:19:10 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:19:10.924592 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1102ed15-1123-4fc9-b728-24c7b6bfa522 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:10.925500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1102ed15-1123-4fc9-b728-24c7b6bfa522 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:10.930963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1102ed15-1123-4fc9-b728-24c7b6bfa522 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:10.931444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1102ed15-1123-4fc9-b728-24c7b6bfa522 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:10.932213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1102ed15-1123-4fc9-b728-24c7b6bfa522 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:10.932654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1102ed15-1123-4fc9-b728-24c7b6bfa522 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:10.961629 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1102ed15-1123-4fc9-b728-24c7b6bfa522 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040562 May 10 21:19:10.962188 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 998/1774] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:19:10 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:19:10.966538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-210fd1b7-99b2-49d6-be6c-24eb97d3721b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:10.967700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-210fd1b7-99b2-49d6-be6c-24eb97d3721b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:10.973217 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-210fd1b7-99b2-49d6-be6c-24eb97d3721b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:10.973706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-210fd1b7-99b2-49d6-be6c-24eb97d3721b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:10.974498 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-210fd1b7-99b2-49d6-be6c-24eb97d3721b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:10.974935 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-210fd1b7-99b2-49d6-be6c-24eb97d3721b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:11.003705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-210fd1b7-99b2-49d6-be6c-24eb97d3721b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040557 May 10 21:19:11.004253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 999/1775] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:10 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:11.008629 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2e218f0a-917c-4b6c-bd9a-0c7ec5e3c99a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:11.009519 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2e218f0a-917c-4b6c-bd9a-0c7ec5e3c99a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:11.015517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e218f0a-917c-4b6c-bd9a-0c7ec5e3c99a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:11.015967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e218f0a-917c-4b6c-bd9a-0c7ec5e3c99a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:11.016733 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e218f0a-917c-4b6c-bd9a-0c7ec5e3c99a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:11.017172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e218f0a-917c-4b6c-bd9a-0c7ec5e3c99a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:11.045268 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2e218f0a-917c-4b6c-bd9a-0c7ec5e3c99a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039968 May 10 21:19:11.045808 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1000/1776] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:11 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:11.937663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2e1192de-6182-4fc5-9b66-e71b6835941c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:11.938311 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2e1192de-6182-4fc5-9b66-e71b6835941c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:11.944618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e1192de-6182-4fc5-9b66-e71b6835941c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:11.945078 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e1192de-6182-4fc5-9b66-e71b6835941c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:11.945843 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e1192de-6182-4fc5-9b66-e71b6835941c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:11.946535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e1192de-6182-4fc5-9b66-e71b6835941c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:12.079964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2e1192de-6182-4fc5-9b66-e71b6835941c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:19:12.087247 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2e1192de-6182-4fc5-9b66-e71b6835941c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.154311 May 10 21:19:12.087817 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1001/1777] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:19:11 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:19:12.092362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f72ccc40-faf6-484b-abf0-531643f5f126 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:12.093299 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f72ccc40-faf6-484b-abf0-531643f5f126 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:12.098710 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f72ccc40-faf6-484b-abf0-531643f5f126 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:12.099179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f72ccc40-faf6-484b-abf0-531643f5f126 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:12.099948 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f72ccc40-faf6-484b-abf0-531643f5f126 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:12.100387 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f72ccc40-faf6-484b-abf0-531643f5f126 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:12.128971 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f72ccc40-faf6-484b-abf0-531643f5f126 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040162 May 10 21:19:12.129505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1002/1778] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:19:12 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:19:12.133946 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-92960f79-c369-4c39-88b3-21b59e6fbe11 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:12.134829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-92960f79-c369-4c39-88b3-21b59e6fbe11 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:12.142744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-92960f79-c369-4c39-88b3-21b59e6fbe11 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:12.143228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-92960f79-c369-4c39-88b3-21b59e6fbe11 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:12.144000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-92960f79-c369-4c39-88b3-21b59e6fbe11 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:12.144435 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-92960f79-c369-4c39-88b3-21b59e6fbe11 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:12.172504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-92960f79-c369-4c39-88b3-21b59e6fbe11 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042042 May 10 21:19:12.173049 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1003/1779] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:12 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:12.177429 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c5d85a05-e3df-4ec6-ab4d-5899164760bb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:12.178320 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c5d85a05-e3df-4ec6-ab4d-5899164760bb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:12.183701 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5d85a05-e3df-4ec6-ab4d-5899164760bb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:12.184148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5d85a05-e3df-4ec6-ab4d-5899164760bb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:12.184906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5d85a05-e3df-4ec6-ab4d-5899164760bb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:12.185342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5d85a05-e3df-4ec6-ab4d-5899164760bb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:12.214416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c5d85a05-e3df-4ec6-ab4d-5899164760bb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040336 May 10 21:19:12.214903 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1004/1780] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:12 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:13.104619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-97c0c605-fb4a-4043-9465-f6b9ba1f460c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:13.105266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-97c0c605-fb4a-4043-9465-f6b9ba1f460c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:13.112397 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-97c0c605-fb4a-4043-9465-f6b9ba1f460c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:13.112850 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-97c0c605-fb4a-4043-9465-f6b9ba1f460c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:13.113618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-97c0c605-fb4a-4043-9465-f6b9ba1f460c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:13.114059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-97c0c605-fb4a-4043-9465-f6b9ba1f460c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:13.243783 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-97c0c605-fb4a-4043-9465-f6b9ba1f460c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:19:13.251191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-97c0c605-fb4a-4043-9465-f6b9ba1f460c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.150443 May 10 21:19:13.251754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1005/1781] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:19:13 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:19:13.256297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d365a31c-5c3a-4e84-94ff-e02c0da694eb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:13.257195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d365a31c-5c3a-4e84-94ff-e02c0da694eb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:13.262601 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d365a31c-5c3a-4e84-94ff-e02c0da694eb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:13.263053 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d365a31c-5c3a-4e84-94ff-e02c0da694eb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:13.264423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d365a31c-5c3a-4e84-94ff-e02c0da694eb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:13.264882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d365a31c-5c3a-4e84-94ff-e02c0da694eb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:13.293168 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d365a31c-5c3a-4e84-94ff-e02c0da694eb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040438 May 10 21:19:13.293717 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1006/1782] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:19:13 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:19:13.298144 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e290242c-06e7-427f-8c53-0d9e21f8971b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:13.299027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e290242c-06e7-427f-8c53-0d9e21f8971b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:13.304400 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e290242c-06e7-427f-8c53-0d9e21f8971b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:13.304846 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e290242c-06e7-427f-8c53-0d9e21f8971b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:13.305599 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e290242c-06e7-427f-8c53-0d9e21f8971b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:13.306034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e290242c-06e7-427f-8c53-0d9e21f8971b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:13.334181 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e290242c-06e7-427f-8c53-0d9e21f8971b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039520 May 10 21:19:13.334725 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1007/1783] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:13 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:13.339040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-697ef4f8-abd8-4df1-9b14-859965891aed tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:13.339941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-697ef4f8-abd8-4df1-9b14-859965891aed tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:13.345856 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-697ef4f8-abd8-4df1-9b14-859965891aed tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:13.346303 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-697ef4f8-abd8-4df1-9b14-859965891aed tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:13.347087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-697ef4f8-abd8-4df1-9b14-859965891aed tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:13.347551 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-697ef4f8-abd8-4df1-9b14-859965891aed tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:13.375638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-697ef4f8-abd8-4df1-9b14-859965891aed tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039803 May 10 21:19:13.376117 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1008/1784] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:13 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:14.269224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1992f1c7-3ae7-457b-bb86-dfcf16ad61a5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:14.269877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1992f1c7-3ae7-457b-bb86-dfcf16ad61a5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:14.275974 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1992f1c7-3ae7-457b-bb86-dfcf16ad61a5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:14.276432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1992f1c7-3ae7-457b-bb86-dfcf16ad61a5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:14.277200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1992f1c7-3ae7-457b-bb86-dfcf16ad61a5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:14.277643 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1992f1c7-3ae7-457b-bb86-dfcf16ad61a5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:14.409304 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1992f1c7-3ae7-457b-bb86-dfcf16ad61a5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:19:14.416873 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1992f1c7-3ae7-457b-bb86-dfcf16ad61a5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.151697 May 10 21:19:14.417439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1009/1785] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:19:14 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:19:14.422578 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-de0fdc55-94e9-4af6-bf4a-f87c83d44e53 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:14.423514 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-de0fdc55-94e9-4af6-bf4a-f87c83d44e53 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:14.429148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de0fdc55-94e9-4af6-bf4a-f87c83d44e53 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:14.429609 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de0fdc55-94e9-4af6-bf4a-f87c83d44e53 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:14.430385 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de0fdc55-94e9-4af6-bf4a-f87c83d44e53 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:14.430828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de0fdc55-94e9-4af6-bf4a-f87c83d44e53 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:14.459845 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-de0fdc55-94e9-4af6-bf4a-f87c83d44e53 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041389 May 10 21:19:14.460401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1010/1786] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:19:14 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:19:14.464846 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-597d8917-5d96-4ea6-b311-a763c8f22026 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:14.465769 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-597d8917-5d96-4ea6-b311-a763c8f22026 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:14.471753 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-597d8917-5d96-4ea6-b311-a763c8f22026 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:14.472208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-597d8917-5d96-4ea6-b311-a763c8f22026 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:14.472973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-597d8917-5d96-4ea6-b311-a763c8f22026 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:14.473416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-597d8917-5d96-4ea6-b311-a763c8f22026 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:14.502345 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-597d8917-5d96-4ea6-b311-a763c8f22026 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040938 May 10 21:19:14.502905 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1011/1787] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:14 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:14.507458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-38f90d65-2546-41fa-9b4e-b2ff15dc2722 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:14.508382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-38f90d65-2546-41fa-9b4e-b2ff15dc2722 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:14.514296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38f90d65-2546-41fa-9b4e-b2ff15dc2722 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:14.514748 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38f90d65-2546-41fa-9b4e-b2ff15dc2722 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:14.515564 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38f90d65-2546-41fa-9b4e-b2ff15dc2722 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:14.516096 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38f90d65-2546-41fa-9b4e-b2ff15dc2722 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:14.550100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-38f90d65-2546-41fa-9b4e-b2ff15dc2722 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045886 May 10 21:19:14.550850 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1012/1788] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:14 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:15.434964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cecf42a9-efb2-4763-969c-ed6386ab3817 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:15.436805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cecf42a9-efb2-4763-969c-ed6386ab3817 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:15.444205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cecf42a9-efb2-4763-969c-ed6386ab3817 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:15.444661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cecf42a9-efb2-4763-969c-ed6386ab3817 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:15.445452 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cecf42a9-efb2-4763-969c-ed6386ab3817 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:15.445892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cecf42a9-efb2-4763-969c-ed6386ab3817 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:15.583034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cecf42a9-efb2-4763-969c-ed6386ab3817 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:19:15.591451 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cecf42a9-efb2-4763-969c-ed6386ab3817 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.161186 May 10 21:19:15.592031 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1013/1789] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:19:15 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:19:15.665787 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1096a244-3f6e-4182-a441-d4f4a8e28e9c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:15.666695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1096a244-3f6e-4182-a441-d4f4a8e28e9c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:15.674038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1096a244-3f6e-4182-a441-d4f4a8e28e9c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:15.674486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1096a244-3f6e-4182-a441-d4f4a8e28e9c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:15.675288 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1096a244-3f6e-4182-a441-d4f4a8e28e9c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:15.675724 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1096a244-3f6e-4182-a441-d4f4a8e28e9c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:15.705758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1096a244-3f6e-4182-a441-d4f4a8e28e9c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.112503 May 10 21:19:15.706235 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1014/1790] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:19:15 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:19:15.710733 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dcca3a1f-a91f-4351-8f6b-51fa918bbf78 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:15.711668 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dcca3a1f-a91f-4351-8f6b-51fa918bbf78 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:15.717948 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dcca3a1f-a91f-4351-8f6b-51fa918bbf78 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:15.718672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dcca3a1f-a91f-4351-8f6b-51fa918bbf78 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:15.719795 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dcca3a1f-a91f-4351-8f6b-51fa918bbf78 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:15.720273 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dcca3a1f-a91f-4351-8f6b-51fa918bbf78 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:15.752014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dcca3a1f-a91f-4351-8f6b-51fa918bbf78 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044743 May 10 21:19:15.752579 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1015/1791] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:15 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:15.757128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-14fdce1c-c770-4971-a5f3-d4502d6943fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:15.758043 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-14fdce1c-c770-4971-a5f3-d4502d6943fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:15.764368 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-14fdce1c-c770-4971-a5f3-d4502d6943fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:15.764814 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-14fdce1c-c770-4971-a5f3-d4502d6943fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:15.765576 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-14fdce1c-c770-4971-a5f3-d4502d6943fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:15.766013 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-14fdce1c-c770-4971-a5f3-d4502d6943fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:15.797566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-14fdce1c-c770-4971-a5f3-d4502d6943fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043952 May 10 21:19:15.798123 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1016/1792] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:15 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:16.610399 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-aaed57a4-4954-4f5e-8ec8-6736aec6d1e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:16.611005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-aaed57a4-4954-4f5e-8ec8-6736aec6d1e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:16.617469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aaed57a4-4954-4f5e-8ec8-6736aec6d1e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:16.617920 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aaed57a4-4954-4f5e-8ec8-6736aec6d1e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:16.618689 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aaed57a4-4954-4f5e-8ec8-6736aec6d1e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:16.619147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aaed57a4-4954-4f5e-8ec8-6736aec6d1e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:16.750808 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-aaed57a4-4954-4f5e-8ec8-6736aec6d1e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:19:16.758189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-aaed57a4-4954-4f5e-8ec8-6736aec6d1e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.152346 May 10 21:19:16.758744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1017/1793] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:19:16 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:19:16.763284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1bedaa40-2e3d-40fc-bd05-b02936dd6d5c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:16.764833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1bedaa40-2e3d-40fc-bd05-b02936dd6d5c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:16.770370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1bedaa40-2e3d-40fc-bd05-b02936dd6d5c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:16.770833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1bedaa40-2e3d-40fc-bd05-b02936dd6d5c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:16.771619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1bedaa40-2e3d-40fc-bd05-b02936dd6d5c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:16.772050 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1bedaa40-2e3d-40fc-bd05-b02936dd6d5c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:16.799650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1bedaa40-2e3d-40fc-bd05-b02936dd6d5c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039901 May 10 21:19:16.800233 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1018/1794] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:19:16 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:19:16.804658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9eb5ef86-f349-4087-a6e2-424d24f38013 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:16.805551 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9eb5ef86-f349-4087-a6e2-424d24f38013 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:16.811746 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9eb5ef86-f349-4087-a6e2-424d24f38013 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:16.812196 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9eb5ef86-f349-4087-a6e2-424d24f38013 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:16.812951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9eb5ef86-f349-4087-a6e2-424d24f38013 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:16.813387 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9eb5ef86-f349-4087-a6e2-424d24f38013 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:16.841459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9eb5ef86-f349-4087-a6e2-424d24f38013 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040281 May 10 21:19:16.842697 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1019/1795] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:16 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:16.847050 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-701d2b93-0a43-45c2-822b-64d13de1ae18 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:16.847953 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-701d2b93-0a43-45c2-822b-64d13de1ae18 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:16.853229 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-701d2b93-0a43-45c2-822b-64d13de1ae18 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:16.853700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-701d2b93-0a43-45c2-822b-64d13de1ae18 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:16.854457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-701d2b93-0a43-45c2-822b-64d13de1ae18 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:16.854890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-701d2b93-0a43-45c2-822b-64d13de1ae18 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:16.883403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-701d2b93-0a43-45c2-822b-64d13de1ae18 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039616 May 10 21:19:16.883878 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1020/1796] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:16 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:17.775786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-da4bc33c-2d07-4f05-9e31-19ad72c41f95 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:17.776407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-da4bc33c-2d07-4f05-9e31-19ad72c41f95 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:17.782840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-da4bc33c-2d07-4f05-9e31-19ad72c41f95 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:17.783334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-da4bc33c-2d07-4f05-9e31-19ad72c41f95 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:17.784114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-da4bc33c-2d07-4f05-9e31-19ad72c41f95 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:17.784553 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-da4bc33c-2d07-4f05-9e31-19ad72c41f95 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:17.920848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-da4bc33c-2d07-4f05-9e31-19ad72c41f95 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:19:17.928251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-da4bc33c-2d07-4f05-9e31-19ad72c41f95 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.156348 May 10 21:19:17.928814 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1021/1797] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:19:17 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:19:17.933626 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2ba1e6d7-09e3-4353-b91b-84fda8936632 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:17.934532 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2ba1e6d7-09e3-4353-b91b-84fda8936632 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:17.940965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ba1e6d7-09e3-4353-b91b-84fda8936632 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:17.941409 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ba1e6d7-09e3-4353-b91b-84fda8936632 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:17.942169 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ba1e6d7-09e3-4353-b91b-84fda8936632 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:17.942631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ba1e6d7-09e3-4353-b91b-84fda8936632 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:17.970641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2ba1e6d7-09e3-4353-b91b-84fda8936632 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040852 May 10 21:19:17.971198 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1022/1798] 10.222.0.49 () {60 vars in 1342 bytes} [Tue May 10 21:19:17 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:19:17.975566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-85dc828c-4cc1-492b-87f3-44799fc6e78f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:17.976441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-85dc828c-4cc1-492b-87f3-44799fc6e78f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:17.981782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-85dc828c-4cc1-492b-87f3-44799fc6e78f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:17.982224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-85dc828c-4cc1-492b-87f3-44799fc6e78f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:17.983500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-85dc828c-4cc1-492b-87f3-44799fc6e78f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:17.983930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-85dc828c-4cc1-492b-87f3-44799fc6e78f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:18.011802 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-85dc828c-4cc1-492b-87f3-44799fc6e78f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039665 May 10 21:19:18.012338 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1023/1799] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:17 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:18.016716 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0b00bacc-61d6-4880-bf7f-b7817dee1a8e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:18.017617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0b00bacc-61d6-4880-bf7f-b7817dee1a8e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:18.022962 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0b00bacc-61d6-4880-bf7f-b7817dee1a8e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:18.023440 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0b00bacc-61d6-4880-bf7f-b7817dee1a8e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:18.024191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0b00bacc-61d6-4880-bf7f-b7817dee1a8e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:18.024624 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0b00bacc-61d6-4880-bf7f-b7817dee1a8e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:18.052727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0b00bacc-61d6-4880-bf7f-b7817dee1a8e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039452 May 10 21:19:18.053263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1024/1800] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:18 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:18.945829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bdad2fd6-8374-4600-b85f-303d0e38da1c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:18.946785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bdad2fd6-8374-4600-b85f-303d0e38da1c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:18.953703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bdad2fd6-8374-4600-b85f-303d0e38da1c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:18.954146 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bdad2fd6-8374-4600-b85f-303d0e38da1c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:18.954902 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bdad2fd6-8374-4600-b85f-303d0e38da1c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:18.955361 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bdad2fd6-8374-4600-b85f-303d0e38da1c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:19.082873 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bdad2fd6-8374-4600-b85f-303d0e38da1c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:19:19.090162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bdad2fd6-8374-4600-b85f-303d0e38da1c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.148149 May 10 21:19:19.090716 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1025/1801] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:19:18 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:19:19.095349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b0191cac-41a8-4314-8edc-ba975f8b455a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:19:19.096254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b0191cac-41a8-4314-8edc-ba975f8b455a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:19.101660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b0191cac-41a8-4314-8edc-ba975f8b455a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:19.102104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b0191cac-41a8-4314-8edc-ba975f8b455a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:19.102862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b0191cac-41a8-4314-8edc-ba975f8b455a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:19.103329 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b0191cac-41a8-4314-8edc-ba975f8b455a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:19.178924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b0191cac-41a8-4314-8edc-ba975f8b455a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "POST /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/action" status: 200 len: 37411 microversion: 2.20 time: 0.086988 May 10 21:19:19.179600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1026/1802] 10.222.0.49 () {62 vars in 1318 bytes} [Tue May 10 21:19:19 2022] POST /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93/action => generated 37411 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 21:19:19.184605 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e25a2a18-f82e-4894-a5e5-5f2333098849 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:19.186212 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e25a2a18-f82e-4894-a5e5-5f2333098849 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:19.193028 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e25a2a18-f82e-4894-a5e5-5f2333098849 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:19.193474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e25a2a18-f82e-4894-a5e5-5f2333098849 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:19.194238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e25a2a18-f82e-4894-a5e5-5f2333098849 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:19.194670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e25a2a18-f82e-4894-a5e5-5f2333098849 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:19.224036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e25a2a18-f82e-4894-a5e5-5f2333098849 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043197 May 10 21:19:19.224536 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1027/1803] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:19 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:19.228967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8995f130-6644-4f3f-b18e-66266b189811 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:19.229864 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8995f130-6644-4f3f-b18e-66266b189811 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:19.238335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8995f130-6644-4f3f-b18e-66266b189811 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:19.238792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8995f130-6644-4f3f-b18e-66266b189811 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:19.239599 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8995f130-6644-4f3f-b18e-66266b189811 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:19.240054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8995f130-6644-4f3f-b18e-66266b189811 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:19.268505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8995f130-6644-4f3f-b18e-66266b189811 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043005 May 10 21:19:19.269058 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1028/1804] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:19 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:20.107394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c9069931-06fa-46fa-9856-6001656fcf20 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:20.108229 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c9069931-06fa-46fa-9856-6001656fcf20 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:20.114537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9069931-06fa-46fa-9856-6001656fcf20 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:20.114987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9069931-06fa-46fa-9856-6001656fcf20 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:20.115806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9069931-06fa-46fa-9856-6001656fcf20 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:20.116249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9069931-06fa-46fa-9856-6001656fcf20 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:20.250365 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c9069931-06fa-46fa-9856-6001656fcf20 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:19:20.257700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c9069931-06fa-46fa-9856-6001656fcf20 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.154237 May 10 21:19:20.258292 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1029/1805] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:19:20 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:19:20.262788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-26f6a5ca-2e7d-4458-9a62-ffd333e5077b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:20.264666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-26f6a5ca-2e7d-4458-9a62-ffd333e5077b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:20.270140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-26f6a5ca-2e7d-4458-9a62-ffd333e5077b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:20.270588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-26f6a5ca-2e7d-4458-9a62-ffd333e5077b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:20.271382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-26f6a5ca-2e7d-4458-9a62-ffd333e5077b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:20.271826 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-26f6a5ca-2e7d-4458-9a62-ffd333e5077b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:20.302708 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-26f6a5ca-2e7d-4458-9a62-ffd333e5077b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043420 May 10 21:19:20.303271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1030/1806] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:20 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:20.307756 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bc8993b3-0809-43b6-a3f8-6a89f50fa47d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:20.308639 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bc8993b3-0809-43b6-a3f8-6a89f50fa47d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:20.314996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bc8993b3-0809-43b6-a3f8-6a89f50fa47d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:20.315477 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bc8993b3-0809-43b6-a3f8-6a89f50fa47d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:20.316236 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bc8993b3-0809-43b6-a3f8-6a89f50fa47d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:20.316675 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bc8993b3-0809-43b6-a3f8-6a89f50fa47d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:20.346218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bc8993b3-0809-43b6-a3f8-6a89f50fa47d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041948 May 10 21:19:20.346862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1031/1807] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:20 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:21.275370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d02fa3ab-90a0-4c69-8221-2768e1b81303 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:21.276078 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d02fa3ab-90a0-4c69-8221-2768e1b81303 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:21.282970 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d02fa3ab-90a0-4c69-8221-2768e1b81303 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:21.283446 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d02fa3ab-90a0-4c69-8221-2768e1b81303 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:21.284206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d02fa3ab-90a0-4c69-8221-2768e1b81303 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:21.284638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d02fa3ab-90a0-4c69-8221-2768e1b81303 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:21.411689 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d02fa3ab-90a0-4c69-8221-2768e1b81303 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:19:21.419016 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d02fa3ab-90a0-4c69-8221-2768e1b81303 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.147547 May 10 21:19:21.419621 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1032/1808] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:19:21 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:19:21.424285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-23b6e9b9-87fc-42c7-95e9-19d5c40e3f9a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:21.425208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-23b6e9b9-87fc-42c7-95e9-19d5c40e3f9a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:21.430753 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-23b6e9b9-87fc-42c7-95e9-19d5c40e3f9a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:21.431233 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-23b6e9b9-87fc-42c7-95e9-19d5c40e3f9a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:21.432003 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-23b6e9b9-87fc-42c7-95e9-19d5c40e3f9a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:21.432440 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-23b6e9b9-87fc-42c7-95e9-19d5c40e3f9a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:21.465585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-23b6e9b9-87fc-42c7-95e9-19d5c40e3f9a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044932 May 10 21:19:21.466140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1033/1809] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:21 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:21.471318 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1869a98f-6b79-48ca-97e4-9412b87ec999 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:21.472218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1869a98f-6b79-48ca-97e4-9412b87ec999 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:21.477693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1869a98f-6b79-48ca-97e4-9412b87ec999 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:21.478143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1869a98f-6b79-48ca-97e4-9412b87ec999 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:21.478907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1869a98f-6b79-48ca-97e4-9412b87ec999 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:21.479379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1869a98f-6b79-48ca-97e4-9412b87ec999 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:21.507018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1869a98f-6b79-48ca-97e4-9412b87ec999 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039807 May 10 21:19:21.507591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1034/1810] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:21 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:22.436996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ae9b9c73-28c2-461e-9206-0d421de2306b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:22.437652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ae9b9c73-28c2-461e-9206-0d421de2306b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:22.443938 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae9b9c73-28c2-461e-9206-0d421de2306b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:22.444385 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae9b9c73-28c2-461e-9206-0d421de2306b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:22.445151 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae9b9c73-28c2-461e-9206-0d421de2306b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:22.445580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae9b9c73-28c2-461e-9206-0d421de2306b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:22.585215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ae9b9c73-28c2-461e-9206-0d421de2306b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:19:22.593475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ae9b9c73-28c2-461e-9206-0d421de2306b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.161060 May 10 21:19:22.594038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1035/1811] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:19:22 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:19:22.598614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8b0159b9-935e-4e3c-b849-8f453313fbd2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:22.599637 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8b0159b9-935e-4e3c-b849-8f453313fbd2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:22.605767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8b0159b9-935e-4e3c-b849-8f453313fbd2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:22.606213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8b0159b9-935e-4e3c-b849-8f453313fbd2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:22.606994 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8b0159b9-935e-4e3c-b849-8f453313fbd2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:22.608062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8b0159b9-935e-4e3c-b849-8f453313fbd2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:22.637634 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8b0159b9-935e-4e3c-b849-8f453313fbd2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042441 May 10 21:19:22.638131 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1036/1812] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:22 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:22.644576 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a402067c-84a2-4fd0-afb2-3424763a2c5c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:22.645810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a402067c-84a2-4fd0-afb2-3424763a2c5c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:22.652536 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a402067c-84a2-4fd0-afb2-3424763a2c5c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:22.652993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a402067c-84a2-4fd0-afb2-3424763a2c5c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:22.653773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a402067c-84a2-4fd0-afb2-3424763a2c5c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:22.654809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a402067c-84a2-4fd0-afb2-3424763a2c5c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:22.684881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a402067c-84a2-4fd0-afb2-3424763a2c5c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045678 May 10 21:19:22.685482 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1037/1813] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:22 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:23.612438 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-83d4db6a-f4b6-479a-bb4f-d3b74c03083a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:23.613057 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-83d4db6a-f4b6-479a-bb4f-d3b74c03083a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:23.619458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-83d4db6a-f4b6-479a-bb4f-d3b74c03083a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:23.619912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-83d4db6a-f4b6-479a-bb4f-d3b74c03083a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:23.620683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-83d4db6a-f4b6-479a-bb4f-d3b74c03083a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:23.621124 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-83d4db6a-f4b6-479a-bb4f-d3b74c03083a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:23.756732 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-83d4db6a-f4b6-479a-bb4f-d3b74c03083a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:19:23.764471 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-83d4db6a-f4b6-479a-bb4f-d3b74c03083a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.155900 May 10 21:19:23.765042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1038/1814] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:19:23 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:19:23.769692 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-656e409f-097a-45fd-aea1-6fb171a2eb53 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:23.770649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-656e409f-097a-45fd-aea1-6fb171a2eb53 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:23.776603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-656e409f-097a-45fd-aea1-6fb171a2eb53 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:23.777056 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-656e409f-097a-45fd-aea1-6fb171a2eb53 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:23.777831 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-656e409f-097a-45fd-aea1-6fb171a2eb53 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:23.778277 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-656e409f-097a-45fd-aea1-6fb171a2eb53 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:23.811717 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-656e409f-097a-45fd-aea1-6fb171a2eb53 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045608 May 10 21:19:23.812416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1039/1815] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:23 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:23.817215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-02ff911a-55f4-4651-8304-19b5367e2381 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:23.818137 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-02ff911a-55f4-4651-8304-19b5367e2381 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:23.824198 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-02ff911a-55f4-4651-8304-19b5367e2381 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:23.824666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-02ff911a-55f4-4651-8304-19b5367e2381 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:23.825449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-02ff911a-55f4-4651-8304-19b5367e2381 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:23.825885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-02ff911a-55f4-4651-8304-19b5367e2381 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:23.854516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-02ff911a-55f4-4651-8304-19b5367e2381 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041072 May 10 21:19:23.855055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1040/1816] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:23 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:24.782502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f999cc9c-aa6b-4c9d-8190-ab927dff5330 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:24.783180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f999cc9c-aa6b-4c9d-8190-ab927dff5330 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:24.789484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f999cc9c-aa6b-4c9d-8190-ab927dff5330 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:24.789941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f999cc9c-aa6b-4c9d-8190-ab927dff5330 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:24.790713 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f999cc9c-aa6b-4c9d-8190-ab927dff5330 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:24.791181 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f999cc9c-aa6b-4c9d-8190-ab927dff5330 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:24.919601 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f999cc9c-aa6b-4c9d-8190-ab927dff5330 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:19:24.927407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f999cc9c-aa6b-4c9d-8190-ab927dff5330 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.149511 May 10 21:19:24.927971 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1041/1817] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:19:24 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:19:24.979080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cb80acf3-e500-4bb7-b758-155cbbd1d394 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:24.980039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cb80acf3-e500-4bb7-b758-155cbbd1d394 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:24.986091 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb80acf3-e500-4bb7-b758-155cbbd1d394 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:24.986545 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb80acf3-e500-4bb7-b758-155cbbd1d394 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:24.987370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb80acf3-e500-4bb7-b758-155cbbd1d394 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:24.987799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb80acf3-e500-4bb7-b758-155cbbd1d394 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:25.016894 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cb80acf3-e500-4bb7-b758-155cbbd1d394 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087942 May 10 21:19:25.017452 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1042/1818] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:24 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:25.021883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c4466319-6ee0-4ad4-836b-1d6cc286188e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:25.022787 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c4466319-6ee0-4ad4-836b-1d6cc286188e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:25.028339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4466319-6ee0-4ad4-836b-1d6cc286188e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:25.028835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4466319-6ee0-4ad4-836b-1d6cc286188e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:25.029982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4466319-6ee0-4ad4-836b-1d6cc286188e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:25.030426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4466319-6ee0-4ad4-836b-1d6cc286188e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:25.058517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c4466319-6ee0-4ad4-836b-1d6cc286188e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040102 May 10 21:19:25.059067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1043/1819] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:25 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:25.945445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9923661a-c654-4ec1-a1b5-d71b8ac07db8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:25.946086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9923661a-c654-4ec1-a1b5-d71b8ac07db8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:25.953355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9923661a-c654-4ec1-a1b5-d71b8ac07db8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:25.953800 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9923661a-c654-4ec1-a1b5-d71b8ac07db8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:25.954558 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9923661a-c654-4ec1-a1b5-d71b8ac07db8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:25.954993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9923661a-c654-4ec1-a1b5-d71b8ac07db8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:26.087446 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9923661a-c654-4ec1-a1b5-d71b8ac07db8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:19:26.095629 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9923661a-c654-4ec1-a1b5-d71b8ac07db8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.154149 May 10 21:19:26.096530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1044/1820] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:19:25 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:19:26.100906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-32192576-8dc1-400f-8177-6a0ee1772a40 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:26.101815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-32192576-8dc1-400f-8177-6a0ee1772a40 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:26.107440 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-32192576-8dc1-400f-8177-6a0ee1772a40 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:26.107928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-32192576-8dc1-400f-8177-6a0ee1772a40 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:26.109077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-32192576-8dc1-400f-8177-6a0ee1772a40 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:26.109077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-32192576-8dc1-400f-8177-6a0ee1772a40 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:26.137275 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-32192576-8dc1-400f-8177-6a0ee1772a40 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039926 May 10 21:19:26.137820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1045/1821] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:26 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:26.142683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5982468f-c749-424d-98e2-1b29e2166e6f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:26.143601 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5982468f-c749-424d-98e2-1b29e2166e6f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:26.148957 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5982468f-c749-424d-98e2-1b29e2166e6f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:26.149404 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5982468f-c749-424d-98e2-1b29e2166e6f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:26.150155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5982468f-c749-424d-98e2-1b29e2166e6f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:26.150586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5982468f-c749-424d-98e2-1b29e2166e6f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:26.178695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5982468f-c749-424d-98e2-1b29e2166e6f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039887 May 10 21:19:26.179453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1046/1822] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:26 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:27.112899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9c89103f-d8a2-45a3-8160-2a5391771193 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:27.113575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9c89103f-d8a2-45a3-8160-2a5391771193 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:27.120182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c89103f-d8a2-45a3-8160-2a5391771193 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:27.120637 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c89103f-d8a2-45a3-8160-2a5391771193 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:27.121390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c89103f-d8a2-45a3-8160-2a5391771193 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:27.121825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c89103f-d8a2-45a3-8160-2a5391771193 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:27.250180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9c89103f-d8a2-45a3-8160-2a5391771193 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:19:27.257502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9c89103f-d8a2-45a3-8160-2a5391771193 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.148451 May 10 21:19:27.258066 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1047/1823] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:19:27 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:19:27.262612 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-796f5656-588f-4768-bead-5490d4d2d893 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:27.264175 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-796f5656-588f-4768-bead-5490d4d2d893 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:27.270109 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-796f5656-588f-4768-bead-5490d4d2d893 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:27.270555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-796f5656-588f-4768-bead-5490d4d2d893 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:27.271344 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-796f5656-588f-4768-bead-5490d4d2d893 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:27.271784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-796f5656-588f-4768-bead-5490d4d2d893 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:27.301693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-796f5656-588f-4768-bead-5490d4d2d893 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042557 May 10 21:19:27.302233 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1048/1824] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:27 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:27.306581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5421d991-e6e7-434b-86f3-61b2e32c6885 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:27.307490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5421d991-e6e7-434b-86f3-61b2e32c6885 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:27.313804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5421d991-e6e7-434b-86f3-61b2e32c6885 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:27.314255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5421d991-e6e7-434b-86f3-61b2e32c6885 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:27.315013 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5421d991-e6e7-434b-86f3-61b2e32c6885 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:27.315484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5421d991-e6e7-434b-86f3-61b2e32c6885 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:27.345483 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5421d991-e6e7-434b-86f3-61b2e32c6885 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042285 May 10 21:19:27.346027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1049/1825] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:27 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:28.275515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-960065fa-1ddd-4d90-9a65-2bb2c91fa9be tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:28.276196 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-960065fa-1ddd-4d90-9a65-2bb2c91fa9be tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:28.283449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-960065fa-1ddd-4d90-9a65-2bb2c91fa9be tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:28.283952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-960065fa-1ddd-4d90-9a65-2bb2c91fa9be tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:28.284760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-960065fa-1ddd-4d90-9a65-2bb2c91fa9be tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:28.285197 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-960065fa-1ddd-4d90-9a65-2bb2c91fa9be tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:28.417903 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-960065fa-1ddd-4d90-9a65-2bb2c91fa9be tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:19:28.425920 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-960065fa-1ddd-4d90-9a65-2bb2c91fa9be tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.154289 May 10 21:19:28.426481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1050/1826] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:19:28 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:19:28.430926 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0b73a47b-4047-4b20-987b-dd668143ec89 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:28.431865 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0b73a47b-4047-4b20-987b-dd668143ec89 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:28.438005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0b73a47b-4047-4b20-987b-dd668143ec89 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:28.438448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0b73a47b-4047-4b20-987b-dd668143ec89 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:28.439238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0b73a47b-4047-4b20-987b-dd668143ec89 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:28.439674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0b73a47b-4047-4b20-987b-dd668143ec89 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:28.467884 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0b73a47b-4047-4b20-987b-dd668143ec89 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040410 May 10 21:19:28.468426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1051/1827] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:28 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:28.472736 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ec50024a-ad51-4321-b192-98890a030008 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:28.473610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ec50024a-ad51-4321-b192-98890a030008 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:28.478879 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec50024a-ad51-4321-b192-98890a030008 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:28.479398 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec50024a-ad51-4321-b192-98890a030008 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:28.480138 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec50024a-ad51-4321-b192-98890a030008 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:28.480568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec50024a-ad51-4321-b192-98890a030008 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:28.509034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ec50024a-ad51-4321-b192-98890a030008 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039658 May 10 21:19:28.509575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1052/1828] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:28 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:29.444484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8c559e8d-a451-4d3c-9a4a-0801757d5dc6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:29.445226 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8c559e8d-a451-4d3c-9a4a-0801757d5dc6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:29.452434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c559e8d-a451-4d3c-9a4a-0801757d5dc6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:29.452889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c559e8d-a451-4d3c-9a4a-0801757d5dc6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:29.453649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c559e8d-a451-4d3c-9a4a-0801757d5dc6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:29.454091 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c559e8d-a451-4d3c-9a4a-0801757d5dc6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:29.590586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8c559e8d-a451-4d3c-9a4a-0801757d5dc6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:19:29.598594 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8c559e8d-a451-4d3c-9a4a-0801757d5dc6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.158049 May 10 21:19:29.599179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1053/1829] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:19:29 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:19:29.603819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5f9bc64a-ad49-4b6f-9c41-2e0655023ae9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:29.604738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5f9bc64a-ad49-4b6f-9c41-2e0655023ae9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:29.611002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f9bc64a-ad49-4b6f-9c41-2e0655023ae9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:29.611485 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f9bc64a-ad49-4b6f-9c41-2e0655023ae9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:29.612252 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f9bc64a-ad49-4b6f-9c41-2e0655023ae9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:29.612692 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f9bc64a-ad49-4b6f-9c41-2e0655023ae9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:29.642667 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5f9bc64a-ad49-4b6f-9c41-2e0655023ae9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042500 May 10 21:19:29.643250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1054/1830] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:29 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:29.647628 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4e2f8eac-7234-490b-80c3-8e76448631d9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:29.648520 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4e2f8eac-7234-490b-80c3-8e76448631d9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:29.653871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4e2f8eac-7234-490b-80c3-8e76448631d9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:29.654949 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4e2f8eac-7234-490b-80c3-8e76448631d9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:29.655754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4e2f8eac-7234-490b-80c3-8e76448631d9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:29.656194 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4e2f8eac-7234-490b-80c3-8e76448631d9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:29.684449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4e2f8eac-7234-490b-80c3-8e76448631d9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040237 May 10 21:19:29.684990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1055/1831] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:29 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:30.616072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-112db6bd-dfb5-49ce-892b-0fc8f954b2de tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:30.616684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-112db6bd-dfb5-49ce-892b-0fc8f954b2de tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:30.623240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-112db6bd-dfb5-49ce-892b-0fc8f954b2de tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:30.623691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-112db6bd-dfb5-49ce-892b-0fc8f954b2de tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:30.624453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-112db6bd-dfb5-49ce-892b-0fc8f954b2de tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:30.624886 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-112db6bd-dfb5-49ce-892b-0fc8f954b2de tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:30.758829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-112db6bd-dfb5-49ce-892b-0fc8f954b2de tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:19:30.766969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-112db6bd-dfb5-49ce-892b-0fc8f954b2de tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.154845 May 10 21:19:30.767591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1056/1832] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:19:30 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:19:30.772034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-aed448a2-2976-4767-8b24-b428a06559b5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:30.772940 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-aed448a2-2976-4767-8b24-b428a06559b5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:30.778353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aed448a2-2976-4767-8b24-b428a06559b5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:30.778805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aed448a2-2976-4767-8b24-b428a06559b5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:30.780294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aed448a2-2976-4767-8b24-b428a06559b5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:30.780740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aed448a2-2976-4767-8b24-b428a06559b5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:30.809914 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-aed448a2-2976-4767-8b24-b428a06559b5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041338 May 10 21:19:30.811015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1057/1833] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:30 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:30.815394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a1447fba-497a-4033-9812-3cbe63c4b221 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:30.816308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a1447fba-497a-4033-9812-3cbe63c4b221 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:30.821932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a1447fba-497a-4033-9812-3cbe63c4b221 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:30.822376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a1447fba-497a-4033-9812-3cbe63c4b221 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:30.823157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a1447fba-497a-4033-9812-3cbe63c4b221 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:30.823596 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a1447fba-497a-4033-9812-3cbe63c4b221 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:30.851842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a1447fba-497a-4033-9812-3cbe63c4b221 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039872 May 10 21:19:30.852384 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1058/1834] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:30 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:31.783831 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-17413fba-ee14-4e49-a3f1-99b2de1565e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:31.784476 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-17413fba-ee14-4e49-a3f1-99b2de1565e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:31.790456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17413fba-ee14-4e49-a3f1-99b2de1565e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:31.790908 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17413fba-ee14-4e49-a3f1-99b2de1565e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:31.791702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17413fba-ee14-4e49-a3f1-99b2de1565e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:31.792142 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17413fba-ee14-4e49-a3f1-99b2de1565e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:31.926030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-17413fba-ee14-4e49-a3f1-99b2de1565e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:19:31.933261 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-17413fba-ee14-4e49-a3f1-99b2de1565e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.153240 May 10 21:19:31.933826 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1059/1835] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:19:31 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:19:31.945672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dd6ca5cc-9caa-4895-818c-d8ed314856e6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:31.946841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dd6ca5cc-9caa-4895-818c-d8ed314856e6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:31.953315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dd6ca5cc-9caa-4895-818c-d8ed314856e6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:31.953748 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dd6ca5cc-9caa-4895-818c-d8ed314856e6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:31.954511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dd6ca5cc-9caa-4895-818c-d8ed314856e6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:31.955241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dd6ca5cc-9caa-4895-818c-d8ed314856e6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:31.985433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dd6ca5cc-9caa-4895-818c-d8ed314856e6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043491 May 10 21:19:31.986082 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1060/1836] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:31 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:31.992864 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6b97b879-90c1-406c-a511-4f3bc12375a4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:31.993798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6b97b879-90c1-406c-a511-4f3bc12375a4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:31.999610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6b97b879-90c1-406c-a511-4f3bc12375a4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:32.000075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6b97b879-90c1-406c-a511-4f3bc12375a4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:32.000845 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6b97b879-90c1-406c-a511-4f3bc12375a4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:32.001294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6b97b879-90c1-406c-a511-4f3bc12375a4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:32.031578 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6b97b879-90c1-406c-a511-4f3bc12375a4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044374 May 10 21:19:32.032140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1061/1837] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:19:31 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:19:32.036633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b897db20-bdf1-4a08-86fa-83b71465dd80 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:19:32.037127 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b897db20-bdf1-4a08-86fa-83b71465dd80 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:19:32.042623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b897db20-bdf1-4a08-86fa-83b71465dd80 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:32.043081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b897db20-bdf1-4a08-86fa-83b71465dd80 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:32.043885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b897db20-bdf1-4a08-86fa-83b71465dd80 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:19:32.044335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b897db20-bdf1-4a08-86fa-83b71465dd80 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:19:55.828870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.objects.instance [None req-b897db20-bdf1-4a08-86fa-83b71465dd80 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lazy-loading 'services' on Instance uuid 9f2d5e2c-92d8-49db-a14b-34dab8c145e4 {{(pid=117714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:20:46.628901 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:20:46.629469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Tue May 10 21:20:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4/os-volume_attachments/306cf20f-4c05-45ed-92dc-61af3b32943e (ip 10.222.0.49) !!! May 10 21:21:04.244179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:21:04.246237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Tue May 10 21:21:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4/os-volume_attachments/306cf20f-4c05-45ed-92dc-61af3b32943e (ip 10.222.0.49) !!! May 10 21:21:32.456453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b897db20-bdf1-4a08-86fa-83b71465dd80 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4/os-volume_attachments/306cf20f-4c05-45ed-92dc-61af3b32943e" status: 202 len: 0 microversion: 2.1 time: 120.423123 May 10 21:21:32.457945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1062/1838] 10.222.0.49 () {58 vars in 1415 bytes} [Tue May 10 21:19:32 2022] DELETE /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4/os-volume_attachments/306cf20f-4c05-45ed-92dc-61af3b32943e => generated 0 bytes in 120425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:21:32.464645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8fc90b7d-ada6-464f-b17c-44ec00bc14f8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:32.465346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8fc90b7d-ada6-464f-b17c-44ec00bc14f8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:32.471972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8fc90b7d-ada6-464f-b17c-44ec00bc14f8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:32.474120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8fc90b7d-ada6-464f-b17c-44ec00bc14f8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:32.474120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8fc90b7d-ada6-464f-b17c-44ec00bc14f8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:32.474120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8fc90b7d-ada6-464f-b17c-44ec00bc14f8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:32.618179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8fc90b7d-ada6-464f-b17c-44ec00bc14f8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:21:32.626906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8fc90b7d-ada6-464f-b17c-44ec00bc14f8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.167731 May 10 21:21:32.627434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1063/1839] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:21:32 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:21:32.632006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-50ed0424-4145-4d3e-ae52-e00869cb0c4f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:32.632954 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-50ed0424-4145-4d3e-ae52-e00869cb0c4f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:32.639109 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50ed0424-4145-4d3e-ae52-e00869cb0c4f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:32.639583 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50ed0424-4145-4d3e-ae52-e00869cb0c4f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:32.640332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50ed0424-4145-4d3e-ae52-e00869cb0c4f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:32.640767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50ed0424-4145-4d3e-ae52-e00869cb0c4f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:32.669918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-50ed0424-4145-4d3e-ae52-e00869cb0c4f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041456 May 10 21:21:32.670453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1064/1840] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:21:32 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:21:32.674832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a9eba55e-a3bd-4b9c-baee-d9460ce12ee4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:32.675740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a9eba55e-a3bd-4b9c-baee-d9460ce12ee4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:32.680883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a9eba55e-a3bd-4b9c-baee-d9460ce12ee4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:32.681325 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a9eba55e-a3bd-4b9c-baee-d9460ce12ee4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:32.682298 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a9eba55e-a3bd-4b9c-baee-d9460ce12ee4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:32.682731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a9eba55e-a3bd-4b9c-baee-d9460ce12ee4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:32.710585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a9eba55e-a3bd-4b9c-baee-d9460ce12ee4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039129 May 10 21:21:32.711127 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1065/1841] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:21:32 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:21:32.716279 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-522ef17c-d151-4cb7-b58d-edee5dc6d6c7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:21:32.716755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-522ef17c-d151-4cb7-b58d-edee5dc6d6c7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:21:32.721832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-522ef17c-d151-4cb7-b58d-edee5dc6d6c7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:32.722274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-522ef17c-d151-4cb7-b58d-edee5dc6d6c7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:32.723012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-522ef17c-d151-4cb7-b58d-edee5dc6d6c7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:21:32.723587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-522ef17c-d151-4cb7-b58d-edee5dc6d6c7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:21:55.974499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.objects.instance [None req-522ef17c-d151-4cb7-b58d-edee5dc6d6c7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lazy-loading 'services' on Instance uuid 9f2d5e2c-92d8-49db-a14b-34dab8c145e4 {{(pid=117714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:23:32.677505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-522ef17c-d151-4cb7-b58d-edee5dc6d6c7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3c03b89-a073-49a1-aa0e-9248fd7117a2) May 10 21:23:32.679944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-522ef17c-d151-4cb7-b58d-edee5dc6d6c7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Request method failure captured: May 10 21:23:32.679944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: DELETE /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4/os-volume_attachments/306cf20f-4c05-45ed-92dc-61af3b32943e HTTP/1.1 May 10 21:23:32.679944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:23:32.679944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:23:32.679944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:23:32.679944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:23:32.679944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:23:32.679944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:23:32.679944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:23:32.679944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:23:32.679944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietS0ma52EIDMZVLUzsXG3bxQ4j06sc8cl4m7I6EHHffQA2nSL3KWRqj0-fKv8IrV3CL27h_uQRrHq7qkkdFLpXLlZPDGJXL0_5bdbEBBbpSMvr0oLRWthCXHTXr_0lioI7Lre83aaRzSEK1kcRLiE-QUGzI7diJH24EZs2iyRNwSdeY May 10 21:23:32.679944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:23:32.679944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:23:32.679944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:23:32.679944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:23:32.679944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:23:32.679944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:23:32.679944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: b51f628be6144a698276671df56eac18 May 10 21:23:32.679944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-VolumesSnapshotTestJSON-447231634 May 10 21:23:32.679944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:23:32.679944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:23:32.681677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b51f628be6144a698276671df56eac18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b51f628be6144a698276671df56eac18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b51f628be6144a698276671df56eac18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b51f628be6144a698276671df56eac18", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:23:32.681677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-VolumesSnapshotTestJSON-447231634 May 10 21:23:32.681677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: b51f628be6144a698276671df56eac18 May 10 21:23:32.681677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-447231634 May 10 21:23:32.681677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-VolumesSnapshotTestJSON-447231634-project May 10 21:23:32.681677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:23:32.681677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:23:32.681677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 842fa4b1c86e4c208ab1f1f119d3bdd8 May 10 21:23:32.681677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-VolumesSnapshotTestJSON-447231634-project May 10 21:23:32.681677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:23:32.682490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3c03b89-a073-49a1-aa0e-9248fd7117a2) May 10 21:23:32.682490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'server_id': '9f2d5e2c-92d8-49db-a14b-34dab8c145e4', 'id': '306cf20f-4c05-45ed-92dc-61af3b32943e'} May 10 21:23:32.682490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:23:32.682490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:23:32.682490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 21:23:32.682490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 21:23:32.682490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:23:32.682490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:23:32.682490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 10 21:23:32.682490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 10 21:23:32.682490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 10 21:23:32.682490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 10 21:23:32.682490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 10 21:23:32.682490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 10 21:23:32.682490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 10 21:23:32.682490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 10 21:23:32.682490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:23:32.684462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:23:32.684462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:23:32.684462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:23:32.684462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3c03b89-a073-49a1-aa0e-9248fd7117a2) May 10 21:23:32.684462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:23:32.684462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:23:32.684462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:23:32.684462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:23:32.684462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 10 21:23:32.684462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 10 21:23:32.684462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 10 21:23:32.684462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 10 21:23:32.684462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 21:23:32.684462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 21:23:32.684462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 21:23:32.684462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 21:23:32.684462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:23:32.684462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:23:32.684462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 10 21:23:32.685952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 10 21:23:32.685952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 10 21:23:32.685952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 10 21:23:32.685952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 10 21:23:32.685952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 10 21:23:32.685952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 10 21:23:32.685952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 10 21:23:32.685952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:23:32.685952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:23:32.685952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:23:32.685952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:23:32.685952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3c03b89-a073-49a1-aa0e-9248fd7117a2) May 10 21:23:32.685952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:23:32.685952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:23:32.685952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:23:32.685952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:23:32.685952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 10 21:23:32.687413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 10 21:23:32.687413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 21:23:32.687413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 21:23:32.687413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 21:23:32.687413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 21:23:32.687413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 10 21:23:32.687413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 10 21:23:32.687413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 10 21:23:32.687413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 21:23:32.687413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 10 21:23:32.687413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 10 21:23:32.687413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3c03b89-a073-49a1-aa0e-9248fd7117a2) May 10 21:23:32.687413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:23:32.687413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:23:32.687413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:23:32.687413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:23:32.687413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:23:32.687413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:23:32.689067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:23:32.689067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:23:32.689067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:23:32.689067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:23:32.689067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 10 21:23:32.689067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 21:23:32.689067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3c03b89-a073-49a1-aa0e-9248fd7117a2) May 10 21:23:32.689067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:23:32.689067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:23:32.689067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:23:32.689067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:23:32.689067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:23:32.689067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:23:32.689067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:23:32.689067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:23:32.689067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3c03b89-a073-49a1-aa0e-9248fd7117a2) May 10 21:23:32.689067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:23:32.691151 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-522ef17c-d151-4cb7-b58d-edee5dc6d6c7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3c03b89-a073-49a1-aa0e-9248fd7117a2) {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:23:32.691151 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-522ef17c-d151-4cb7-b58d-edee5dc6d6c7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4/os-volume_attachments/306cf20f-4c05-45ed-92dc-61af3b32943e" status: 400 len: 269 microversion: 2.1 time: 119.970246 May 10 21:23:32.691151 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1066/1842] 10.222.0.49 () {58 vars in 1415 bytes} [Tue May 10 21:21:32 2022] DELETE /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4/os-volume_attachments/306cf20f-4c05-45ed-92dc-61af3b32943e => generated 269 bytes in 119972 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 21:23:32.850531 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-04e63ebe-3c66-4d43-b194-b4e471c418bb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:32.851257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-04e63ebe-3c66-4d43-b194-b4e471c418bb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:32.858222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04e63ebe-3c66-4d43-b194-b4e471c418bb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:32.858689 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04e63ebe-3c66-4d43-b194-b4e471c418bb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:32.859532 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04e63ebe-3c66-4d43-b194-b4e471c418bb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:32.859968 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04e63ebe-3c66-4d43-b194-b4e471c418bb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:32.992880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-04e63ebe-3c66-4d43-b194-b4e471c418bb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:33.000267 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-04e63ebe-3c66-4d43-b194-b4e471c418bb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.314924 May 10 21:23:33.001339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1067/1843] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:23:32 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:33.005474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f4083f88-0aa7-47ad-81aa-86c7a4da8d51 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:33.006449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f4083f88-0aa7-47ad-81aa-86c7a4da8d51 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:33.012034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4083f88-0aa7-47ad-81aa-86c7a4da8d51 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:33.012485 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4083f88-0aa7-47ad-81aa-86c7a4da8d51 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:33.013277 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4083f88-0aa7-47ad-81aa-86c7a4da8d51 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:33.013763 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4083f88-0aa7-47ad-81aa-86c7a4da8d51 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:33.045219 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f4083f88-0aa7-47ad-81aa-86c7a4da8d51 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043300 May 10 21:23:33.045693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1068/1844] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:23:33 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:23:33.050156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8aac03fa-e459-4431-81f7-f973009bc930 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:33.051046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8aac03fa-e459-4431-81f7-f973009bc930 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:33.056657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8aac03fa-e459-4431-81f7-f973009bc930 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:33.057103 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8aac03fa-e459-4431-81f7-f973009bc930 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:33.057888 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8aac03fa-e459-4431-81f7-f973009bc930 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:33.058306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8aac03fa-e459-4431-81f7-f973009bc930 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:33.089509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8aac03fa-e459-4431-81f7-f973009bc930 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042805 May 10 21:23:33.090067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1069/1845] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:23:33 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:23:33.094599 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a41c7317-17f5-4f28-ac77-67facdf2be91 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:33.095082 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a41c7317-17f5-4f28-ac77-67facdf2be91 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:33.101369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a41c7317-17f5-4f28-ac77-67facdf2be91 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:33.105271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a41c7317-17f5-4f28-ac77-67facdf2be91 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:33.105271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a41c7317-17f5-4f28-ac77-67facdf2be91 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:33.105271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a41c7317-17f5-4f28-ac77-67facdf2be91 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:56.122266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.objects.instance [None req-a41c7317-17f5-4f28-ac77-67facdf2be91 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lazy-loading 'services' on Instance uuid 9f2d5e2c-92d8-49db-a14b-34dab8c145e4 {{(pid=117714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:23:56.226866 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-a41c7317-17f5-4f28-ac77-67facdf2be91 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fd631b96-3b4b-4dab-9f7c-85e684ada015) May 10 21:23:56.229048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a41c7317-17f5-4f28-ac77-67facdf2be91 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Request method failure captured: May 10 21:23:56.229048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: DELETE /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4/os-volume_attachments/306cf20f-4c05-45ed-92dc-61af3b32943e HTTP/1.1 May 10 21:23:56.229048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:23:56.229048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:23:56.229048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:23:56.229048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:23:56.229048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:23:56.229048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:23:56.229048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:23:56.229048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:23:56.229048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietS0ma52EIDMZVLUzsXG3bxQ4j06sc8cl4m7I6EHHffQA2nSL3KWRqj0-fKv8IrV3CL27h_uQRrHq7qkkdFLpXLlZPDGJXL0_5bdbEBBbpSMvr0oLRWthCXHTXr_0lioI7Lre83aaRzSEK1kcRLiE-QUGzI7diJH24EZs2iyRNwSdeY May 10 21:23:56.229048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:23:56.229048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:23:56.229048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:23:56.229048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:23:56.229048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:23:56.229048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:23:56.229048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: b51f628be6144a698276671df56eac18 May 10 21:23:56.229048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-VolumesSnapshotTestJSON-447231634 May 10 21:23:56.229048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:23:56.229048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:23:56.230751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b51f628be6144a698276671df56eac18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b51f628be6144a698276671df56eac18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b51f628be6144a698276671df56eac18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b51f628be6144a698276671df56eac18", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:23:56.230751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-VolumesSnapshotTestJSON-447231634 May 10 21:23:56.230751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: b51f628be6144a698276671df56eac18 May 10 21:23:56.230751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-447231634 May 10 21:23:56.230751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-VolumesSnapshotTestJSON-447231634-project May 10 21:23:56.230751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:23:56.230751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:23:56.230751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 842fa4b1c86e4c208ab1f1f119d3bdd8 May 10 21:23:56.230751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-VolumesSnapshotTestJSON-447231634-project May 10 21:23:56.230751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:23:56.231509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fd631b96-3b4b-4dab-9f7c-85e684ada015) May 10 21:23:56.231509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'server_id': '9f2d5e2c-92d8-49db-a14b-34dab8c145e4', 'id': '306cf20f-4c05-45ed-92dc-61af3b32943e'} May 10 21:23:56.231509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:23:56.231509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:23:56.231509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 21:23:56.231509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 21:23:56.231509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:23:56.231509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:23:56.231509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 10 21:23:56.231509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 10 21:23:56.231509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 10 21:23:56.231509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 10 21:23:56.231509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 10 21:23:56.231509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 10 21:23:56.231509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 10 21:23:56.231509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 10 21:23:56.231509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:23:56.232602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:23:56.232602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:23:56.232602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:23:56.232602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fd631b96-3b4b-4dab-9f7c-85e684ada015) May 10 21:23:56.232602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:23:56.232602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:23:56.232602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:23:56.232602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:23:56.232602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 10 21:23:56.232602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 10 21:23:56.232602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 10 21:23:56.232602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 10 21:23:56.232602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 21:23:56.232602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 21:23:56.232602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 21:23:56.232602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 21:23:56.232602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:23:56.232602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:23:56.232602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 10 21:23:56.233889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 10 21:23:56.233889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 10 21:23:56.233889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 10 21:23:56.233889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 10 21:23:56.233889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 10 21:23:56.233889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 10 21:23:56.233889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 10 21:23:56.233889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:23:56.233889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:23:56.233889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:23:56.233889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:23:56.233889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fd631b96-3b4b-4dab-9f7c-85e684ada015) May 10 21:23:56.233889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:23:56.233889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:23:56.233889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:23:56.233889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:23:56.233889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 10 21:23:56.234909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 10 21:23:56.234909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 21:23:56.234909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 21:23:56.234909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 21:23:56.234909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 21:23:56.234909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 10 21:23:56.234909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 10 21:23:56.234909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 10 21:23:56.234909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 21:23:56.234909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 10 21:23:56.234909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 10 21:23:56.234909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fd631b96-3b4b-4dab-9f7c-85e684ada015) May 10 21:23:56.234909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:23:56.234909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:23:56.234909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:23:56.234909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:23:56.234909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:23:56.234909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:23:56.236130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:23:56.236130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:23:56.236130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:23:56.236130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:23:56.236130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 10 21:23:56.236130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 21:23:56.236130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fd631b96-3b4b-4dab-9f7c-85e684ada015) May 10 21:23:56.236130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:23:56.236130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:23:56.236130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:23:56.236130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:23:56.236130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:23:56.236130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:23:56.236130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:23:56.236130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:23:56.236130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fd631b96-3b4b-4dab-9f7c-85e684ada015) May 10 21:23:56.236130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:23:56.237243 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a41c7317-17f5-4f28-ac77-67facdf2be91 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fd631b96-3b4b-4dab-9f7c-85e684ada015) {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:23:56.237243 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a41c7317-17f5-4f28-ac77-67facdf2be91 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4/os-volume_attachments/306cf20f-4c05-45ed-92dc-61af3b32943e" status: 400 len: 269 microversion: 2.1 time: 23.139498 May 10 21:23:56.237243 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1070/1846] 10.222.0.49 () {58 vars in 1415 bytes} [Tue May 10 21:23:33 2022] DELETE /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4/os-volume_attachments/306cf20f-4c05-45ed-92dc-61af3b32943e => generated 269 bytes in 23140 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 21:23:56.237243 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4539f74f-ce67-4e0d-b5e6-b9729c335026 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:56.237862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4539f74f-ce67-4e0d-b5e6-b9729c335026 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 92b6d664-37d6-422f-a52a-0ffec8a44389] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:56.243368 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4539f74f-ce67-4e0d-b5e6-b9729c335026 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:56.243823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4539f74f-ce67-4e0d-b5e6-b9729c335026 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:56.244593 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4539f74f-ce67-4e0d-b5e6-b9729c335026 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:56.245029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4539f74f-ce67-4e0d-b5e6-b9729c335026 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:56.270166 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4539f74f-ce67-4e0d-b5e6-b9729c335026 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 92b6d664-37d6-422f-a52a-0ffec8a44389] Going to try to terminate instance {{(pid=117714) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:23:56.512703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4539f74f-ce67-4e0d-b5e6-b9729c335026 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "DELETE /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389" status: 204 len: 0 microversion: 2.1 time: 0.280321 May 10 21:23:56.513343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1071/1847] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 21:23:56 2022] DELETE /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 21:23:56.518439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-48f0bc61-e035-43f9-aed3-74fc4bc04c5b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:56.519848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-48f0bc61-e035-43f9-aed3-74fc4bc04c5b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:56.525725 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-48f0bc61-e035-43f9-aed3-74fc4bc04c5b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:56.526172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-48f0bc61-e035-43f9-aed3-74fc4bc04c5b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:56.526934 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-48f0bc61-e035-43f9-aed3-74fc4bc04c5b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:56.527407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-48f0bc61-e035-43f9-aed3-74fc4bc04c5b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:56.669766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-48f0bc61-e035-43f9-aed3-74fc4bc04c5b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:23:56.677444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-48f0bc61-e035-43f9-aed3-74fc4bc04c5b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.163065 May 10 21:23:56.678009 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1072/1848] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:23:56 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:23:56.682480 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-89914076-432e-46e5-aee4-9526dd94483d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:56.683475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-89914076-432e-46e5-aee4-9526dd94483d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:56.689175 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89914076-432e-46e5-aee4-9526dd94483d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:56.689629 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89914076-432e-46e5-aee4-9526dd94483d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:56.690894 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89914076-432e-46e5-aee4-9526dd94483d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:56.691352 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89914076-432e-46e5-aee4-9526dd94483d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:56.721106 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-89914076-432e-46e5-aee4-9526dd94483d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042086 May 10 21:23:56.726894 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1073/1849] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:23:56 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:23:56.726894 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4676ebe9-c49a-44d2-a32b-9024bd27d307 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:56.727362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4676ebe9-c49a-44d2-a32b-9024bd27d307 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:56.732827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4676ebe9-c49a-44d2-a32b-9024bd27d307 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:56.733280 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4676ebe9-c49a-44d2-a32b-9024bd27d307 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:56.734039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4676ebe9-c49a-44d2-a32b-9024bd27d307 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:56.734516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4676ebe9-c49a-44d2-a32b-9024bd27d307 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:56.765114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4676ebe9-c49a-44d2-a32b-9024bd27d307 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042078 May 10 21:23:56.765597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1074/1850] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:23:56 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:23:56.770876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-70a5de27-4fd2-4d03-a7be-7aa2309bbad3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:23:56.771379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-70a5de27-4fd2-4d03-a7be-7aa2309bbad3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:23:56.776855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-70a5de27-4fd2-4d03-a7be-7aa2309bbad3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:56.782243 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-70a5de27-4fd2-4d03-a7be-7aa2309bbad3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:56.782243 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-70a5de27-4fd2-4d03-a7be-7aa2309bbad3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:23:56.782243 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-70a5de27-4fd2-4d03-a7be-7aa2309bbad3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:23:56.858806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.objects.instance [None req-70a5de27-4fd2-4d03-a7be-7aa2309bbad3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lazy-loading 'services' on Instance uuid 9f2d5e2c-92d8-49db-a14b-34dab8c145e4 {{(pid=117714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:24:06.638177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:24:06.638757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Tue May 10 21:24:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4/os-volume_attachments/306cf20f-4c05-45ed-92dc-61af3b32943e (ip 10.222.0.49) !!! May 10 21:24:24.252883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:24:24.253592 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Tue May 10 21:24:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4/os-volume_attachments/306cf20f-4c05-45ed-92dc-61af3b32943e (ip 10.222.0.49) !!! May 10 21:25:33.149180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-70a5de27-4fd2-4d03-a7be-7aa2309bbad3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9f41d2b2-56f5-4838-9484-05689ba916c7) May 10 21:25:33.152297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-70a5de27-4fd2-4d03-a7be-7aa2309bbad3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Request method failure captured: May 10 21:25:33.152297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: DELETE /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4/os-volume_attachments/306cf20f-4c05-45ed-92dc-61af3b32943e HTTP/1.1 May 10 21:25:33.152297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:25:33.152297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:25:33.152297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:25:33.152297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:25:33.152297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:25:33.152297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:25:33.152297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:25:33.152297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:25:33.152297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietS0ma52EIDMZVLUzsXG3bxQ4j06sc8cl4m7I6EHHffQA2nSL3KWRqj0-fKv8IrV3CL27h_uQRrHq7qkkdFLpXLlZPDGJXL0_5bdbEBBbpSMvr0oLRWthCXHTXr_0lioI7Lre83aaRzSEK1kcRLiE-QUGzI7diJH24EZs2iyRNwSdeY May 10 21:25:33.152297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:25:33.152297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:25:33.152297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:25:33.152297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:25:33.152297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:25:33.152297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:25:33.152297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: b51f628be6144a698276671df56eac18 May 10 21:25:33.152297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-VolumesSnapshotTestJSON-447231634 May 10 21:25:33.152297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:25:33.152297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:25:33.153743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b51f628be6144a698276671df56eac18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b51f628be6144a698276671df56eac18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b51f628be6144a698276671df56eac18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b51f628be6144a698276671df56eac18", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:25:33.153743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-VolumesSnapshotTestJSON-447231634 May 10 21:25:33.153743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: b51f628be6144a698276671df56eac18 May 10 21:25:33.153743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-447231634 May 10 21:25:33.153743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-VolumesSnapshotTestJSON-447231634-project May 10 21:25:33.153743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:25:33.153743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:25:33.153743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 842fa4b1c86e4c208ab1f1f119d3bdd8 May 10 21:25:33.153743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-VolumesSnapshotTestJSON-447231634-project May 10 21:25:33.153743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:25:33.154654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9f41d2b2-56f5-4838-9484-05689ba916c7) May 10 21:25:33.154654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'server_id': '9f2d5e2c-92d8-49db-a14b-34dab8c145e4', 'id': '306cf20f-4c05-45ed-92dc-61af3b32943e'} May 10 21:25:33.154654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:25:33.154654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:33.154654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 21:25:33.154654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 21:25:33.154654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:25:33.154654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:25:33.154654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 10 21:25:33.154654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 10 21:25:33.154654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 10 21:25:33.154654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 10 21:25:33.154654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 10 21:25:33.154654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 10 21:25:33.154654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 10 21:25:33.154654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 10 21:25:33.154654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:25:33.155848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:25:33.155848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:25:33.155848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:25:33.155848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9f41d2b2-56f5-4838-9484-05689ba916c7) May 10 21:25:33.155848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:33.155848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:33.155848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:33.155848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:33.155848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 10 21:25:33.155848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 10 21:25:33.155848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 10 21:25:33.155848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 10 21:25:33.155848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 21:25:33.155848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 21:25:33.155848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 21:25:33.155848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 21:25:33.155848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:25:33.155848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:25:33.155848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 10 21:25:33.157110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 10 21:25:33.157110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 10 21:25:33.157110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 10 21:25:33.157110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 10 21:25:33.157110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 10 21:25:33.157110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 10 21:25:33.157110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 10 21:25:33.157110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:25:33.157110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:25:33.157110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:25:33.157110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:25:33.157110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9f41d2b2-56f5-4838-9484-05689ba916c7) May 10 21:25:33.157110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:33.157110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:33.157110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:33.157110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:33.157110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 10 21:25:33.158177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 10 21:25:33.158177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 21:25:33.158177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 21:25:33.158177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 21:25:33.158177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 21:25:33.158177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 10 21:25:33.158177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 10 21:25:33.158177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 10 21:25:33.158177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 21:25:33.158177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 10 21:25:33.158177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 10 21:25:33.158177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9f41d2b2-56f5-4838-9484-05689ba916c7) May 10 21:25:33.158177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:33.158177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:33.158177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:33.158177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:33.158177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:33.158177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:33.163334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:25:33.163334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:25:33.163334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:25:33.163334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:25:33.163334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 10 21:25:33.163334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 21:25:33.163334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9f41d2b2-56f5-4838-9484-05689ba916c7) May 10 21:25:33.163334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:33.163334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:33.163334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:33.163334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:33.163334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:33.163334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:33.163334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:25:33.163334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:25:33.163334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9f41d2b2-56f5-4838-9484-05689ba916c7) May 10 21:25:33.163334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:33.165386 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-70a5de27-4fd2-4d03-a7be-7aa2309bbad3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9f41d2b2-56f5-4838-9484-05689ba916c7) {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:25:33.165386 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-70a5de27-4fd2-4d03-a7be-7aa2309bbad3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4/os-volume_attachments/306cf20f-4c05-45ed-92dc-61af3b32943e" status: 400 len: 269 microversion: 2.1 time: 96.387072 May 10 21:25:33.165386 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1075/1851] 10.222.0.49 () {58 vars in 1415 bytes} [Tue May 10 21:23:56 2022] DELETE /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4/os-volume_attachments/306cf20f-4c05-45ed-92dc-61af3b32943e => generated 269 bytes in 96388 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 21:25:33.280334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-615214d8-8d1a-4bc2-89b7-cf991e5639f9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:33.280833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-615214d8-8d1a-4bc2-89b7-cf991e5639f9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 92b6d664-37d6-422f-a52a-0ffec8a44389] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:33.287661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-615214d8-8d1a-4bc2-89b7-cf991e5639f9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:33.288112 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-615214d8-8d1a-4bc2-89b7-cf991e5639f9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:33.288913 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-615214d8-8d1a-4bc2-89b7-cf991e5639f9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:33.289431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-615214d8-8d1a-4bc2-89b7-cf991e5639f9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:33.304376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-615214d8-8d1a-4bc2-89b7-cf991e5639f9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] HTTP exception thrown: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:25:33.306486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-615214d8-8d1a-4bc2-89b7-cf991e5639f9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Request method failure captured: May 10 21:25:33.306486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: DELETE /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389 HTTP/1.1 May 10 21:25:33.306486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:25:33.306486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:25:33.306486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:25:33.306486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:25:33.306486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:25:33.306486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:25:33.306486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:25:33.306486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:25:33.306486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietSAJMT-hnL6qBkRs7bZ3-110HT4ymfZj92vRoBUEAGHIeo_ldK2Vr4zsDgcllgzjIBDSyio1stjSGyxN0jeNBxfaE1kSHTlyNAeVLUtctiC1v8O3DwT8su8M8miZ3QqxTaNbg2K8kPDMc7k5ZJZ4ZhBF8q-vP6lWzvhhrcux6GAj2A May 10 21:25:33.306486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:25:33.306486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:25:33.306486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:25:33.306486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:25:33.306486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:25:33.306486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:25:33.306486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: bd946455713e4c36a8efadbce486ee8b May 10 21:25:33.306486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-AttachVolumeTestJSON-824855839 May 10 21:25:33.306486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:25:33.306486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:25:33.313614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd946455713e4c36a8efadbce486ee8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bd946455713e4c36a8efadbce486ee8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd946455713e4c36a8efadbce486ee8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bd946455713e4c36a8efadbce486ee8b", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:25:33.313614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-AttachVolumeTestJSON-824855839 May 10 21:25:33.313614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: bd946455713e4c36a8efadbce486ee8b May 10 21:25:33.313614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-AttachVolumeTestJSON-824855839 May 10 21:25:33.313614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-AttachVolumeTestJSON-824855839-project May 10 21:25:33.313614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:25:33.313614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:25:33.313614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: dc411f6a0a024e7eac561ad1b6d2a944 May 10 21:25:33.313614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-AttachVolumeTestJSON-824855839-project May 10 21:25:33.313614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:25:33.313614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:25:33.313614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': '92b6d664-37d6-422f-a52a-0ffec8a44389'} May 10 21:25:33.314457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:25:33.314457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:33.314457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:25:33.314457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:25:33.314457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:25:33.314457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:25:33.314457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:25:33.314457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:25:33.314457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:25:33.314457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:25:33.314457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:25:33.314457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:33.314457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:33.314457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:33.314457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:33.314457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:33.314457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:33.314457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:25:33.314457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:25:33.314457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:25:33.316095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:25:33.316095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 21:25:33.316095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 21:25:33.316095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 21:25:33.316095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 21:25:33.316095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:25:33.316095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:25:33.316095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:25:33.316095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:25:33.316095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:25:33.316095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:33.316095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:33.316095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:33.316095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:33.316095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:33.316095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:33.316095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:25:33.316095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:25:33.316095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:25:33.316095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:33.319010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-615214d8-8d1a-4bc2-89b7-cf991e5639f9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Returning 404 to user: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:25:33.319010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-615214d8-8d1a-4bc2-89b7-cf991e5639f9 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "DELETE /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389" status: 404 len: 111 microversion: 2.1 time: 0.154567 May 10 21:25:33.319010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1076/1852] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 21:25:33 2022] DELETE /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:25:33.319010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-04b07827-8d02-43c1-bba7-9760d2e88dcb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:33.319010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-04b07827-8d02-43c1-bba7-9760d2e88dcb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:33.321598 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04b07827-8d02-43c1-bba7-9760d2e88dcb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:33.322056 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04b07827-8d02-43c1-bba7-9760d2e88dcb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:33.323512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04b07827-8d02-43c1-bba7-9760d2e88dcb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:33.324495 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04b07827-8d02-43c1-bba7-9760d2e88dcb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:33.461161 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-04b07827-8d02-43c1-bba7-9760d2e88dcb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:33.468662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-04b07827-8d02-43c1-bba7-9760d2e88dcb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1560 microversion: 2.1 time: 0.157595 May 10 21:25:33.469234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1077/1853] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:25:33 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:33.597978 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cb82bdba-badc-4200-b6a0-b7857b87660d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:33.601645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cb82bdba-badc-4200-b6a0-b7857b87660d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:33.605197 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb82bdba-badc-4200-b6a0-b7857b87660d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:33.605717 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb82bdba-badc-4200-b6a0-b7857b87660d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:33.606505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb82bdba-badc-4200-b6a0-b7857b87660d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:33.606959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb82bdba-badc-4200-b6a0-b7857b87660d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:33.637122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cb82bdba-badc-4200-b6a0-b7857b87660d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166745 May 10 21:25:33.637679 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1078/1854] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:25:33 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:25:33.751820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9c2b904e-dbdc-4653-82b4-5656c0e066e6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:33.752742 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9c2b904e-dbdc-4653-82b4-5656c0e066e6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:33.758618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c2b904e-dbdc-4653-82b4-5656c0e066e6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:33.759068 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c2b904e-dbdc-4653-82b4-5656c0e066e6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:33.759864 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c2b904e-dbdc-4653-82b4-5656c0e066e6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:33.760373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c2b904e-dbdc-4653-82b4-5656c0e066e6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:33.789703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9c2b904e-dbdc-4653-82b4-5656c0e066e6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150985 May 10 21:25:33.790256 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1079/1855] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:25:33 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:25:33.795699 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c4431ec1-cbf1-41f4-bcfc-9908b7c25b10 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:33.796191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c4431ec1-cbf1-41f4-bcfc-9908b7c25b10 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:33.801960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4431ec1-cbf1-41f4-bcfc-9908b7c25b10 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:33.802403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4431ec1-cbf1-41f4-bcfc-9908b7c25b10 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:33.803186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4431ec1-cbf1-41f4-bcfc-9908b7c25b10 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:33.803622 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4431ec1-cbf1-41f4-bcfc-9908b7c25b10 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:33.882335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.objects.instance [None req-c4431ec1-cbf1-41f4-bcfc-9908b7c25b10 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lazy-loading 'services' on Instance uuid 9f2d5e2c-92d8-49db-a14b-34dab8c145e4 {{(pid=117714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:25:33.938791 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-c4431ec1-cbf1-41f4-bcfc-9908b7c25b10 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc149e93-f121-40e2-9e17-846457b020ae) May 10 21:25:33.941070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c4431ec1-cbf1-41f4-bcfc-9908b7c25b10 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Request method failure captured: May 10 21:25:33.941070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: DELETE /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4/os-volume_attachments/306cf20f-4c05-45ed-92dc-61af3b32943e HTTP/1.1 May 10 21:25:33.941070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:25:33.941070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:25:33.941070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:25:33.941070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:25:33.941070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:25:33.941070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:25:33.941070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:25:33.941070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:25:33.941070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietS0ma52EIDMZVLUzsXG3bxQ4j06sc8cl4m7I6EHHffQA2nSL3KWRqj0-fKv8IrV3CL27h_uQRrHq7qkkdFLpXLlZPDGJXL0_5bdbEBBbpSMvr0oLRWthCXHTXr_0lioI7Lre83aaRzSEK1kcRLiE-QUGzI7diJH24EZs2iyRNwSdeY May 10 21:25:33.941070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:25:33.941070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:25:33.941070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:25:33.941070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:25:33.941070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:25:33.941070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:25:33.941070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: b51f628be6144a698276671df56eac18 May 10 21:25:33.941070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-VolumesSnapshotTestJSON-447231634 May 10 21:25:33.941070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:25:33.941070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:25:33.942657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b51f628be6144a698276671df56eac18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b51f628be6144a698276671df56eac18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b51f628be6144a698276671df56eac18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b51f628be6144a698276671df56eac18", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:25:33.942657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-VolumesSnapshotTestJSON-447231634 May 10 21:25:33.942657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: b51f628be6144a698276671df56eac18 May 10 21:25:33.942657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-447231634 May 10 21:25:33.942657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-VolumesSnapshotTestJSON-447231634-project May 10 21:25:33.942657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:25:33.942657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:25:33.942657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 842fa4b1c86e4c208ab1f1f119d3bdd8 May 10 21:25:33.942657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-VolumesSnapshotTestJSON-447231634-project May 10 21:25:33.942657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:25:33.943447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc149e93-f121-40e2-9e17-846457b020ae) May 10 21:25:33.943447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'server_id': '9f2d5e2c-92d8-49db-a14b-34dab8c145e4', 'id': '306cf20f-4c05-45ed-92dc-61af3b32943e'} May 10 21:25:33.943447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:25:33.943447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:33.943447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 21:25:33.943447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 21:25:33.943447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:25:33.943447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:25:33.943447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 10 21:25:33.943447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 10 21:25:33.943447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 10 21:25:33.943447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 10 21:25:33.943447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 10 21:25:33.943447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 10 21:25:33.943447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 10 21:25:33.943447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 10 21:25:33.943447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:25:33.944704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:25:33.944704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:25:33.944704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:25:33.944704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc149e93-f121-40e2-9e17-846457b020ae) May 10 21:25:33.944704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:33.944704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:33.944704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:33.944704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:33.944704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 10 21:25:33.944704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 10 21:25:33.944704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 10 21:25:33.944704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 10 21:25:33.944704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 21:25:33.944704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 21:25:33.944704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 21:25:33.944704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 21:25:33.944704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:25:33.944704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:25:33.944704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 10 21:25:33.946083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 10 21:25:33.946083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 10 21:25:33.946083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 10 21:25:33.946083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 10 21:25:33.946083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 10 21:25:33.946083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 10 21:25:33.946083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 10 21:25:33.946083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:25:33.946083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:25:33.946083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:25:33.946083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:25:33.946083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc149e93-f121-40e2-9e17-846457b020ae) May 10 21:25:33.946083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:33.946083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:33.946083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:33.946083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:33.946083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 10 21:25:33.947393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 10 21:25:33.947393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 21:25:33.947393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 21:25:33.947393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 21:25:33.947393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 21:25:33.947393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 10 21:25:33.947393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 10 21:25:33.947393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 10 21:25:33.947393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 21:25:33.947393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 10 21:25:33.947393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 10 21:25:33.947393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc149e93-f121-40e2-9e17-846457b020ae) May 10 21:25:33.947393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:33.947393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:33.947393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:33.947393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:33.947393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:33.947393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:33.949490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:25:33.949490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:25:33.949490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:25:33.949490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:25:33.949490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 10 21:25:33.949490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 21:25:33.949490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc149e93-f121-40e2-9e17-846457b020ae) May 10 21:25:33.949490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:33.949490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:33.949490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:33.949490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:33.949490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:33.949490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:33.949490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:25:33.949490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:25:33.949490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc149e93-f121-40e2-9e17-846457b020ae) May 10 21:25:33.949490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:33.950996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c4431ec1-cbf1-41f4-bcfc-9908b7c25b10 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc149e93-f121-40e2-9e17-846457b020ae) {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:25:33.950996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c4431ec1-cbf1-41f4-bcfc-9908b7c25b10 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4/os-volume_attachments/306cf20f-4c05-45ed-92dc-61af3b32943e" status: 400 len: 269 microversion: 2.1 time: 0.151212 May 10 21:25:33.950996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1080/1856] 10.222.0.49 () {58 vars in 1415 bytes} [Tue May 10 21:25:33 2022] DELETE /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4/os-volume_attachments/306cf20f-4c05-45ed-92dc-61af3b32943e => generated 269 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 21:25:33.950996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ee8d783c-9929-413d-bb9c-3d199f60ce5c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:33.951389 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ee8d783c-9929-413d-bb9c-3d199f60ce5c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 92b6d664-37d6-422f-a52a-0ffec8a44389] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:33.954376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee8d783c-9929-413d-bb9c-3d199f60ce5c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:33.954816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee8d783c-9929-413d-bb9c-3d199f60ce5c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:33.955629 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee8d783c-9929-413d-bb9c-3d199f60ce5c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:33.956061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee8d783c-9929-413d-bb9c-3d199f60ce5c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:33.969138 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-ee8d783c-9929-413d-bb9c-3d199f60ce5c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] HTTP exception thrown: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:25:33.970656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ee8d783c-9929-413d-bb9c-3d199f60ce5c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Request method failure captured: May 10 21:25:33.970656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: DELETE /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389 HTTP/1.1 May 10 21:25:33.970656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:25:33.970656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:25:33.970656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:25:33.970656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:25:33.970656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:25:33.970656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:25:33.970656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:25:33.970656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:25:33.970656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietSAJMT-hnL6qBkRs7bZ3-110HT4ymfZj92vRoBUEAGHIeo_ldK2Vr4zsDgcllgzjIBDSyio1stjSGyxN0jeNBxfaE1kSHTlyNAeVLUtctiC1v8O3DwT8su8M8miZ3QqxTaNbg2K8kPDMc7k5ZJZ4ZhBF8q-vP6lWzvhhrcux6GAj2A May 10 21:25:33.970656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:25:33.970656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:25:33.970656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:25:33.970656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:25:33.970656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:25:33.970656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:25:33.970656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: bd946455713e4c36a8efadbce486ee8b May 10 21:25:33.970656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-AttachVolumeTestJSON-824855839 May 10 21:25:33.970656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:25:33.970656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:25:33.972332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd946455713e4c36a8efadbce486ee8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bd946455713e4c36a8efadbce486ee8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd946455713e4c36a8efadbce486ee8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bd946455713e4c36a8efadbce486ee8b", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:25:33.972332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-AttachVolumeTestJSON-824855839 May 10 21:25:33.972332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: bd946455713e4c36a8efadbce486ee8b May 10 21:25:33.972332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-AttachVolumeTestJSON-824855839 May 10 21:25:33.972332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-AttachVolumeTestJSON-824855839-project May 10 21:25:33.972332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:25:33.972332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:25:33.972332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: dc411f6a0a024e7eac561ad1b6d2a944 May 10 21:25:33.972332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-AttachVolumeTestJSON-824855839-project May 10 21:25:33.972332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:25:33.972332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:25:33.972332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': '92b6d664-37d6-422f-a52a-0ffec8a44389'} May 10 21:25:33.973315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:25:33.973315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:33.973315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:25:33.973315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:25:33.973315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:25:33.973315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:25:33.973315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:25:33.973315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:25:33.973315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:25:33.973315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:25:33.973315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:25:33.973315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:33.973315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:33.973315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:33.973315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:33.973315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:33.973315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:33.973315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:25:33.973315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:25:33.973315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:25:33.974782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:25:33.974782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 21:25:33.974782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 21:25:33.974782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 21:25:33.974782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 21:25:33.974782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:25:33.974782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:25:33.974782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:25:33.974782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:25:33.974782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:25:33.974782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:33.974782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:33.974782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:33.974782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:33.974782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:33.974782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:33.974782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:25:33.974782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:25:33.974782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:25:33.974782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:33.976348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ee8d783c-9929-413d-bb9c-3d199f60ce5c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Returning 404 to user: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:25:33.976348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ee8d783c-9929-413d-bb9c-3d199f60ce5c tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "DELETE /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389" status: 404 len: 111 microversion: 2.1 time: 0.027835 May 10 21:25:33.976348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1081/1857] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 21:25:33 2022] DELETE /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:25:33.976830 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0ada0548-67f8-4cc0-a04e-c1930bd40530 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:33.977426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0ada0548-67f8-4cc0-a04e-c1930bd40530 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:33.984227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ada0548-67f8-4cc0-a04e-c1930bd40530 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:33.984674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ada0548-67f8-4cc0-a04e-c1930bd40530 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:33.985422 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ada0548-67f8-4cc0-a04e-c1930bd40530 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:33.985854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ada0548-67f8-4cc0-a04e-c1930bd40530 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:34.117627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0ada0548-67f8-4cc0-a04e-c1930bd40530 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:34.125836 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0ada0548-67f8-4cc0-a04e-c1930bd40530 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1560 microversion: 2.1 time: 0.152369 May 10 21:25:34.126439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1082/1858] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:25:33 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:34.130885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d3a191eb-f156-44b0-a18f-53adc235f2ab tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:34.131890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d3a191eb-f156-44b0-a18f-53adc235f2ab tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:34.137398 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d3a191eb-f156-44b0-a18f-53adc235f2ab tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:34.137851 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d3a191eb-f156-44b0-a18f-53adc235f2ab tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:34.138619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d3a191eb-f156-44b0-a18f-53adc235f2ab tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:34.139063 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d3a191eb-f156-44b0-a18f-53adc235f2ab tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:34.167564 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d3a191eb-f156-44b0-a18f-53adc235f2ab tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040092 May 10 21:25:34.168237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1083/1859] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:25:34 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:25:34.172449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b54e16f8-8fd5-4c1d-bd92-a46b1a0e6ee7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:34.173331 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b54e16f8-8fd5-4c1d-bd92-a46b1a0e6ee7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:34.178683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b54e16f8-8fd5-4c1d-bd92-a46b1a0e6ee7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:34.179157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b54e16f8-8fd5-4c1d-bd92-a46b1a0e6ee7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:34.179925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b54e16f8-8fd5-4c1d-bd92-a46b1a0e6ee7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:34.180365 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b54e16f8-8fd5-4c1d-bd92-a46b1a0e6ee7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:34.208716 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b54e16f8-8fd5-4c1d-bd92-a46b1a0e6ee7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039658 May 10 21:25:34.209263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1084/1860] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:25:34 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:25:34.266228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-5cfde0bd-4ffd-45c2-a911-e3c294f98a89 req-8a853cd1-d8ff-49b4-a253-f6a0d7368d04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b6d664-37d6-422f-a52a-0ffec8a44389", "name": "network-vif-deleted", "tag": "d3cf0742-1fc1-49a1-93ca-8273a54dbbef"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:25:34.274095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-5cfde0bd-4ffd-45c2-a911-e3c294f98a89 req-8a853cd1-d8ff-49b4-a253-f6a0d7368d04 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:34.274565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-5cfde0bd-4ffd-45c2-a911-e3c294f98a89 req-8a853cd1-d8ff-49b4-a253-f6a0d7368d04 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:34.286477 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-5cfde0bd-4ffd-45c2-a911-e3c294f98a89 req-8a853cd1-d8ff-49b4-a253-f6a0d7368d04 service nova] Creating event network-vif-deleted:d3cf0742-1fc1-49a1-93ca-8273a54dbbef for instance 92b6d664-37d6-422f-a52a-0ffec8a44389 on hv-cinder-82880 May 10 21:25:34.292200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-5cfde0bd-4ffd-45c2-a911-e3c294f98a89 req-8a853cd1-d8ff-49b4-a253-f6a0d7368d04 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081194 May 10 21:25:34.293261 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1085/1861] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:25:34.298317 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-83cd9dfd-1c67-4a79-9248-53a9d6c2cca3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:34.298899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-83cd9dfd-1c67-4a79-9248-53a9d6c2cca3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:34.304877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-83cd9dfd-1c67-4a79-9248-53a9d6c2cca3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:34.305327 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-83cd9dfd-1c67-4a79-9248-53a9d6c2cca3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:34.306090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-83cd9dfd-1c67-4a79-9248-53a9d6c2cca3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:34.306529 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-83cd9dfd-1c67-4a79-9248-53a9d6c2cca3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:34.387751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.objects.instance [None req-83cd9dfd-1c67-4a79-9248-53a9d6c2cca3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lazy-loading 'services' on Instance uuid 9f2d5e2c-92d8-49db-a14b-34dab8c145e4 {{(pid=117714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:25:34.463209 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-83cd9dfd-1c67-4a79-9248-53a9d6c2cca3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-23f8a1f8-20ec-4e3e-83e5-2c48fa663586) May 10 21:25:34.466012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-83cd9dfd-1c67-4a79-9248-53a9d6c2cca3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Request method failure captured: May 10 21:25:34.466012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: DELETE /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4/os-volume_attachments/306cf20f-4c05-45ed-92dc-61af3b32943e HTTP/1.1 May 10 21:25:34.466012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:25:34.466012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:25:34.466012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:25:34.466012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:25:34.466012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:25:34.466012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:25:34.466012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:25:34.466012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:25:34.466012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietS0ma52EIDMZVLUzsXG3bxQ4j06sc8cl4m7I6EHHffQA2nSL3KWRqj0-fKv8IrV3CL27h_uQRrHq7qkkdFLpXLlZPDGJXL0_5bdbEBBbpSMvr0oLRWthCXHTXr_0lioI7Lre83aaRzSEK1kcRLiE-QUGzI7diJH24EZs2iyRNwSdeY May 10 21:25:34.466012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:25:34.466012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:25:34.466012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:25:34.466012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:25:34.466012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:25:34.466012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:25:34.466012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: b51f628be6144a698276671df56eac18 May 10 21:25:34.466012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-VolumesSnapshotTestJSON-447231634 May 10 21:25:34.466012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:25:34.466012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:25:34.467695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b51f628be6144a698276671df56eac18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b51f628be6144a698276671df56eac18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b51f628be6144a698276671df56eac18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b51f628be6144a698276671df56eac18", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:25:34.467695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-VolumesSnapshotTestJSON-447231634 May 10 21:25:34.467695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: b51f628be6144a698276671df56eac18 May 10 21:25:34.467695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-447231634 May 10 21:25:34.467695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-VolumesSnapshotTestJSON-447231634-project May 10 21:25:34.467695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:25:34.467695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:25:34.467695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 842fa4b1c86e4c208ab1f1f119d3bdd8 May 10 21:25:34.467695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-VolumesSnapshotTestJSON-447231634-project May 10 21:25:34.467695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:25:34.468465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-23f8a1f8-20ec-4e3e-83e5-2c48fa663586) May 10 21:25:34.468465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'server_id': '9f2d5e2c-92d8-49db-a14b-34dab8c145e4', 'id': '306cf20f-4c05-45ed-92dc-61af3b32943e'} May 10 21:25:34.468465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:25:34.468465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:34.468465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 21:25:34.468465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 21:25:34.468465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:25:34.468465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:25:34.468465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 10 21:25:34.468465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 10 21:25:34.468465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 10 21:25:34.468465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 10 21:25:34.468465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 10 21:25:34.468465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 10 21:25:34.468465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 10 21:25:34.468465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 10 21:25:34.468465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:25:34.469882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:25:34.469882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:25:34.469882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:25:34.469882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-23f8a1f8-20ec-4e3e-83e5-2c48fa663586) May 10 21:25:34.469882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:34.469882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:34.469882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:34.469882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:34.469882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 10 21:25:34.469882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 10 21:25:34.469882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 10 21:25:34.469882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 10 21:25:34.469882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 21:25:34.469882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 21:25:34.469882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 21:25:34.469882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 21:25:34.469882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:25:34.469882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:25:34.469882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 10 21:25:34.471326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 10 21:25:34.471326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 10 21:25:34.471326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 10 21:25:34.471326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 10 21:25:34.471326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 10 21:25:34.471326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 10 21:25:34.471326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 10 21:25:34.471326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:25:34.471326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:25:34.471326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:25:34.471326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:25:34.471326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-23f8a1f8-20ec-4e3e-83e5-2c48fa663586) May 10 21:25:34.471326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:34.471326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:34.471326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:34.471326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:34.471326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 10 21:25:34.472614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 10 21:25:34.472614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 21:25:34.472614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 21:25:34.472614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 21:25:34.472614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 21:25:34.472614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 10 21:25:34.472614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 10 21:25:34.472614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 10 21:25:34.472614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 21:25:34.472614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 10 21:25:34.472614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 10 21:25:34.472614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-23f8a1f8-20ec-4e3e-83e5-2c48fa663586) May 10 21:25:34.472614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:34.472614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:34.472614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:34.472614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:34.472614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:34.472614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:34.474018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:25:34.474018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:25:34.474018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:25:34.474018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:25:34.474018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 10 21:25:34.474018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 21:25:34.474018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-23f8a1f8-20ec-4e3e-83e5-2c48fa663586) May 10 21:25:34.474018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:34.474018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:34.474018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:34.474018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:34.474018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:34.474018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:34.474018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:25:34.474018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:25:34.474018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-23f8a1f8-20ec-4e3e-83e5-2c48fa663586) May 10 21:25:34.474018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:34.475306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-83cd9dfd-1c67-4a79-9248-53a9d6c2cca3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-23f8a1f8-20ec-4e3e-83e5-2c48fa663586) {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:25:34.475306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-83cd9dfd-1c67-4a79-9248-53a9d6c2cca3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4/os-volume_attachments/306cf20f-4c05-45ed-92dc-61af3b32943e" status: 400 len: 269 microversion: 2.1 time: 0.173092 May 10 21:25:34.475306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1086/1862] 10.222.0.49 () {58 vars in 1415 bytes} [Tue May 10 21:25:34 2022] DELETE /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4/os-volume_attachments/306cf20f-4c05-45ed-92dc-61af3b32943e => generated 269 bytes in 174 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 21:25:34.475306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8b148109-6a98-4e20-b0cb-d24c51d5bf52 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:34.475657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8b148109-6a98-4e20-b0cb-d24c51d5bf52 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 92b6d664-37d6-422f-a52a-0ffec8a44389] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:34.480089 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8b148109-6a98-4e20-b0cb-d24c51d5bf52 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:34.480536 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8b148109-6a98-4e20-b0cb-d24c51d5bf52 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:34.481290 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8b148109-6a98-4e20-b0cb-d24c51d5bf52 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:34.481723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8b148109-6a98-4e20-b0cb-d24c51d5bf52 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:34.494518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-8b148109-6a98-4e20-b0cb-d24c51d5bf52 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] HTTP exception thrown: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:25:34.496101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8b148109-6a98-4e20-b0cb-d24c51d5bf52 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Request method failure captured: May 10 21:25:34.496101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: DELETE /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389 HTTP/1.1 May 10 21:25:34.496101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:25:34.496101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:25:34.496101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:25:34.496101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:25:34.496101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:25:34.496101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:25:34.496101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:25:34.496101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:25:34.496101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietSAJMT-hnL6qBkRs7bZ3-110HT4ymfZj92vRoBUEAGHIeo_ldK2Vr4zsDgcllgzjIBDSyio1stjSGyxN0jeNBxfaE1kSHTlyNAeVLUtctiC1v8O3DwT8su8M8miZ3QqxTaNbg2K8kPDMc7k5ZJZ4ZhBF8q-vP6lWzvhhrcux6GAj2A May 10 21:25:34.496101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:25:34.496101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:25:34.496101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:25:34.496101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:25:34.496101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:25:34.496101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:25:34.496101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: bd946455713e4c36a8efadbce486ee8b May 10 21:25:34.496101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-AttachVolumeTestJSON-824855839 May 10 21:25:34.496101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:25:34.496101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:25:34.497686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd946455713e4c36a8efadbce486ee8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bd946455713e4c36a8efadbce486ee8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd946455713e4c36a8efadbce486ee8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bd946455713e4c36a8efadbce486ee8b", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:25:34.497686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-AttachVolumeTestJSON-824855839 May 10 21:25:34.497686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: bd946455713e4c36a8efadbce486ee8b May 10 21:25:34.497686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-AttachVolumeTestJSON-824855839 May 10 21:25:34.497686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-AttachVolumeTestJSON-824855839-project May 10 21:25:34.497686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:25:34.497686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:25:34.497686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: dc411f6a0a024e7eac561ad1b6d2a944 May 10 21:25:34.497686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-AttachVolumeTestJSON-824855839-project May 10 21:25:34.497686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:25:34.497686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:25:34.497686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': '92b6d664-37d6-422f-a52a-0ffec8a44389'} May 10 21:25:34.498555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:25:34.498555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:34.498555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:25:34.498555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:25:34.498555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:25:34.498555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:25:34.498555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:25:34.498555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:25:34.498555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:25:34.498555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:25:34.498555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:25:34.498555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:34.498555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:34.498555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:34.498555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:34.498555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:34.498555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:34.498555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:25:34.498555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:25:34.498555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:25:34.500289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:25:34.500289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 21:25:34.500289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 21:25:34.500289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 21:25:34.500289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 21:25:34.500289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:25:34.500289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:25:34.500289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:25:34.500289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:25:34.500289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:25:34.500289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:34.500289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:34.500289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:34.500289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:34.500289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:34.500289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:34.500289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:25:34.500289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:25:34.500289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:25:34.500289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:34.501710 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8b148109-6a98-4e20-b0cb-d24c51d5bf52 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Returning 404 to user: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:25:34.501710 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8b148109-6a98-4e20-b0cb-d24c51d5bf52 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "DELETE /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389" status: 404 len: 111 microversion: 2.1 time: 0.028591 May 10 21:25:34.501710 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1087/1863] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 21:25:34 2022] DELETE /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:25:34.502473 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-21a45a0f-01d9-4486-a045-11cf2d98ae4a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:34.503081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-21a45a0f-01d9-4486-a045-11cf2d98ae4a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:34.508708 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21a45a0f-01d9-4486-a045-11cf2d98ae4a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:34.515751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21a45a0f-01d9-4486-a045-11cf2d98ae4a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:34.515751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21a45a0f-01d9-4486-a045-11cf2d98ae4a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:34.515751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21a45a0f-01d9-4486-a045-11cf2d98ae4a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:34.643563 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-21a45a0f-01d9-4486-a045-11cf2d98ae4a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:34.649545 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-21a45a0f-01d9-4486-a045-11cf2d98ae4a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1560 microversion: 2.1 time: 0.150515 May 10 21:25:34.650103 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1088/1864] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:25:34 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:34.655368 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b852376f-b1d3-479e-bc77-66d38034873b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:34.656319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b852376f-b1d3-479e-bc77-66d38034873b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:34.661910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b852376f-b1d3-479e-bc77-66d38034873b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:34.662362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b852376f-b1d3-479e-bc77-66d38034873b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:34.663113 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b852376f-b1d3-479e-bc77-66d38034873b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:34.663570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b852376f-b1d3-479e-bc77-66d38034873b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:34.691063 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b852376f-b1d3-479e-bc77-66d38034873b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039994 May 10 21:25:34.691635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1089/1865] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:25:34 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:25:34.695905 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6aaf6f8e-446d-48a4-ba55-eb98888632ac tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:34.696767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6aaf6f8e-446d-48a4-ba55-eb98888632ac tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:34.702796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6aaf6f8e-446d-48a4-ba55-eb98888632ac tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:34.703286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6aaf6f8e-446d-48a4-ba55-eb98888632ac tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:34.704036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6aaf6f8e-446d-48a4-ba55-eb98888632ac tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:34.704468 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6aaf6f8e-446d-48a4-ba55-eb98888632ac tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:34.733509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6aaf6f8e-446d-48a4-ba55-eb98888632ac tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040916 May 10 21:25:34.734055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1090/1866] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:25:34 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:25:34.738443 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-54683816-5a2d-419b-b22d-6b8997af3c2b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:34.738962 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-54683816-5a2d-419b-b22d-6b8997af3c2b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:34.744214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54683816-5a2d-419b-b22d-6b8997af3c2b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:34.744663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54683816-5a2d-419b-b22d-6b8997af3c2b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:34.745591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54683816-5a2d-419b-b22d-6b8997af3c2b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:34.746024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54683816-5a2d-419b-b22d-6b8997af3c2b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:34.821726 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.objects.instance [None req-54683816-5a2d-419b-b22d-6b8997af3c2b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lazy-loading 'services' on Instance uuid 9f2d5e2c-92d8-49db-a14b-34dab8c145e4 {{(pid=117714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:25:34.875845 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-54683816-5a2d-419b-b22d-6b8997af3c2b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c736f755-1bd6-4b7c-983a-16eff41099fc) May 10 21:25:34.878072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-54683816-5a2d-419b-b22d-6b8997af3c2b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Request method failure captured: May 10 21:25:34.878072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: DELETE /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4/os-volume_attachments/306cf20f-4c05-45ed-92dc-61af3b32943e HTTP/1.1 May 10 21:25:34.878072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:25:34.878072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:25:34.878072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:25:34.878072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:25:34.878072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:25:34.878072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:25:34.878072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:25:34.878072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:25:34.878072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietS0ma52EIDMZVLUzsXG3bxQ4j06sc8cl4m7I6EHHffQA2nSL3KWRqj0-fKv8IrV3CL27h_uQRrHq7qkkdFLpXLlZPDGJXL0_5bdbEBBbpSMvr0oLRWthCXHTXr_0lioI7Lre83aaRzSEK1kcRLiE-QUGzI7diJH24EZs2iyRNwSdeY May 10 21:25:34.878072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:25:34.878072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:25:34.878072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:25:34.878072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:25:34.878072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:25:34.878072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:25:34.878072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: b51f628be6144a698276671df56eac18 May 10 21:25:34.878072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-VolumesSnapshotTestJSON-447231634 May 10 21:25:34.878072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:25:34.878072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:25:34.879645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b51f628be6144a698276671df56eac18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b51f628be6144a698276671df56eac18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b51f628be6144a698276671df56eac18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b51f628be6144a698276671df56eac18", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:25:34.879645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-VolumesSnapshotTestJSON-447231634 May 10 21:25:34.879645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: b51f628be6144a698276671df56eac18 May 10 21:25:34.879645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-447231634 May 10 21:25:34.879645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-VolumesSnapshotTestJSON-447231634-project May 10 21:25:34.879645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:25:34.879645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:25:34.879645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 842fa4b1c86e4c208ab1f1f119d3bdd8 May 10 21:25:34.879645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-VolumesSnapshotTestJSON-447231634-project May 10 21:25:34.879645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:25:34.880405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c736f755-1bd6-4b7c-983a-16eff41099fc) May 10 21:25:34.880405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'server_id': '9f2d5e2c-92d8-49db-a14b-34dab8c145e4', 'id': '306cf20f-4c05-45ed-92dc-61af3b32943e'} May 10 21:25:34.880405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:25:34.880405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:34.880405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 21:25:34.880405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 21:25:34.880405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:25:34.880405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:25:34.880405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 10 21:25:34.880405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 10 21:25:34.880405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 10 21:25:34.880405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 10 21:25:34.880405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 10 21:25:34.880405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 10 21:25:34.880405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 10 21:25:34.880405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 10 21:25:34.880405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:25:34.881610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:25:34.881610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:25:34.881610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:25:34.881610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c736f755-1bd6-4b7c-983a-16eff41099fc) May 10 21:25:34.881610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:34.881610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:34.881610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:34.881610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:34.881610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 10 21:25:34.881610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 10 21:25:34.881610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 10 21:25:34.881610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 10 21:25:34.881610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 21:25:34.881610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 21:25:34.881610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 21:25:34.881610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 21:25:34.881610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:25:34.881610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:25:34.881610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 10 21:25:34.882945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 10 21:25:34.882945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 10 21:25:34.882945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 10 21:25:34.882945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 10 21:25:34.882945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 10 21:25:34.882945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 10 21:25:34.882945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 10 21:25:34.882945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:25:34.882945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:25:34.882945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:25:34.882945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:25:34.882945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c736f755-1bd6-4b7c-983a-16eff41099fc) May 10 21:25:34.882945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:34.882945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:34.882945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:34.882945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:34.882945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 10 21:25:34.884214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 10 21:25:34.884214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 21:25:34.884214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 21:25:34.884214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 21:25:34.884214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 21:25:34.884214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 10 21:25:34.884214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 10 21:25:34.884214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 10 21:25:34.884214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 21:25:34.884214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 10 21:25:34.884214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 10 21:25:34.884214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c736f755-1bd6-4b7c-983a-16eff41099fc) May 10 21:25:34.884214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:34.884214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:34.884214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:34.884214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:34.884214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:34.884214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:34.886162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:25:34.886162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:25:34.886162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:25:34.886162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:25:34.886162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 10 21:25:34.886162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 21:25:34.886162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c736f755-1bd6-4b7c-983a-16eff41099fc) May 10 21:25:34.886162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:34.886162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:34.886162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:34.886162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:34.886162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:34.886162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:34.886162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:25:34.886162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:25:34.886162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c736f755-1bd6-4b7c-983a-16eff41099fc) May 10 21:25:34.886162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:34.887449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-54683816-5a2d-419b-b22d-6b8997af3c2b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c736f755-1bd6-4b7c-983a-16eff41099fc) {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:25:34.887449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-54683816-5a2d-419b-b22d-6b8997af3c2b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4/os-volume_attachments/306cf20f-4c05-45ed-92dc-61af3b32943e" status: 400 len: 269 microversion: 2.1 time: 0.144539 May 10 21:25:34.887449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1091/1867] 10.222.0.49 () {58 vars in 1415 bytes} [Tue May 10 21:25:34 2022] DELETE /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4/os-volume_attachments/306cf20f-4c05-45ed-92dc-61af3b32943e => generated 269 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 21:25:34.887449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e1aaca78-12db-496f-85fa-7a277e8ca3c0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:34.887893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e1aaca78-12db-496f-85fa-7a277e8ca3c0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 92b6d664-37d6-422f-a52a-0ffec8a44389] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:34.892582 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e1aaca78-12db-496f-85fa-7a277e8ca3c0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:34.893037 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e1aaca78-12db-496f-85fa-7a277e8ca3c0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:34.893874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e1aaca78-12db-496f-85fa-7a277e8ca3c0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:34.894261 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e1aaca78-12db-496f-85fa-7a277e8ca3c0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:34.907852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-e1aaca78-12db-496f-85fa-7a277e8ca3c0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] HTTP exception thrown: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:25:34.909588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e1aaca78-12db-496f-85fa-7a277e8ca3c0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Request method failure captured: May 10 21:25:34.909588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: DELETE /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389 HTTP/1.1 May 10 21:25:34.909588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:25:34.909588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:25:34.909588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:25:34.909588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:25:34.909588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:25:34.909588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:25:34.909588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:25:34.909588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:25:34.909588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietSAJMT-hnL6qBkRs7bZ3-110HT4ymfZj92vRoBUEAGHIeo_ldK2Vr4zsDgcllgzjIBDSyio1stjSGyxN0jeNBxfaE1kSHTlyNAeVLUtctiC1v8O3DwT8su8M8miZ3QqxTaNbg2K8kPDMc7k5ZJZ4ZhBF8q-vP6lWzvhhrcux6GAj2A May 10 21:25:34.909588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:25:34.909588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:25:34.909588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:25:34.909588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:25:34.909588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:25:34.909588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:25:34.909588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: bd946455713e4c36a8efadbce486ee8b May 10 21:25:34.909588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-AttachVolumeTestJSON-824855839 May 10 21:25:34.909588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:25:34.909588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:25:34.911314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd946455713e4c36a8efadbce486ee8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bd946455713e4c36a8efadbce486ee8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd946455713e4c36a8efadbce486ee8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bd946455713e4c36a8efadbce486ee8b", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:25:34.911314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-AttachVolumeTestJSON-824855839 May 10 21:25:34.911314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: bd946455713e4c36a8efadbce486ee8b May 10 21:25:34.911314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-AttachVolumeTestJSON-824855839 May 10 21:25:34.911314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-AttachVolumeTestJSON-824855839-project May 10 21:25:34.911314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:25:34.911314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:25:34.911314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: dc411f6a0a024e7eac561ad1b6d2a944 May 10 21:25:34.911314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-AttachVolumeTestJSON-824855839-project May 10 21:25:34.911314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:25:34.911314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:25:34.911314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': '92b6d664-37d6-422f-a52a-0ffec8a44389'} May 10 21:25:34.912393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:25:34.912393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:34.912393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:25:34.912393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:25:34.912393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:25:34.912393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:25:34.912393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:25:34.912393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:25:34.912393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:25:34.912393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:25:34.912393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:25:34.912393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:34.912393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:34.912393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:34.912393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:34.912393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:34.912393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:34.912393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:25:34.912393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:25:34.912393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:25:34.913870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:25:34.913870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 21:25:34.913870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 21:25:34.913870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 21:25:34.913870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 21:25:34.913870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:25:34.913870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:25:34.913870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:25:34.913870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:25:34.913870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:25:34.913870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:34.913870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:25:34.913870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:34.913870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:25:34.913870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:25:34.913870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:25:34.913870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:25:34.913870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:25:34.913870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:25:34.913870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:25:34.915283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e1aaca78-12db-496f-85fa-7a277e8ca3c0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Returning 404 to user: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:25:34.915283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e1aaca78-12db-496f-85fa-7a277e8ca3c0 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "DELETE /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389" status: 404 len: 111 microversion: 2.1 time: 0.030040 May 10 21:25:34.915283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1092/1868] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 21:25:34 2022] DELETE /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:25:34.917288 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-460b50ea-04a5-4c13-a536-2acd93f03b71 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:34.917907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-460b50ea-04a5-4c13-a536-2acd93f03b71 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:34.923953 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-460b50ea-04a5-4c13-a536-2acd93f03b71 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:34.924730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-460b50ea-04a5-4c13-a536-2acd93f03b71 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:34.925233 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-460b50ea-04a5-4c13-a536-2acd93f03b71 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:34.925624 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-460b50ea-04a5-4c13-a536-2acd93f03b71 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:35.058468 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-460b50ea-04a5-4c13-a536-2acd93f03b71 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:35.065797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-460b50ea-04a5-4c13-a536-2acd93f03b71 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1560 microversion: 2.1 time: 0.153016 May 10 21:25:35.066357 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1093/1869] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:25:34 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:35.070848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-63e3a521-9a2f-4bb3-9b77-3970eab5dbee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:35.071791 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-63e3a521-9a2f-4bb3-9b77-3970eab5dbee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:35.078119 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-63e3a521-9a2f-4bb3-9b77-3970eab5dbee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:35.078575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-63e3a521-9a2f-4bb3-9b77-3970eab5dbee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:35.079367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-63e3a521-9a2f-4bb3-9b77-3970eab5dbee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:35.079813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-63e3a521-9a2f-4bb3-9b77-3970eab5dbee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:35.110432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-63e3a521-9a2f-4bb3-9b77-3970eab5dbee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043033 May 10 21:25:35.111001 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1094/1870] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:25:35 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:25:35.115563 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-654259fb-51a6-4786-b8b9-59e2fd1f3564 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:35.116474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-654259fb-51a6-4786-b8b9-59e2fd1f3564 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:35.122830 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-654259fb-51a6-4786-b8b9-59e2fd1f3564 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:35.123394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-654259fb-51a6-4786-b8b9-59e2fd1f3564 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:35.124171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-654259fb-51a6-4786-b8b9-59e2fd1f3564 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:35.124617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-654259fb-51a6-4786-b8b9-59e2fd1f3564 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:35.154710 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-654259fb-51a6-4786-b8b9-59e2fd1f3564 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042539 May 10 21:25:35.158458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1095/1871] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:25:35 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:25:35.160024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f6b537a3-a0d0-498b-a984-2871105131ea tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:35.160507 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f6b537a3-a0d0-498b-a984-2871105131ea tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:35.166116 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6b537a3-a0d0-498b-a984-2871105131ea tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:35.166559 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6b537a3-a0d0-498b-a984-2871105131ea tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:35.167449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6b537a3-a0d0-498b-a984-2871105131ea tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:35.167879 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6b537a3-a0d0-498b-a984-2871105131ea tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:35.192628 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f6b537a3-a0d0-498b-a984-2871105131ea tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Going to try to terminate instance {{(pid=117714) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:25:35.440142 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f6b537a3-a0d0-498b-a984-2871105131ea tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "DELETE /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 204 len: 0 microversion: 2.20 time: 0.283453 May 10 21:25:35.440650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1096/1872] 10.222.0.49 () {60 vars in 1279 bytes} [Tue May 10 21:25:35 2022] DELETE /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 21:25:35.445958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4453a6fb-7d67-4be3-bdd5-156ed332607f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '.version_select at 0x7f85d52b9700>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:35.531149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4453a6fb-7d67-4be3-bdd5-156ed332607f tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-401881749" status: 202 len: 0 microversion: 2.1 time: 0.089088 May 10 21:25:35.531794 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1097/1873] 10.222.0.49 () {58 vars in 1217 bytes} [Tue May 10 21:25:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-401881749 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:25:35.536305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a15a598b-1d1a-434b-90be-84aa65530d2e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:35.537028 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a15a598b-1d1a-434b-90be-84aa65530d2e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:35.543271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a15a598b-1d1a-434b-90be-84aa65530d2e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:35.543722 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a15a598b-1d1a-434b-90be-84aa65530d2e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:35.544556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a15a598b-1d1a-434b-90be-84aa65530d2e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:35.544997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a15a598b-1d1a-434b-90be-84aa65530d2e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:35.733402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a15a598b-1d1a-434b-90be-84aa65530d2e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:35.739723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a15a598b-1d1a-434b-90be-84aa65530d2e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:35.741336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a15a598b-1d1a-434b-90be-84aa65530d2e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:35.742593 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a15a598b-1d1a-434b-90be-84aa65530d2e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1803 microversion: 2.20 time: 0.209880 May 10 21:25:35.743180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1098/1874] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:25:35 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1803 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:25:36.027818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-adad4c6a-0331-4555-b371-c6549b65e7eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:36.028362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-adad4c6a-0331-4555-b371-c6549b65e7eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:36.034513 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-adad4c6a-0331-4555-b371-c6549b65e7eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:36.034965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-adad4c6a-0331-4555-b371-c6549b65e7eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:36.035781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-adad4c6a-0331-4555-b371-c6549b65e7eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:36.036224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-adad4c6a-0331-4555-b371-c6549b65e7eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:36.069395 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-adad4c6a-0331-4555-b371-c6549b65e7eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Going to try to terminate instance {{(pid=117714) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:25:36.485730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-adad4c6a-0331-4555-b371-c6549b65e7eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 204 len: 0 microversion: 2.1 time: 0.462321 May 10 21:25:36.489460 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1099/1875] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 21:25:36 2022] DELETE /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 21:25:36.672890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-4337e0bd-d1bc-4785-b380-39bad1a87390 req-4c607ab7-6282-4761-aa68-f6d1ea3a445a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c7c73d-54f3-4695-87bc-4c9d22d5652f", "tag": "b751e302-b05a-4d37-b886-85ba68540b75"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:25:36.685383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-4337e0bd-d1bc-4785-b380-39bad1a87390 req-4c607ab7-6282-4761-aa68-f6d1ea3a445a service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:36.685835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-4337e0bd-d1bc-4785-b380-39bad1a87390 req-4c607ab7-6282-4761-aa68-f6d1ea3a445a service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:36.697728 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-4337e0bd-d1bc-4785-b380-39bad1a87390 req-4c607ab7-6282-4761-aa68-f6d1ea3a445a service nova] Creating event network-changed:b751e302-b05a-4d37-b886-85ba68540b75 for instance d4c7c73d-54f3-4695-87bc-4c9d22d5652f on hv-cinder-82880 May 10 21:25:36.704715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-4337e0bd-d1bc-4785-b380-39bad1a87390 req-4c607ab7-6282-4761-aa68-f6d1ea3a445a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212353 May 10 21:25:36.705634 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1100/1876] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:25:36.711258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0ad4ee7f-d265-4dd8-8c47-55360590b1cb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:25:36.712298 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0ad4ee7f-d265-4dd8-8c47-55360590b1cb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:36.729804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ad4ee7f-d265-4dd8-8c47-55360590b1cb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:36.730372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ad4ee7f-d265-4dd8-8c47-55360590b1cb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:36.735655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ad4ee7f-d265-4dd8-8c47-55360590b1cb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:36.735655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ad4ee7f-d265-4dd8-8c47-55360590b1cb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:36.823361 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0ad4ee7f-d265-4dd8-8c47-55360590b1cb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "POST /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/action" status: 200 len: 41248 microversion: 2.1 time: 0.115480 May 10 21:25:36.835217 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1101/1877] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 21:25:36 2022] POST /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b/action => generated 41248 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:25:36.843472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-65ba17d7-8762-4ddd-a2ef-1be9a1bc113e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:25:36.844634 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-65ba17d7-8762-4ddd-a2ef-1be9a1bc113e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:36.854923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65ba17d7-8762-4ddd-a2ef-1be9a1bc113e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:36.855447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65ba17d7-8762-4ddd-a2ef-1be9a1bc113e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:36.856244 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65ba17d7-8762-4ddd-a2ef-1be9a1bc113e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:36.856691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65ba17d7-8762-4ddd-a2ef-1be9a1bc113e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:36.956522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-65ba17d7-8762-4ddd-a2ef-1be9a1bc113e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "POST /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/action" status: 200 len: 76681 microversion: 2.1 time: 0.118688 May 10 21:25:36.958809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1102/1878] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 21:25:36 2022] POST /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e/action => generated 76681 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 21:25:36.966947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-83053f87-25e2-4d16-ab46-fbb72db6ab3a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:36.968087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-83053f87-25e2-4d16-ab46-fbb72db6ab3a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:36.980842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-83053f87-25e2-4d16-ab46-fbb72db6ab3a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:36.987964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-83053f87-25e2-4d16-ab46-fbb72db6ab3a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:36.987964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-83053f87-25e2-4d16-ab46-fbb72db6ab3a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:36.987964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-83053f87-25e2-4d16-ab46-fbb72db6ab3a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:37.343898 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-83053f87-25e2-4d16-ab46-fbb72db6ab3a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:37.352627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-83053f87-25e2-4d16-ab46-fbb72db6ab3a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1566 microversion: 2.1 time: 0.392412 May 10 21:25:37.353169 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1103/1879] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:25:36 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1566 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:37.358759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-20132dc6-f465-4e82-a610-ef2b249390fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:37.358759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-20132dc6-f465-4e82-a610-ef2b249390fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:37.372346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20132dc6-f465-4e82-a610-ef2b249390fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:37.372891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20132dc6-f465-4e82-a610-ef2b249390fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:37.373792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20132dc6-f465-4e82-a610-ef2b249390fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:37.374455 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20132dc6-f465-4e82-a610-ef2b249390fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:37.520310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-20132dc6-f465-4e82-a610-ef2b249390fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:37.530531 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-20132dc6-f465-4e82-a610-ef2b249390fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:37.532524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-20132dc6-f465-4e82-a610-ef2b249390fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:37.534322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-20132dc6-f465-4e82-a610-ef2b249390fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1735 microversion: 2.20 time: 0.180084 May 10 21:25:37.545714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1104/1880] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:25:37 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:25:37.887191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-4aa5585b-3e5b-45c7-9a80-7d750d86c5da req-2adbd727-9015-477a-8818-b0aa3a534886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688d836a-358b-4815-80e9-f43bd14f5f93", "name": "network-vif-deleted", "tag": "8d78546f-3c5c-4f44-9d56-4eb5e6c1e96f"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:25:37.895963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-4aa5585b-3e5b-45c7-9a80-7d750d86c5da req-2adbd727-9015-477a-8818-b0aa3a534886 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:37.896412 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-4aa5585b-3e5b-45c7-9a80-7d750d86c5da req-2adbd727-9015-477a-8818-b0aa3a534886 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:37.909492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-4aa5585b-3e5b-45c7-9a80-7d750d86c5da req-2adbd727-9015-477a-8818-b0aa3a534886 service nova] Creating event network-vif-deleted:8d78546f-3c5c-4f44-9d56-4eb5e6c1e96f for instance 688d836a-358b-4815-80e9-f43bd14f5f93 on hv-cinder-82880 May 10 21:25:37.920305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-4aa5585b-3e5b-45c7-9a80-7d750d86c5da req-2adbd727-9015-477a-8818-b0aa3a534886 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037748 May 10 21:25:37.923299 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1105/1881] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:25:38.374917 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2981c10f-adc0-4588-86b6-ceda643b5d25 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:38.375777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2981c10f-adc0-4588-86b6-ceda643b5d25 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:38.381964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2981c10f-adc0-4588-86b6-ceda643b5d25 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:38.382418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2981c10f-adc0-4588-86b6-ceda643b5d25 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:38.383216 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2981c10f-adc0-4588-86b6-ceda643b5d25 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:38.383663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2981c10f-adc0-4588-86b6-ceda643b5d25 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:38.450723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2981c10f-adc0-4588-86b6-ceda643b5d25 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:38.458417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2981c10f-adc0-4588-86b6-ceda643b5d25 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1380 microversion: 2.1 time: 0.088207 May 10 21:25:38.458999 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1106/1882] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:25:38 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1380 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:25:38.553047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-86886bef-7895-4c28-af37-60f80a2c3847 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:38.553682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-86886bef-7895-4c28-af37-60f80a2c3847 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:38.560145 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-86886bef-7895-4c28-af37-60f80a2c3847 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:38.560606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-86886bef-7895-4c28-af37-60f80a2c3847 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:38.561396 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-86886bef-7895-4c28-af37-60f80a2c3847 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:38.561971 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-86886bef-7895-4c28-af37-60f80a2c3847 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:38.627189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-86886bef-7895-4c28-af37-60f80a2c3847 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:38.636047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-86886bef-7895-4c28-af37-60f80a2c3847 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:38.637584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-86886bef-7895-4c28-af37-60f80a2c3847 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:38.638759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-86886bef-7895-4c28-af37-60f80a2c3847 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.089908 May 10 21:25:38.639345 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1107/1883] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:25:38 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:25:38.757729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-f9db7de5-f18b-446c-b09b-0db175b5d837 req-b7a791d9-a7ba-41c3-8a75-6d467dc6649c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4c7c73d-54f3-4695-87bc-4c9d22d5652f", "name": "network-vif-deleted", "tag": "b751e302-b05a-4d37-b886-85ba68540b75"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:25:38.766441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-f9db7de5-f18b-446c-b09b-0db175b5d837 req-b7a791d9-a7ba-41c3-8a75-6d467dc6649c service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:38.766882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-f9db7de5-f18b-446c-b09b-0db175b5d837 req-b7a791d9-a7ba-41c3-8a75-6d467dc6649c service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:38.777609 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-f9db7de5-f18b-446c-b09b-0db175b5d837 req-b7a791d9-a7ba-41c3-8a75-6d467dc6649c service nova] Creating event network-vif-deleted:b751e302-b05a-4d37-b886-85ba68540b75 for instance d4c7c73d-54f3-4695-87bc-4c9d22d5652f on hv-cinder-82880 May 10 21:25:38.783239 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-f9db7de5-f18b-446c-b09b-0db175b5d837 req-b7a791d9-a7ba-41c3-8a75-6d467dc6649c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030144 May 10 21:25:38.783841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1108/1884] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:25:39.476570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4f140d95-2f2e-47ea-8c60-403957aea811 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:39.477308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4f140d95-2f2e-47ea-8c60-403957aea811 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:39.483649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f140d95-2f2e-47ea-8c60-403957aea811 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:39.484135 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f140d95-2f2e-47ea-8c60-403957aea811 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:39.484901 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f140d95-2f2e-47ea-8c60-403957aea811 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:39.485340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f140d95-2f2e-47ea-8c60-403957aea811 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:39.547371 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4f140d95-2f2e-47ea-8c60-403957aea811 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:39.554609 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4f140d95-2f2e-47ea-8c60-403957aea811 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082761 May 10 21:25:39.555536 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1109/1885] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:25:39 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:25:39.656589 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0f4d8f58-8d47-4250-9614-a57ed4ff365b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:39.657204 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0f4d8f58-8d47-4250-9614-a57ed4ff365b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:39.663312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f4d8f58-8d47-4250-9614-a57ed4ff365b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:39.663769 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f4d8f58-8d47-4250-9614-a57ed4ff365b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:39.664539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f4d8f58-8d47-4250-9614-a57ed4ff365b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:39.664985 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f4d8f58-8d47-4250-9614-a57ed4ff365b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:39.724296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0f4d8f58-8d47-4250-9614-a57ed4ff365b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:39.732568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0f4d8f58-8d47-4250-9614-a57ed4ff365b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:39.734023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0f4d8f58-8d47-4250-9614-a57ed4ff365b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:39.735192 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0f4d8f58-8d47-4250-9614-a57ed4ff365b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.082596 May 10 21:25:39.735764 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1110/1886] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:25:39 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:25:40.571457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c3ce50e9-aa7e-43be-b598-d7c03f5c2e46 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:40.572113 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c3ce50e9-aa7e-43be-b598-d7c03f5c2e46 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:40.578739 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c3ce50e9-aa7e-43be-b598-d7c03f5c2e46 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:40.579237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c3ce50e9-aa7e-43be-b598-d7c03f5c2e46 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:40.580013 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c3ce50e9-aa7e-43be-b598-d7c03f5c2e46 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:40.580455 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c3ce50e9-aa7e-43be-b598-d7c03f5c2e46 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:40.644381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c3ce50e9-aa7e-43be-b598-d7c03f5c2e46 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:40.652342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c3ce50e9-aa7e-43be-b598-d7c03f5c2e46 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.084857 May 10 21:25:40.652913 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1111/1887] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:25:40 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:25:40.753720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-eb7ec6b7-cc83-4a62-903d-085bceca6fa0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:40.754330 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-eb7ec6b7-cc83-4a62-903d-085bceca6fa0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:40.760855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eb7ec6b7-cc83-4a62-903d-085bceca6fa0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:40.761335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eb7ec6b7-cc83-4a62-903d-085bceca6fa0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:40.762085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eb7ec6b7-cc83-4a62-903d-085bceca6fa0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:40.762519 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eb7ec6b7-cc83-4a62-903d-085bceca6fa0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:40.821098 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-eb7ec6b7-cc83-4a62-903d-085bceca6fa0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:40.830084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-eb7ec6b7-cc83-4a62-903d-085bceca6fa0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:40.831605 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-eb7ec6b7-cc83-4a62-903d-085bceca6fa0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:40.832734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-eb7ec6b7-cc83-4a62-903d-085bceca6fa0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083005 May 10 21:25:40.833291 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1112/1888] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:25:40 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:25:41.669302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-38903388-c94c-4937-ab43-3685d1066bb0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:41.669928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-38903388-c94c-4937-ab43-3685d1066bb0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:41.676351 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38903388-c94c-4937-ab43-3685d1066bb0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:41.676812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38903388-c94c-4937-ab43-3685d1066bb0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:41.677577 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38903388-c94c-4937-ab43-3685d1066bb0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:41.678020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38903388-c94c-4937-ab43-3685d1066bb0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:41.738750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-38903388-c94c-4937-ab43-3685d1066bb0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:41.746658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-38903388-c94c-4937-ab43-3685d1066bb0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081333 May 10 21:25:41.747236 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1113/1889] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:25:41 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:25:41.851222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8b205900-9ad4-43a8-8b2a-3d4be12e9f8d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:41.851825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8b205900-9ad4-43a8-8b2a-3d4be12e9f8d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:41.858355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8b205900-9ad4-43a8-8b2a-3d4be12e9f8d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:41.858773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8b205900-9ad4-43a8-8b2a-3d4be12e9f8d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:41.859556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8b205900-9ad4-43a8-8b2a-3d4be12e9f8d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:41.859999 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8b205900-9ad4-43a8-8b2a-3d4be12e9f8d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:41.920423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8b205900-9ad4-43a8-8b2a-3d4be12e9f8d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:41.928935 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8b205900-9ad4-43a8-8b2a-3d4be12e9f8d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:41.930486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8b205900-9ad4-43a8-8b2a-3d4be12e9f8d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:41.931704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8b205900-9ad4-43a8-8b2a-3d4be12e9f8d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084285 May 10 21:25:41.932362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1114/1890] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:25:41 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:25:42.764581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0772cce2-1fe3-4ef9-8251-925b79c6a673 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:42.765222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0772cce2-1fe3-4ef9-8251-925b79c6a673 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:42.771687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0772cce2-1fe3-4ef9-8251-925b79c6a673 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:42.772140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0772cce2-1fe3-4ef9-8251-925b79c6a673 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:42.772904 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0772cce2-1fe3-4ef9-8251-925b79c6a673 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:42.773341 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0772cce2-1fe3-4ef9-8251-925b79c6a673 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:42.837127 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0772cce2-1fe3-4ef9-8251-925b79c6a673 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:42.844521 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0772cce2-1fe3-4ef9-8251-925b79c6a673 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.084781 May 10 21:25:42.845090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1115/1891] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:25:42 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:25:42.949882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-18881c26-30a2-4a80-9ad5-cf957f3e6ca5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:42.950488 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-18881c26-30a2-4a80-9ad5-cf957f3e6ca5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:42.956719 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-18881c26-30a2-4a80-9ad5-cf957f3e6ca5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:42.957174 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-18881c26-30a2-4a80-9ad5-cf957f3e6ca5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:42.957933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-18881c26-30a2-4a80-9ad5-cf957f3e6ca5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:42.958377 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-18881c26-30a2-4a80-9ad5-cf957f3e6ca5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:43.019329 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-18881c26-30a2-4a80-9ad5-cf957f3e6ca5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:43.028540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-18881c26-30a2-4a80-9ad5-cf957f3e6ca5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:43.030047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-18881c26-30a2-4a80-9ad5-cf957f3e6ca5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:43.031202 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-18881c26-30a2-4a80-9ad5-cf957f3e6ca5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085352 May 10 21:25:43.031790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1116/1892] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:25:42 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:25:43.861766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-afcbc618-b230-4111-809d-130389b2f186 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:43.862427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-afcbc618-b230-4111-809d-130389b2f186 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:43.868795 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-afcbc618-b230-4111-809d-130389b2f186 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:43.869239 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-afcbc618-b230-4111-809d-130389b2f186 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:43.870001 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-afcbc618-b230-4111-809d-130389b2f186 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:43.870519 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-afcbc618-b230-4111-809d-130389b2f186 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:43.931427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-afcbc618-b230-4111-809d-130389b2f186 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:43.939176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-afcbc618-b230-4111-809d-130389b2f186 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081603 May 10 21:25:43.939740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1117/1893] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:25:43 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:25:44.048717 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-65826cf0-84b8-42de-a084-8723e6f69e20 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:44.049320 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-65826cf0-84b8-42de-a084-8723e6f69e20 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:44.055257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65826cf0-84b8-42de-a084-8723e6f69e20 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:44.055704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65826cf0-84b8-42de-a084-8723e6f69e20 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:44.056452 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65826cf0-84b8-42de-a084-8723e6f69e20 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:44.056882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65826cf0-84b8-42de-a084-8723e6f69e20 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:44.117299 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-65826cf0-84b8-42de-a084-8723e6f69e20 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:44.126130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-65826cf0-84b8-42de-a084-8723e6f69e20 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:44.127657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-65826cf0-84b8-42de-a084-8723e6f69e20 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:44.128782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-65826cf0-84b8-42de-a084-8723e6f69e20 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083937 May 10 21:25:44.129345 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1118/1894] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:25:44 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:25:44.957128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-700d010c-97cf-45e4-907b-e2d108b421ad tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:44.957775 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-700d010c-97cf-45e4-907b-e2d108b421ad tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:44.964167 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-700d010c-97cf-45e4-907b-e2d108b421ad tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:44.964618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-700d010c-97cf-45e4-907b-e2d108b421ad tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:44.965373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-700d010c-97cf-45e4-907b-e2d108b421ad tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:44.965810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-700d010c-97cf-45e4-907b-e2d108b421ad tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:45.031210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-700d010c-97cf-45e4-907b-e2d108b421ad tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:45.038652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-700d010c-97cf-45e4-907b-e2d108b421ad tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.085410 May 10 21:25:45.039234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1119/1895] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:25:44 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:25:45.146945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8fe52eb7-24fb-47be-b8ab-d540453a7b68 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:45.147604 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8fe52eb7-24fb-47be-b8ab-d540453a7b68 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:45.154137 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8fe52eb7-24fb-47be-b8ab-d540453a7b68 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:45.154580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8fe52eb7-24fb-47be-b8ab-d540453a7b68 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:45.155361 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8fe52eb7-24fb-47be-b8ab-d540453a7b68 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:45.155791 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8fe52eb7-24fb-47be-b8ab-d540453a7b68 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:45.215313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8fe52eb7-24fb-47be-b8ab-d540453a7b68 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:45.223443 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8fe52eb7-24fb-47be-b8ab-d540453a7b68 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:45.224938 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8fe52eb7-24fb-47be-b8ab-d540453a7b68 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:45.226067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8fe52eb7-24fb-47be-b8ab-d540453a7b68 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.082923 May 10 21:25:45.226633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1120/1896] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:25:45 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:25:46.056682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3480c04d-c206-47f5-a67e-43aba082ae14 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:46.057947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3480c04d-c206-47f5-a67e-43aba082ae14 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:46.064217 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3480c04d-c206-47f5-a67e-43aba082ae14 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:46.065783 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3480c04d-c206-47f5-a67e-43aba082ae14 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:46.065783 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3480c04d-c206-47f5-a67e-43aba082ae14 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:46.065994 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3480c04d-c206-47f5-a67e-43aba082ae14 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:46.127907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3480c04d-c206-47f5-a67e-43aba082ae14 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:46.136074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3480c04d-c206-47f5-a67e-43aba082ae14 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082696 May 10 21:25:46.136745 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1121/1897] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:25:46 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:25:46.243893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e54d3e08-b083-445a-9955-c04607d1a32e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:46.244982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e54d3e08-b083-445a-9955-c04607d1a32e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:46.250955 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e54d3e08-b083-445a-9955-c04607d1a32e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:46.251444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e54d3e08-b083-445a-9955-c04607d1a32e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:46.252220 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e54d3e08-b083-445a-9955-c04607d1a32e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:46.252659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e54d3e08-b083-445a-9955-c04607d1a32e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:46.312418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e54d3e08-b083-445a-9955-c04607d1a32e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:46.320574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e54d3e08-b083-445a-9955-c04607d1a32e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:46.322092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e54d3e08-b083-445a-9955-c04607d1a32e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:46.323903 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e54d3e08-b083-445a-9955-c04607d1a32e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083869 May 10 21:25:46.324469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1122/1898] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:25:46 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:25:47.153162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-13290938-600b-4310-957c-76a7c2bce139 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:47.153808 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-13290938-600b-4310-957c-76a7c2bce139 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:47.160070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-13290938-600b-4310-957c-76a7c2bce139 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:47.160517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-13290938-600b-4310-957c-76a7c2bce139 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:47.161268 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-13290938-600b-4310-957c-76a7c2bce139 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:47.161703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-13290938-600b-4310-957c-76a7c2bce139 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:47.225088 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-13290938-600b-4310-957c-76a7c2bce139 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:47.232519 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-13290938-600b-4310-957c-76a7c2bce139 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083398 May 10 21:25:47.233077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1123/1899] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:25:47 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:25:47.341858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0fee286b-9cc4-4af8-97b6-4af1cf839d4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:47.342464 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0fee286b-9cc4-4af8-97b6-4af1cf839d4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:47.348339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0fee286b-9cc4-4af8-97b6-4af1cf839d4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:47.348793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0fee286b-9cc4-4af8-97b6-4af1cf839d4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:47.349551 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0fee286b-9cc4-4af8-97b6-4af1cf839d4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:47.349991 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0fee286b-9cc4-4af8-97b6-4af1cf839d4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:47.409240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0fee286b-9cc4-4af8-97b6-4af1cf839d4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:47.418461 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0fee286b-9cc4-4af8-97b6-4af1cf839d4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:47.420004 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0fee286b-9cc4-4af8-97b6-4af1cf839d4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:47.421148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0fee286b-9cc4-4af8-97b6-4af1cf839d4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083390 May 10 21:25:47.421709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1124/1900] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:25:47 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:25:48.249358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a3c82261-d8db-446c-9f8f-d79dbd96c204 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:48.250065 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a3c82261-d8db-446c-9f8f-d79dbd96c204 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:48.256288 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a3c82261-d8db-446c-9f8f-d79dbd96c204 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:48.256735 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a3c82261-d8db-446c-9f8f-d79dbd96c204 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:48.257519 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a3c82261-d8db-446c-9f8f-d79dbd96c204 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:48.257953 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a3c82261-d8db-446c-9f8f-d79dbd96c204 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:48.319485 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a3c82261-d8db-446c-9f8f-d79dbd96c204 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:48.327613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a3c82261-d8db-446c-9f8f-d79dbd96c204 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081849 May 10 21:25:48.328186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1125/1901] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:25:48 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:25:48.438666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-24659627-749f-44b9-a0f0-181b6521620a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:48.439307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-24659627-749f-44b9-a0f0-181b6521620a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:48.445025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-24659627-749f-44b9-a0f0-181b6521620a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:48.445479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-24659627-749f-44b9-a0f0-181b6521620a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:48.446251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-24659627-749f-44b9-a0f0-181b6521620a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:48.446692 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-24659627-749f-44b9-a0f0-181b6521620a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:48.507405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-24659627-749f-44b9-a0f0-181b6521620a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:48.516164 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-24659627-749f-44b9-a0f0-181b6521620a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:48.517660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-24659627-749f-44b9-a0f0-181b6521620a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:48.518785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-24659627-749f-44b9-a0f0-181b6521620a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083766 May 10 21:25:48.519386 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1126/1902] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:25:48 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:25:49.344835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-754829a9-68ff-4f8b-96e5-0b51359691a6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:49.345507 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-754829a9-68ff-4f8b-96e5-0b51359691a6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:49.351790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-754829a9-68ff-4f8b-96e5-0b51359691a6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:49.352239 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-754829a9-68ff-4f8b-96e5-0b51359691a6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:49.352987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-754829a9-68ff-4f8b-96e5-0b51359691a6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:49.353420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-754829a9-68ff-4f8b-96e5-0b51359691a6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:49.417013 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-754829a9-68ff-4f8b-96e5-0b51359691a6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:49.424437 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-754829a9-68ff-4f8b-96e5-0b51359691a6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083605 May 10 21:25:49.424996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1127/1903] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:25:49 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:25:49.536296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-03533904-0167-4025-afcf-2f0605eda2ae tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:49.536896 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-03533904-0167-4025-afcf-2f0605eda2ae tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:49.543308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03533904-0167-4025-afcf-2f0605eda2ae tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:49.543761 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03533904-0167-4025-afcf-2f0605eda2ae tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:49.544512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03533904-0167-4025-afcf-2f0605eda2ae tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:49.544947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03533904-0167-4025-afcf-2f0605eda2ae tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:49.604571 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-03533904-0167-4025-afcf-2f0605eda2ae tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:49.612866 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-03533904-0167-4025-afcf-2f0605eda2ae tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:49.614357 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-03533904-0167-4025-afcf-2f0605eda2ae tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:49.615512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-03533904-0167-4025-afcf-2f0605eda2ae tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.082923 May 10 21:25:49.616057 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1128/1904] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:25:49 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:25:50.441967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9d4790ed-05ba-426c-83c0-991c63a6a6d5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:50.442821 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9d4790ed-05ba-426c-83c0-991c63a6a6d5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:50.449673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9d4790ed-05ba-426c-83c0-991c63a6a6d5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:50.450125 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9d4790ed-05ba-426c-83c0-991c63a6a6d5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:50.450883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9d4790ed-05ba-426c-83c0-991c63a6a6d5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:50.451353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9d4790ed-05ba-426c-83c0-991c63a6a6d5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:50.512335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9d4790ed-05ba-426c-83c0-991c63a6a6d5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:50.519885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9d4790ed-05ba-426c-83c0-991c63a6a6d5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081775 May 10 21:25:50.520450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1129/1905] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:25:50 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:25:50.633710 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-334d5422-ca8a-4aca-b5f1-3487e34991c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:50.634321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-334d5422-ca8a-4aca-b5f1-3487e34991c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:50.641330 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-334d5422-ca8a-4aca-b5f1-3487e34991c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:50.641779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-334d5422-ca8a-4aca-b5f1-3487e34991c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:50.642550 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-334d5422-ca8a-4aca-b5f1-3487e34991c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:50.642993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-334d5422-ca8a-4aca-b5f1-3487e34991c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:50.705014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-334d5422-ca8a-4aca-b5f1-3487e34991c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:50.713278 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-334d5422-ca8a-4aca-b5f1-3487e34991c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:50.715267 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-334d5422-ca8a-4aca-b5f1-3487e34991c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:50.716403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-334d5422-ca8a-4aca-b5f1-3487e34991c1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086617 May 10 21:25:50.716957 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1130/1906] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:25:50 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:25:51.537422 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-19481621-32b8-45aa-8046-10141dca31e1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:51.538075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-19481621-32b8-45aa-8046-10141dca31e1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:51.544407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-19481621-32b8-45aa-8046-10141dca31e1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:51.544855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-19481621-32b8-45aa-8046-10141dca31e1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:51.545613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-19481621-32b8-45aa-8046-10141dca31e1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:51.546047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-19481621-32b8-45aa-8046-10141dca31e1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:51.610539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-19481621-32b8-45aa-8046-10141dca31e1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:51.617976 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-19481621-32b8-45aa-8046-10141dca31e1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.084434 May 10 21:25:51.618535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1131/1907] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:25:51 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:25:51.734128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d8fbf4d6-ca2f-49b2-aea4-8908f539650e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:51.734762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d8fbf4d6-ca2f-49b2-aea4-8908f539650e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:51.740666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d8fbf4d6-ca2f-49b2-aea4-8908f539650e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:51.741107 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d8fbf4d6-ca2f-49b2-aea4-8908f539650e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:51.741857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d8fbf4d6-ca2f-49b2-aea4-8908f539650e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:51.742291 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d8fbf4d6-ca2f-49b2-aea4-8908f539650e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:51.802148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d8fbf4d6-ca2f-49b2-aea4-8908f539650e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:51.811442 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d8fbf4d6-ca2f-49b2-aea4-8908f539650e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:51.812955 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d8fbf4d6-ca2f-49b2-aea4-8908f539650e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:51.814096 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d8fbf4d6-ca2f-49b2-aea4-8908f539650e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083715 May 10 21:25:51.814651 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1132/1908] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:25:51 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:25:52.635406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fdf01a9e-ed54-4ff2-a0c5-7a758d3b3ac6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:52.636554 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fdf01a9e-ed54-4ff2-a0c5-7a758d3b3ac6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:52.642882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fdf01a9e-ed54-4ff2-a0c5-7a758d3b3ac6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:52.643371 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fdf01a9e-ed54-4ff2-a0c5-7a758d3b3ac6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:52.646676 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fdf01a9e-ed54-4ff2-a0c5-7a758d3b3ac6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:52.646676 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fdf01a9e-ed54-4ff2-a0c5-7a758d3b3ac6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:52.706565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fdf01a9e-ed54-4ff2-a0c5-7a758d3b3ac6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:52.713906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fdf01a9e-ed54-4ff2-a0c5-7a758d3b3ac6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082395 May 10 21:25:52.714470 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1133/1909] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:25:52 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:25:52.832089 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5f6216c1-5ec3-46ae-b303-52ba041279ce tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:52.832626 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5f6216c1-5ec3-46ae-b303-52ba041279ce tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:52.838409 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f6216c1-5ec3-46ae-b303-52ba041279ce tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:52.838862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f6216c1-5ec3-46ae-b303-52ba041279ce tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:52.839662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f6216c1-5ec3-46ae-b303-52ba041279ce tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:52.840746 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f6216c1-5ec3-46ae-b303-52ba041279ce tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:52.901213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5f6216c1-5ec3-46ae-b303-52ba041279ce tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:52.909639 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5f6216c1-5ec3-46ae-b303-52ba041279ce tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:52.911173 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5f6216c1-5ec3-46ae-b303-52ba041279ce tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:52.912320 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5f6216c1-5ec3-46ae-b303-52ba041279ce tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084021 May 10 21:25:52.912883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1134/1910] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:25:52 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:25:53.731061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2a70c3dd-717a-469e-9a24-03cb1babcc3c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:53.731735 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2a70c3dd-717a-469e-9a24-03cb1babcc3c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:53.737963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2a70c3dd-717a-469e-9a24-03cb1babcc3c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:53.738405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2a70c3dd-717a-469e-9a24-03cb1babcc3c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:53.739181 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2a70c3dd-717a-469e-9a24-03cb1babcc3c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:53.739619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2a70c3dd-717a-469e-9a24-03cb1babcc3c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:53.801640 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2a70c3dd-717a-469e-9a24-03cb1babcc3c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:53.809565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2a70c3dd-717a-469e-9a24-03cb1babcc3c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081776 May 10 21:25:53.810155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1135/1911] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:25:53 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:25:53.930306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b9d3cddb-1d0e-4398-ace5-a167528c20a6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:53.930840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b9d3cddb-1d0e-4398-ace5-a167528c20a6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:53.937505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b9d3cddb-1d0e-4398-ace5-a167528c20a6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:53.937987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b9d3cddb-1d0e-4398-ace5-a167528c20a6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:53.938752 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b9d3cddb-1d0e-4398-ace5-a167528c20a6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:53.939232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b9d3cddb-1d0e-4398-ace5-a167528c20a6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:54.000413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b9d3cddb-1d0e-4398-ace5-a167528c20a6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:54.008847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b9d3cddb-1d0e-4398-ace5-a167528c20a6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:54.010363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b9d3cddb-1d0e-4398-ace5-a167528c20a6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:54.011546 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b9d3cddb-1d0e-4398-ace5-a167528c20a6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085132 May 10 21:25:54.012136 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1136/1912] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:25:53 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:25:54.826840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4cae4e9a-cf20-42ad-86e6-ac3e10ef432a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:54.827746 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4cae4e9a-cf20-42ad-86e6-ac3e10ef432a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:54.834015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4cae4e9a-cf20-42ad-86e6-ac3e10ef432a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:54.834468 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4cae4e9a-cf20-42ad-86e6-ac3e10ef432a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:54.835264 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4cae4e9a-cf20-42ad-86e6-ac3e10ef432a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:54.835702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4cae4e9a-cf20-42ad-86e6-ac3e10ef432a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:54.897168 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4cae4e9a-cf20-42ad-86e6-ac3e10ef432a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:54.905831 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4cae4e9a-cf20-42ad-86e6-ac3e10ef432a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083864 May 10 21:25:54.906403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1137/1913] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:25:54 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:25:55.031230 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bfc2157d-291f-4da3-9eb8-e83bcabb269c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:55.031845 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bfc2157d-291f-4da3-9eb8-e83bcabb269c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:55.037959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfc2157d-291f-4da3-9eb8-e83bcabb269c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:55.038420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfc2157d-291f-4da3-9eb8-e83bcabb269c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:55.039222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfc2157d-291f-4da3-9eb8-e83bcabb269c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:55.039670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfc2157d-291f-4da3-9eb8-e83bcabb269c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:55.099638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bfc2157d-291f-4da3-9eb8-e83bcabb269c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:55.109380 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bfc2157d-291f-4da3-9eb8-e83bcabb269c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:55.110908 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bfc2157d-291f-4da3-9eb8-e83bcabb269c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:55.112678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bfc2157d-291f-4da3-9eb8-e83bcabb269c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086007 May 10 21:25:55.113620 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1138/1914] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:25:55 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:25:55.922477 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3982b135-4f4d-4914-94c6-3824b0811305 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:55.923153 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3982b135-4f4d-4914-94c6-3824b0811305 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:55.928983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3982b135-4f4d-4914-94c6-3824b0811305 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:55.929433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3982b135-4f4d-4914-94c6-3824b0811305 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:55.930190 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3982b135-4f4d-4914-94c6-3824b0811305 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:55.930624 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3982b135-4f4d-4914-94c6-3824b0811305 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:55.993035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3982b135-4f4d-4914-94c6-3824b0811305 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:56.001008 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3982b135-4f4d-4914-94c6-3824b0811305 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083156 May 10 21:25:56.001575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1139/1915] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:25:55 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:25:56.131702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4d95dfde-f1ca-4a07-ad26-f62fd15d69e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:56.132314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4d95dfde-f1ca-4a07-ad26-f62fd15d69e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:56.139244 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4d95dfde-f1ca-4a07-ad26-f62fd15d69e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:56.139695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4d95dfde-f1ca-4a07-ad26-f62fd15d69e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:56.140457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4d95dfde-f1ca-4a07-ad26-f62fd15d69e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:56.140902 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4d95dfde-f1ca-4a07-ad26-f62fd15d69e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:56.200522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4d95dfde-f1ca-4a07-ad26-f62fd15d69e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:56.209075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4d95dfde-f1ca-4a07-ad26-f62fd15d69e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:56.210578 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4d95dfde-f1ca-4a07-ad26-f62fd15d69e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:56.211751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4d95dfde-f1ca-4a07-ad26-f62fd15d69e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083970 May 10 21:25:56.212512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1140/1916] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:25:56 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:25:57.018723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a95ec924-2495-4e31-9cfd-5abbe19ddeff tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:57.019369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a95ec924-2495-4e31-9cfd-5abbe19ddeff tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:57.025603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a95ec924-2495-4e31-9cfd-5abbe19ddeff tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:57.026067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a95ec924-2495-4e31-9cfd-5abbe19ddeff tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:57.026814 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a95ec924-2495-4e31-9cfd-5abbe19ddeff tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:57.027276 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a95ec924-2495-4e31-9cfd-5abbe19ddeff tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:57.091185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a95ec924-2495-4e31-9cfd-5abbe19ddeff tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:57.098575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a95ec924-2495-4e31-9cfd-5abbe19ddeff tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083739 May 10 21:25:57.099141 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1141/1917] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:25:57 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:25:57.141905 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-348c1b59-ab6d-410b-8fb1-d80a4832fb41 tempest-TestVolumeBootPattern-1764075483 tempest-TestVolumeBootPattern-1764075483-project] Calling method '.version_select at 0x7f85da66b4c0>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:57.212134 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-348c1b59-ab6d-410b-8fb1-d80a4832fb41 tempest-TestVolumeBootPattern-1764075483 tempest-TestVolumeBootPattern-1764075483-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1775997954" status: 202 len: 0 microversion: 2.1 time: 0.073965 May 10 21:25:57.212723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1142/1918] 10.222.0.49 () {58 vars in 1262 bytes} [Tue May 10 21:25:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1775997954 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 21:25:57.228636 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-48a07728-dc8b-46a4-bebd-47ee5ab6672c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:57.229259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-48a07728-dc8b-46a4-bebd-47ee5ab6672c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:57.235994 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-48a07728-dc8b-46a4-bebd-47ee5ab6672c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:57.236455 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-48a07728-dc8b-46a4-bebd-47ee5ab6672c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:57.237228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-48a07728-dc8b-46a4-bebd-47ee5ab6672c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:57.237668 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-48a07728-dc8b-46a4-bebd-47ee5ab6672c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:57.307229 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-48a07728-dc8b-46a4-bebd-47ee5ab6672c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:57.315958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-48a07728-dc8b-46a4-bebd-47ee5ab6672c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:57.317457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-48a07728-dc8b-46a4-bebd-47ee5ab6672c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:57.318594 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-48a07728-dc8b-46a4-bebd-47ee5ab6672c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.093763 May 10 21:25:57.319170 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1143/1919] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:25:57 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:25:58.116619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c7c8a1a8-4fe4-496e-9e6d-afa69521fa1e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:58.117362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c7c8a1a8-4fe4-496e-9e6d-afa69521fa1e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:58.124972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c7c8a1a8-4fe4-496e-9e6d-afa69521fa1e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:58.125433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c7c8a1a8-4fe4-496e-9e6d-afa69521fa1e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:58.126244 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c7c8a1a8-4fe4-496e-9e6d-afa69521fa1e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:58.126684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c7c8a1a8-4fe4-496e-9e6d-afa69521fa1e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:58.193832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c7c8a1a8-4fe4-496e-9e6d-afa69521fa1e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:58.202230 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c7c8a1a8-4fe4-496e-9e6d-afa69521fa1e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.089580 May 10 21:25:58.203065 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1144/1920] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:25:58 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:25:58.336346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-16941980-6c23-4e8b-bf4d-0f3536bc880e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:58.336965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-16941980-6c23-4e8b-bf4d-0f3536bc880e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:58.343661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-16941980-6c23-4e8b-bf4d-0f3536bc880e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:58.344124 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-16941980-6c23-4e8b-bf4d-0f3536bc880e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:58.344902 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-16941980-6c23-4e8b-bf4d-0f3536bc880e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:58.345344 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-16941980-6c23-4e8b-bf4d-0f3536bc880e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:58.405543 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-16941980-6c23-4e8b-bf4d-0f3536bc880e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:58.413862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-16941980-6c23-4e8b-bf4d-0f3536bc880e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:58.415432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-16941980-6c23-4e8b-bf4d-0f3536bc880e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:58.416571 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-16941980-6c23-4e8b-bf4d-0f3536bc880e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084230 May 10 21:25:58.417139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1145/1921] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:25:58 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:25:59.219967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f9b0344e-8818-41f9-8cc0-b461644c6164 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:59.220663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f9b0344e-8818-41f9-8cc0-b461644c6164 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:59.227160 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f9b0344e-8818-41f9-8cc0-b461644c6164 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:59.227892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f9b0344e-8818-41f9-8cc0-b461644c6164 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:59.228721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f9b0344e-8818-41f9-8cc0-b461644c6164 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:59.229419 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f9b0344e-8818-41f9-8cc0-b461644c6164 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:59.292878 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f9b0344e-8818-41f9-8cc0-b461644c6164 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:59.301321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f9b0344e-8818-41f9-8cc0-b461644c6164 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.085290 May 10 21:25:59.311163 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1146/1922] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:25:59 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:25:59.436049 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6cd89985-07e4-464a-9c1a-546a1f0d2d16 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:25:59.436665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6cd89985-07e4-464a-9c1a-546a1f0d2d16 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:25:59.442878 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6cd89985-07e4-464a-9c1a-546a1f0d2d16 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:59.443587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6cd89985-07e4-464a-9c1a-546a1f0d2d16 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:59.444538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6cd89985-07e4-464a-9c1a-546a1f0d2d16 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:25:59.444967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6cd89985-07e4-464a-9c1a-546a1f0d2d16 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:25:59.509723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6cd89985-07e4-464a-9c1a-546a1f0d2d16 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:59.523090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6cd89985-07e4-464a-9c1a-546a1f0d2d16 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:59.524749 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6cd89985-07e4-464a-9c1a-546a1f0d2d16 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:25:59.525925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6cd89985-07e4-464a-9c1a-546a1f0d2d16 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.094626 May 10 21:25:59.526619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1147/1923] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:25:59 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:00.319602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e5af898b-b58f-4549-8be7-344294ec5534 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:00.320249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e5af898b-b58f-4549-8be7-344294ec5534 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:00.327101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e5af898b-b58f-4549-8be7-344294ec5534 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:00.327793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e5af898b-b58f-4549-8be7-344294ec5534 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:00.328557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e5af898b-b58f-4549-8be7-344294ec5534 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:00.328990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e5af898b-b58f-4549-8be7-344294ec5534 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:00.406752 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e5af898b-b58f-4549-8be7-344294ec5534 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:00.415743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e5af898b-b58f-4549-8be7-344294ec5534 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.100177 May 10 21:26:00.416724 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1148/1924] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:00 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:26:00.543036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4a004973-f206-42d0-b920-e04415ccc327 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:00.544580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4a004973-f206-42d0-b920-e04415ccc327 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:00.550657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a004973-f206-42d0-b920-e04415ccc327 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:00.551356 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a004973-f206-42d0-b920-e04415ccc327 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:00.552500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a004973-f206-42d0-b920-e04415ccc327 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:00.553093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a004973-f206-42d0-b920-e04415ccc327 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:00.628061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4a004973-f206-42d0-b920-e04415ccc327 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:00.653118 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4a004973-f206-42d0-b920-e04415ccc327 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:00.654683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4a004973-f206-42d0-b920-e04415ccc327 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:00.655923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4a004973-f206-42d0-b920-e04415ccc327 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.117027 May 10 21:26:00.666856 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1149/1925] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:00 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:01.433199 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2ee71c2d-0e99-44c2-bd0d-f7f79e413a27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:01.435260 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2ee71c2d-0e99-44c2-bd0d-f7f79e413a27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:01.441330 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ee71c2d-0e99-44c2-bd0d-f7f79e413a27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:01.441780 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ee71c2d-0e99-44c2-bd0d-f7f79e413a27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:01.442578 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ee71c2d-0e99-44c2-bd0d-f7f79e413a27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:01.443012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ee71c2d-0e99-44c2-bd0d-f7f79e413a27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:01.665925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2ee71c2d-0e99-44c2-bd0d-f7f79e413a27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:01.674001 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2ee71c2d-0e99-44c2-bd0d-f7f79e413a27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.245084 May 10 21:26:01.674575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1150/1926] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:01 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:01.679017 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-469401a7-919a-41e9-861d-1387f666d2dc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:01.679654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-469401a7-919a-41e9-861d-1387f666d2dc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:01.686157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-469401a7-919a-41e9-861d-1387f666d2dc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:01.686540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-469401a7-919a-41e9-861d-1387f666d2dc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:01.687376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-469401a7-919a-41e9-861d-1387f666d2dc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:01.687822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-469401a7-919a-41e9-861d-1387f666d2dc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:01.972120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-469401a7-919a-41e9-861d-1387f666d2dc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:01.980363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-469401a7-919a-41e9-861d-1387f666d2dc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:01.982693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-469401a7-919a-41e9-861d-1387f666d2dc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:01.983885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-469401a7-919a-41e9-861d-1387f666d2dc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.308396 May 10 21:26:01.984650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1151/1927] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:01 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:02.691703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b3b09f1b-a66b-43eb-a5a2-ba086f4b291e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:02.692451 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b3b09f1b-a66b-43eb-a5a2-ba086f4b291e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:02.699089 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3b09f1b-a66b-43eb-a5a2-ba086f4b291e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:02.700517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3b09f1b-a66b-43eb-a5a2-ba086f4b291e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:02.701554 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3b09f1b-a66b-43eb-a5a2-ba086f4b291e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:02.702089 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3b09f1b-a66b-43eb-a5a2-ba086f4b291e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:02.789803 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b3b09f1b-a66b-43eb-a5a2-ba086f4b291e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:02.797302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b3b09f1b-a66b-43eb-a5a2-ba086f4b291e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.109708 May 10 21:26:02.797870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1152/1928] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:02 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:03.002528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6a0fdc35-ab25-4fab-a7c7-29ff4fb40986 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:03.003057 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6a0fdc35-ab25-4fab-a7c7-29ff4fb40986 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:03.009069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a0fdc35-ab25-4fab-a7c7-29ff4fb40986 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:03.009524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a0fdc35-ab25-4fab-a7c7-29ff4fb40986 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:03.010293 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a0fdc35-ab25-4fab-a7c7-29ff4fb40986 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:03.010732 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a0fdc35-ab25-4fab-a7c7-29ff4fb40986 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:03.091953 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6a0fdc35-ab25-4fab-a7c7-29ff4fb40986 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:03.100023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6a0fdc35-ab25-4fab-a7c7-29ff4fb40986 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:03.101537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6a0fdc35-ab25-4fab-a7c7-29ff4fb40986 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:03.102684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6a0fdc35-ab25-4fab-a7c7-29ff4fb40986 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.104284 May 10 21:26:03.103300 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1153/1929] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:02 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:03.815904 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a1018336-be0c-46b9-a27e-0760d12b5089 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:03.816681 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a1018336-be0c-46b9-a27e-0760d12b5089 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:03.823343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a1018336-be0c-46b9-a27e-0760d12b5089 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:03.823813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a1018336-be0c-46b9-a27e-0760d12b5089 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:03.824730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a1018336-be0c-46b9-a27e-0760d12b5089 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:03.825341 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a1018336-be0c-46b9-a27e-0760d12b5089 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:03.889616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a1018336-be0c-46b9-a27e-0760d12b5089 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:03.897975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a1018336-be0c-46b9-a27e-0760d12b5089 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.086063 May 10 21:26:03.899060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1154/1930] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:03 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:04.121950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-736f29c8-fccc-4de9-94f5-75d6a33d4e38 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:04.122585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-736f29c8-fccc-4de9-94f5-75d6a33d4e38 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:04.128643 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-736f29c8-fccc-4de9-94f5-75d6a33d4e38 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:04.129090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-736f29c8-fccc-4de9-94f5-75d6a33d4e38 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:04.129849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-736f29c8-fccc-4de9-94f5-75d6a33d4e38 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:04.130282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-736f29c8-fccc-4de9-94f5-75d6a33d4e38 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:04.193232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-736f29c8-fccc-4de9-94f5-75d6a33d4e38 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:04.204558 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-736f29c8-fccc-4de9-94f5-75d6a33d4e38 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:04.206325 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-736f29c8-fccc-4de9-94f5-75d6a33d4e38 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:04.207727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-736f29c8-fccc-4de9-94f5-75d6a33d4e38 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.090415 May 10 21:26:04.208645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1155/1931] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:04 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:04.916356 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f0e69b53-ea78-4e15-893f-060d389ba842 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:04.919277 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f0e69b53-ea78-4e15-893f-060d389ba842 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:04.927860 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0e69b53-ea78-4e15-893f-060d389ba842 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:04.935893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0e69b53-ea78-4e15-893f-060d389ba842 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:04.937236 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0e69b53-ea78-4e15-893f-060d389ba842 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:04.937856 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0e69b53-ea78-4e15-893f-060d389ba842 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:05.017522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f0e69b53-ea78-4e15-893f-060d389ba842 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:05.032808 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f0e69b53-ea78-4e15-893f-060d389ba842 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.120617 May 10 21:26:05.033633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1156/1932] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:04 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:26:05.226766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8d52e6ac-1e11-4b09-9e4d-846675d40d5d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:05.227405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8d52e6ac-1e11-4b09-9e4d-846675d40d5d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:05.235546 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8d52e6ac-1e11-4b09-9e4d-846675d40d5d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:05.236200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8d52e6ac-1e11-4b09-9e4d-846675d40d5d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:05.237169 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8d52e6ac-1e11-4b09-9e4d-846675d40d5d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:05.237613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8d52e6ac-1e11-4b09-9e4d-846675d40d5d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:05.301180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8d52e6ac-1e11-4b09-9e4d-846675d40d5d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:05.310167 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8d52e6ac-1e11-4b09-9e4d-846675d40d5d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:05.311743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8d52e6ac-1e11-4b09-9e4d-846675d40d5d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:05.312894 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8d52e6ac-1e11-4b09-9e4d-846675d40d5d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.090101 May 10 21:26:05.313454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1157/1933] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:05 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:06.050376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f0070d65-6de8-4961-a376-4bb7552a1c4f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:06.051031 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f0070d65-6de8-4961-a376-4bb7552a1c4f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:06.057740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0070d65-6de8-4961-a376-4bb7552a1c4f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:06.058229 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0070d65-6de8-4961-a376-4bb7552a1c4f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:06.060077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0070d65-6de8-4961-a376-4bb7552a1c4f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:06.060531 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0070d65-6de8-4961-a376-4bb7552a1c4f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:06.123934 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f0070d65-6de8-4961-a376-4bb7552a1c4f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:06.131453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f0070d65-6de8-4961-a376-4bb7552a1c4f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.085134 May 10 21:26:06.132016 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1158/1934] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:06 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:06.331234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c4e7dc6f-6bfd-444a-8eff-c827e4eec5ee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:06.331927 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c4e7dc6f-6bfd-444a-8eff-c827e4eec5ee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:06.337726 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4e7dc6f-6bfd-444a-8eff-c827e4eec5ee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:06.338174 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4e7dc6f-6bfd-444a-8eff-c827e4eec5ee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:06.338926 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4e7dc6f-6bfd-444a-8eff-c827e4eec5ee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:06.339395 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4e7dc6f-6bfd-444a-8eff-c827e4eec5ee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:06.400771 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c4e7dc6f-6bfd-444a-8eff-c827e4eec5ee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:06.409554 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c4e7dc6f-6bfd-444a-8eff-c827e4eec5ee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:06.411043 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c4e7dc6f-6bfd-444a-8eff-c827e4eec5ee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:06.412327 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c4e7dc6f-6bfd-444a-8eff-c827e4eec5ee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085615 May 10 21:26:06.413107 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1159/1935] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:06 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:07.149709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ce214ecf-2e63-4cf2-832c-f4fe8f91219b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:07.150337 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ce214ecf-2e63-4cf2-832c-f4fe8f91219b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:07.156914 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ce214ecf-2e63-4cf2-832c-f4fe8f91219b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:07.157368 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ce214ecf-2e63-4cf2-832c-f4fe8f91219b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:07.158158 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ce214ecf-2e63-4cf2-832c-f4fe8f91219b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:07.158586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ce214ecf-2e63-4cf2-832c-f4fe8f91219b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:07.225983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ce214ecf-2e63-4cf2-832c-f4fe8f91219b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:07.234053 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ce214ecf-2e63-4cf2-832c-f4fe8f91219b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.088319 May 10 21:26:07.234648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1160/1936] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:07 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:07.431175 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b5c8c7eb-018e-4e1f-95a9-4f3cad21f912 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:07.431705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b5c8c7eb-018e-4e1f-95a9-4f3cad21f912 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:07.438350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5c8c7eb-018e-4e1f-95a9-4f3cad21f912 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:07.438798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5c8c7eb-018e-4e1f-95a9-4f3cad21f912 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:07.439592 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5c8c7eb-018e-4e1f-95a9-4f3cad21f912 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:07.440031 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5c8c7eb-018e-4e1f-95a9-4f3cad21f912 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:07.500652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b5c8c7eb-018e-4e1f-95a9-4f3cad21f912 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:07.509063 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b5c8c7eb-018e-4e1f-95a9-4f3cad21f912 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:07.510562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b5c8c7eb-018e-4e1f-95a9-4f3cad21f912 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:07.511754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b5c8c7eb-018e-4e1f-95a9-4f3cad21f912 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084597 May 10 21:26:07.512303 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1161/1937] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:07 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:08.251186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d2207cbf-5616-418b-8fcf-3687b53d2bf9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:08.251881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d2207cbf-5616-418b-8fcf-3687b53d2bf9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:08.258174 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2207cbf-5616-418b-8fcf-3687b53d2bf9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:08.258619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2207cbf-5616-418b-8fcf-3687b53d2bf9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:08.259394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2207cbf-5616-418b-8fcf-3687b53d2bf9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:08.259834 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2207cbf-5616-418b-8fcf-3687b53d2bf9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:08.322234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d2207cbf-5616-418b-8fcf-3687b53d2bf9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:08.329916 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d2207cbf-5616-418b-8fcf-3687b53d2bf9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082713 May 10 21:26:08.330473 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1162/1938] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:08 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:08.529800 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b216dedf-f568-4f52-b0ea-103d2646b56d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:08.530329 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b216dedf-f568-4f52-b0ea-103d2646b56d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:08.536177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b216dedf-f568-4f52-b0ea-103d2646b56d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:08.536621 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b216dedf-f568-4f52-b0ea-103d2646b56d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:08.537377 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b216dedf-f568-4f52-b0ea-103d2646b56d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:08.537811 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b216dedf-f568-4f52-b0ea-103d2646b56d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:08.598598 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b216dedf-f568-4f52-b0ea-103d2646b56d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:08.607912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b216dedf-f568-4f52-b0ea-103d2646b56d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:08.609414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b216dedf-f568-4f52-b0ea-103d2646b56d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:08.610563 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b216dedf-f568-4f52-b0ea-103d2646b56d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084927 May 10 21:26:08.611111 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1163/1939] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:08 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:09.346423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2b3f964e-3275-42c8-8392-a3902ca9e6a3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:09.347104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2b3f964e-3275-42c8-8392-a3902ca9e6a3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:09.353441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2b3f964e-3275-42c8-8392-a3902ca9e6a3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:09.353893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2b3f964e-3275-42c8-8392-a3902ca9e6a3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:09.354659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2b3f964e-3275-42c8-8392-a3902ca9e6a3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:09.355097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2b3f964e-3275-42c8-8392-a3902ca9e6a3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:09.416400 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2b3f964e-3275-42c8-8392-a3902ca9e6a3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:09.423831 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2b3f964e-3275-42c8-8392-a3902ca9e6a3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081321 May 10 21:26:09.424389 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1164/1940] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:09 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:09.628300 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-180dbfc5-6c49-4bf7-8504-1d77b1922326 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:09.628917 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-180dbfc5-6c49-4bf7-8504-1d77b1922326 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:09.634827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-180dbfc5-6c49-4bf7-8504-1d77b1922326 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:09.635326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-180dbfc5-6c49-4bf7-8504-1d77b1922326 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:09.636084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-180dbfc5-6c49-4bf7-8504-1d77b1922326 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:09.636520 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-180dbfc5-6c49-4bf7-8504-1d77b1922326 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:09.696037 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-180dbfc5-6c49-4bf7-8504-1d77b1922326 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:09.705403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-180dbfc5-6c49-4bf7-8504-1d77b1922326 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:09.706898 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-180dbfc5-6c49-4bf7-8504-1d77b1922326 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:09.708068 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-180dbfc5-6c49-4bf7-8504-1d77b1922326 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083734 May 10 21:26:09.708618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1165/1941] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:09 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:10.440634 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6158528a-47cf-40f8-9717-ae58ed247c09 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:10.441335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6158528a-47cf-40f8-9717-ae58ed247c09 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:10.447691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6158528a-47cf-40f8-9717-ae58ed247c09 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:10.448335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6158528a-47cf-40f8-9717-ae58ed247c09 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:10.449041 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6158528a-47cf-40f8-9717-ae58ed247c09 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:10.449475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6158528a-47cf-40f8-9717-ae58ed247c09 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:10.513758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6158528a-47cf-40f8-9717-ae58ed247c09 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:10.521590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6158528a-47cf-40f8-9717-ae58ed247c09 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.084940 May 10 21:26:10.522177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1166/1942] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:10 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:10.725853 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6fb6e388-361b-4267-b7e0-78feb509ea0c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:10.726416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6fb6e388-361b-4267-b7e0-78feb509ea0c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:10.732698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6fb6e388-361b-4267-b7e0-78feb509ea0c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:10.733145 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6fb6e388-361b-4267-b7e0-78feb509ea0c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:10.733907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6fb6e388-361b-4267-b7e0-78feb509ea0c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:10.734339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6fb6e388-361b-4267-b7e0-78feb509ea0c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:10.793461 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6fb6e388-361b-4267-b7e0-78feb509ea0c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:10.801570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6fb6e388-361b-4267-b7e0-78feb509ea0c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:10.803094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6fb6e388-361b-4267-b7e0-78feb509ea0c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:10.804344 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6fb6e388-361b-4267-b7e0-78feb509ea0c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.082553 May 10 21:26:10.804901 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1167/1943] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:10 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:11.539256 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c540f945-c6de-4a20-a0ce-a872ff831abc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:11.539907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c540f945-c6de-4a20-a0ce-a872ff831abc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:11.546944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c540f945-c6de-4a20-a0ce-a872ff831abc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:11.547491 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c540f945-c6de-4a20-a0ce-a872ff831abc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:11.548251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c540f945-c6de-4a20-a0ce-a872ff831abc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:11.548686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c540f945-c6de-4a20-a0ce-a872ff831abc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:11.610656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c540f945-c6de-4a20-a0ce-a872ff831abc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:11.618128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c540f945-c6de-4a20-a0ce-a872ff831abc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082737 May 10 21:26:11.618684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1168/1944] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:11 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:11.822195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b913bf10-3393-4145-a34c-524c0eed212e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:11.823312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b913bf10-3393-4145-a34c-524c0eed212e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:11.829758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b913bf10-3393-4145-a34c-524c0eed212e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:11.830205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b913bf10-3393-4145-a34c-524c0eed212e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:11.830970 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b913bf10-3393-4145-a34c-524c0eed212e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:11.831434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b913bf10-3393-4145-a34c-524c0eed212e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:11.921745 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b913bf10-3393-4145-a34c-524c0eed212e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:11.930009 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b913bf10-3393-4145-a34c-524c0eed212e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:11.931546 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b913bf10-3393-4145-a34c-524c0eed212e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:11.932689 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b913bf10-3393-4145-a34c-524c0eed212e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.114449 May 10 21:26:11.933252 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1169/1945] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:11 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:12.635605 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a26bc3cb-bedf-4fd6-b068-189da25adbd7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:12.636322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a26bc3cb-bedf-4fd6-b068-189da25adbd7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:12.642750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a26bc3cb-bedf-4fd6-b068-189da25adbd7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:12.643359 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a26bc3cb-bedf-4fd6-b068-189da25adbd7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:12.644125 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a26bc3cb-bedf-4fd6-b068-189da25adbd7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:12.644699 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a26bc3cb-bedf-4fd6-b068-189da25adbd7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:12.706758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a26bc3cb-bedf-4fd6-b068-189da25adbd7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:12.714316 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a26bc3cb-bedf-4fd6-b068-189da25adbd7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082490 May 10 21:26:12.716084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1170/1946] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:12 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:12.951972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2ba93468-2adb-4a33-9413-410265438d6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:12.952584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2ba93468-2adb-4a33-9413-410265438d6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:12.958838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ba93468-2adb-4a33-9413-410265438d6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:12.959328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ba93468-2adb-4a33-9413-410265438d6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:12.960090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ba93468-2adb-4a33-9413-410265438d6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:12.960527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ba93468-2adb-4a33-9413-410265438d6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:13.022358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2ba93468-2adb-4a33-9413-410265438d6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:13.031983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2ba93468-2adb-4a33-9413-410265438d6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:13.033486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2ba93468-2adb-4a33-9413-410265438d6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:13.034630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2ba93468-2adb-4a33-9413-410265438d6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087575 May 10 21:26:13.035203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1171/1947] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:12 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:13.733344 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-90c4a3f1-e2e4-45f6-b39c-f64ac49fff36 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:13.733981 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-90c4a3f1-e2e4-45f6-b39c-f64ac49fff36 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:13.739966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-90c4a3f1-e2e4-45f6-b39c-f64ac49fff36 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:13.740415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-90c4a3f1-e2e4-45f6-b39c-f64ac49fff36 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:13.741250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-90c4a3f1-e2e4-45f6-b39c-f64ac49fff36 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:13.741690 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-90c4a3f1-e2e4-45f6-b39c-f64ac49fff36 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:13.801353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-90c4a3f1-e2e4-45f6-b39c-f64ac49fff36 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:13.809071 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-90c4a3f1-e2e4-45f6-b39c-f64ac49fff36 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079921 May 10 21:26:13.809641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1172/1948] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:13 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:14.053778 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-04a21274-7c2b-4c0a-9dbf-c7c808133f00 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:14.054297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-04a21274-7c2b-4c0a-9dbf-c7c808133f00 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:14.060944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04a21274-7c2b-4c0a-9dbf-c7c808133f00 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:14.061518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04a21274-7c2b-4c0a-9dbf-c7c808133f00 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:14.062277 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04a21274-7c2b-4c0a-9dbf-c7c808133f00 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:14.062707 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04a21274-7c2b-4c0a-9dbf-c7c808133f00 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:14.127340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-04a21274-7c2b-4c0a-9dbf-c7c808133f00 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:14.135582 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-04a21274-7c2b-4c0a-9dbf-c7c808133f00 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:14.137707 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-04a21274-7c2b-4c0a-9dbf-c7c808133f00 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:14.138846 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-04a21274-7c2b-4c0a-9dbf-c7c808133f00 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.089155 May 10 21:26:14.139447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1173/1949] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:14 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:14.826079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-509c59b1-d502-4d80-be63-428779849217 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:14.826738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-509c59b1-d502-4d80-be63-428779849217 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:14.833416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-509c59b1-d502-4d80-be63-428779849217 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:14.833809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-509c59b1-d502-4d80-be63-428779849217 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:14.834585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-509c59b1-d502-4d80-be63-428779849217 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:14.835030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-509c59b1-d502-4d80-be63-428779849217 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:14.896503 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-509c59b1-d502-4d80-be63-428779849217 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:14.904676 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-509c59b1-d502-4d80-be63-428779849217 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082567 May 10 21:26:14.905244 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1174/1950] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:14 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:15.157144 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-06ba463a-e688-4ccc-989a-60a65fe7f504 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:15.157790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-06ba463a-e688-4ccc-989a-60a65fe7f504 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:15.163785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-06ba463a-e688-4ccc-989a-60a65fe7f504 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:15.164220 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-06ba463a-e688-4ccc-989a-60a65fe7f504 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:15.164979 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-06ba463a-e688-4ccc-989a-60a65fe7f504 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:15.165417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-06ba463a-e688-4ccc-989a-60a65fe7f504 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:15.227340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-06ba463a-e688-4ccc-989a-60a65fe7f504 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:15.235780 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-06ba463a-e688-4ccc-989a-60a65fe7f504 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:15.237289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-06ba463a-e688-4ccc-989a-60a65fe7f504 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:15.238450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-06ba463a-e688-4ccc-989a-60a65fe7f504 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085171 May 10 21:26:15.239196 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1175/1951] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:15 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:15.922523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-df0e1002-479f-4f31-92de-19b815b6ee33 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:15.923115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-df0e1002-479f-4f31-92de-19b815b6ee33 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:15.929453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df0e1002-479f-4f31-92de-19b815b6ee33 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:15.929899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df0e1002-479f-4f31-92de-19b815b6ee33 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:15.930661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df0e1002-479f-4f31-92de-19b815b6ee33 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:15.931094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df0e1002-479f-4f31-92de-19b815b6ee33 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:15.991286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-df0e1002-479f-4f31-92de-19b815b6ee33 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:15.999393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-df0e1002-479f-4f31-92de-19b815b6ee33 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081478 May 10 21:26:15.999967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1176/1952] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:15 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:16.256933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-eca4443f-3c56-4c98-8e19-48fc56b3a7af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:16.257456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-eca4443f-3c56-4c98-8e19-48fc56b3a7af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:16.263593 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eca4443f-3c56-4c98-8e19-48fc56b3a7af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:16.264038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eca4443f-3c56-4c98-8e19-48fc56b3a7af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:16.264789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eca4443f-3c56-4c98-8e19-48fc56b3a7af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:16.265230 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eca4443f-3c56-4c98-8e19-48fc56b3a7af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:16.327502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-eca4443f-3c56-4c98-8e19-48fc56b3a7af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:16.336153 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-eca4443f-3c56-4c98-8e19-48fc56b3a7af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:16.337661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-eca4443f-3c56-4c98-8e19-48fc56b3a7af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:16.338841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-eca4443f-3c56-4c98-8e19-48fc56b3a7af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085956 May 10 21:26:16.339450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1177/1953] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:16 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:17.016911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d0c10264-9172-4c89-8292-bde455dd12bd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:17.017598 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d0c10264-9172-4c89-8292-bde455dd12bd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:17.023925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0c10264-9172-4c89-8292-bde455dd12bd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:17.024372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0c10264-9172-4c89-8292-bde455dd12bd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:17.025129 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0c10264-9172-4c89-8292-bde455dd12bd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:17.025608 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0c10264-9172-4c89-8292-bde455dd12bd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:17.086952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d0c10264-9172-4c89-8292-bde455dd12bd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:17.094643 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d0c10264-9172-4c89-8292-bde455dd12bd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081678 May 10 21:26:17.095238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1178/1954] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:17 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:17.357889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3165b0e6-8ab7-40c2-9737-716a1ce8f6c0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:17.358495 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3165b0e6-8ab7-40c2-9737-716a1ce8f6c0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:17.364361 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3165b0e6-8ab7-40c2-9737-716a1ce8f6c0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:17.364808 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3165b0e6-8ab7-40c2-9737-716a1ce8f6c0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:17.365564 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3165b0e6-8ab7-40c2-9737-716a1ce8f6c0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:17.365998 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3165b0e6-8ab7-40c2-9737-716a1ce8f6c0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:17.424630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3165b0e6-8ab7-40c2-9737-716a1ce8f6c0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:17.432738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3165b0e6-8ab7-40c2-9737-716a1ce8f6c0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:17.434912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3165b0e6-8ab7-40c2-9737-716a1ce8f6c0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:17.436075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3165b0e6-8ab7-40c2-9737-716a1ce8f6c0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.082642 May 10 21:26:17.436635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1179/1955] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:17 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:18.111803 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0aef5005-30fc-4d85-b4e6-0e58f58f0b65 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:18.112484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0aef5005-30fc-4d85-b4e6-0e58f58f0b65 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:18.118725 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0aef5005-30fc-4d85-b4e6-0e58f58f0b65 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:18.119212 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0aef5005-30fc-4d85-b4e6-0e58f58f0b65 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:18.119974 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0aef5005-30fc-4d85-b4e6-0e58f58f0b65 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:18.120407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0aef5005-30fc-4d85-b4e6-0e58f58f0b65 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:18.180980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0aef5005-30fc-4d85-b4e6-0e58f58f0b65 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:18.188779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0aef5005-30fc-4d85-b4e6-0e58f58f0b65 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080926 May 10 21:26:18.189339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1180/1956] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:18 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:18.454706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0c420316-3b62-41d9-89a4-bf2f3d16762d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:18.455258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0c420316-3b62-41d9-89a4-bf2f3d16762d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:18.461313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c420316-3b62-41d9-89a4-bf2f3d16762d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:18.461759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c420316-3b62-41d9-89a4-bf2f3d16762d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:18.462511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c420316-3b62-41d9-89a4-bf2f3d16762d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:18.462943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c420316-3b62-41d9-89a4-bf2f3d16762d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:18.526528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0c420316-3b62-41d9-89a4-bf2f3d16762d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:18.534983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0c420316-3b62-41d9-89a4-bf2f3d16762d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:18.536538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0c420316-3b62-41d9-89a4-bf2f3d16762d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:18.537686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0c420316-3b62-41d9-89a4-bf2f3d16762d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087507 May 10 21:26:18.538228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1181/1957] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:18 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:19.206470 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-54614f1e-8f0d-4866-8e2f-5ec92d5ab5b1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:19.207170 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-54614f1e-8f0d-4866-8e2f-5ec92d5ab5b1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:19.213415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54614f1e-8f0d-4866-8e2f-5ec92d5ab5b1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:19.213865 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54614f1e-8f0d-4866-8e2f-5ec92d5ab5b1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:19.214724 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54614f1e-8f0d-4866-8e2f-5ec92d5ab5b1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:19.215630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54614f1e-8f0d-4866-8e2f-5ec92d5ab5b1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:19.276311 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-54614f1e-8f0d-4866-8e2f-5ec92d5ab5b1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:19.283957 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-54614f1e-8f0d-4866-8e2f-5ec92d5ab5b1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081611 May 10 21:26:19.284526 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1182/1958] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:19 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:19.555555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-33b8dda8-8e60-405f-9eb7-9fa3c8f06e11 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:19.556097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-33b8dda8-8e60-405f-9eb7-9fa3c8f06e11 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:19.562226 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-33b8dda8-8e60-405f-9eb7-9fa3c8f06e11 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:19.562685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-33b8dda8-8e60-405f-9eb7-9fa3c8f06e11 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:19.563481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-33b8dda8-8e60-405f-9eb7-9fa3c8f06e11 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:19.563923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-33b8dda8-8e60-405f-9eb7-9fa3c8f06e11 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:19.624609 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-33b8dda8-8e60-405f-9eb7-9fa3c8f06e11 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:19.632777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-33b8dda8-8e60-405f-9eb7-9fa3c8f06e11 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:19.634296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-33b8dda8-8e60-405f-9eb7-9fa3c8f06e11 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:19.635461 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-33b8dda8-8e60-405f-9eb7-9fa3c8f06e11 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083858 May 10 21:26:19.636009 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1183/1959] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:19 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:20.300860 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8bac27d7-47dc-4880-a6d3-f66d8019f4ed tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:20.301510 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8bac27d7-47dc-4880-a6d3-f66d8019f4ed tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:20.307871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8bac27d7-47dc-4880-a6d3-f66d8019f4ed tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:20.308361 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8bac27d7-47dc-4880-a6d3-f66d8019f4ed tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:20.309240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8bac27d7-47dc-4880-a6d3-f66d8019f4ed tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:20.309677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8bac27d7-47dc-4880-a6d3-f66d8019f4ed tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:20.369727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8bac27d7-47dc-4880-a6d3-f66d8019f4ed tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:20.377198 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8bac27d7-47dc-4880-a6d3-f66d8019f4ed tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080271 May 10 21:26:20.377778 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1184/1960] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:20 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:20.653500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4a85dbb4-1bf5-4939-be2c-fbdf06586871 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:20.654121 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4a85dbb4-1bf5-4939-be2c-fbdf06586871 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:20.660272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a85dbb4-1bf5-4939-be2c-fbdf06586871 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:20.660721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a85dbb4-1bf5-4939-be2c-fbdf06586871 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:20.661479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a85dbb4-1bf5-4939-be2c-fbdf06586871 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:20.661917 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a85dbb4-1bf5-4939-be2c-fbdf06586871 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:20.724155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4a85dbb4-1bf5-4939-be2c-fbdf06586871 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:20.732892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4a85dbb4-1bf5-4939-be2c-fbdf06586871 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:20.734400 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4a85dbb4-1bf5-4939-be2c-fbdf06586871 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:20.735577 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4a85dbb4-1bf5-4939-be2c-fbdf06586871 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086638 May 10 21:26:20.736130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1185/1961] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:20 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:21.394278 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c7435ef9-8ff5-4b0b-96b0-a47b4607033e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:21.394930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c7435ef9-8ff5-4b0b-96b0-a47b4607033e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:21.401279 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c7435ef9-8ff5-4b0b-96b0-a47b4607033e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:21.401725 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c7435ef9-8ff5-4b0b-96b0-a47b4607033e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:21.402477 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c7435ef9-8ff5-4b0b-96b0-a47b4607033e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:21.402913 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c7435ef9-8ff5-4b0b-96b0-a47b4607033e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:21.464166 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c7435ef9-8ff5-4b0b-96b0-a47b4607033e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:21.472730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c7435ef9-8ff5-4b0b-96b0-a47b4607033e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082302 May 10 21:26:21.473290 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1186/1962] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:21 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:21.753963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-469d5711-b162-4627-8449-6f2e409d7295 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:21.754513 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-469d5711-b162-4627-8449-6f2e409d7295 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:21.760492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-469d5711-b162-4627-8449-6f2e409d7295 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:21.760939 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-469d5711-b162-4627-8449-6f2e409d7295 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:21.761691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-469d5711-b162-4627-8449-6f2e409d7295 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:21.762121 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-469d5711-b162-4627-8449-6f2e409d7295 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:21.821537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-469d5711-b162-4627-8449-6f2e409d7295 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:21.830627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-469d5711-b162-4627-8449-6f2e409d7295 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:21.832162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-469d5711-b162-4627-8449-6f2e409d7295 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:21.833312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-469d5711-b162-4627-8449-6f2e409d7295 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083323 May 10 21:26:21.833868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1187/1963] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:21 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:22.490688 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-512da9ad-29e4-43aa-aac8-5892bfb0758d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:22.491498 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-512da9ad-29e4-43aa-aac8-5892bfb0758d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:22.499453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-512da9ad-29e4-43aa-aac8-5892bfb0758d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:22.499913 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-512da9ad-29e4-43aa-aac8-5892bfb0758d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:22.500692 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-512da9ad-29e4-43aa-aac8-5892bfb0758d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:22.501255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-512da9ad-29e4-43aa-aac8-5892bfb0758d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:22.568534 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-512da9ad-29e4-43aa-aac8-5892bfb0758d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:22.576443 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-512da9ad-29e4-43aa-aac8-5892bfb0758d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.089713 May 10 21:26:22.577821 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1188/1964] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:22 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:22.851512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-742a7d7c-69bb-4da9-83ac-d7493a49963c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:22.852125 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-742a7d7c-69bb-4da9-83ac-d7493a49963c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:22.858432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-742a7d7c-69bb-4da9-83ac-d7493a49963c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:22.858943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-742a7d7c-69bb-4da9-83ac-d7493a49963c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:22.859740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-742a7d7c-69bb-4da9-83ac-d7493a49963c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:22.860190 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-742a7d7c-69bb-4da9-83ac-d7493a49963c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:22.926447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-742a7d7c-69bb-4da9-83ac-d7493a49963c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:22.935337 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-742a7d7c-69bb-4da9-83ac-d7493a49963c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:22.936854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-742a7d7c-69bb-4da9-83ac-d7493a49963c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:22.937998 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-742a7d7c-69bb-4da9-83ac-d7493a49963c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.090750 May 10 21:26:22.938561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1189/1965] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:22 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:23.593893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5c849729-9528-4cd4-9844-57d17e69ccf6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:23.594599 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5c849729-9528-4cd4-9844-57d17e69ccf6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:23.600847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5c849729-9528-4cd4-9844-57d17e69ccf6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:23.601293 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5c849729-9528-4cd4-9844-57d17e69ccf6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:23.602055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5c849729-9528-4cd4-9844-57d17e69ccf6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:23.602496 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5c849729-9528-4cd4-9844-57d17e69ccf6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:23.664110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5c849729-9528-4cd4-9844-57d17e69ccf6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:23.671396 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5c849729-9528-4cd4-9844-57d17e69ccf6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081572 May 10 21:26:23.671967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1190/1966] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:23 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:23.956667 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-129d11fd-2df9-4aec-9985-62653515718f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:23.957195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-129d11fd-2df9-4aec-9985-62653515718f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:23.963056 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-129d11fd-2df9-4aec-9985-62653515718f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:23.963530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-129d11fd-2df9-4aec-9985-62653515718f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:23.964290 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-129d11fd-2df9-4aec-9985-62653515718f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:23.964723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-129d11fd-2df9-4aec-9985-62653515718f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:24.024944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-129d11fd-2df9-4aec-9985-62653515718f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:24.033493 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-129d11fd-2df9-4aec-9985-62653515718f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:24.034998 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-129d11fd-2df9-4aec-9985-62653515718f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:24.036186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-129d11fd-2df9-4aec-9985-62653515718f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083737 May 10 21:26:24.036754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1191/1967] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:23 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:24.687873 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-27fa8714-af04-4eaa-b523-bcfe9a48c9b7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:24.688468 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-27fa8714-af04-4eaa-b523-bcfe9a48c9b7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:24.694941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27fa8714-af04-4eaa-b523-bcfe9a48c9b7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:24.695431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27fa8714-af04-4eaa-b523-bcfe9a48c9b7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:24.696189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27fa8714-af04-4eaa-b523-bcfe9a48c9b7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:24.696626 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27fa8714-af04-4eaa-b523-bcfe9a48c9b7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:24.757844 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-27fa8714-af04-4eaa-b523-bcfe9a48c9b7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:24.766008 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-27fa8714-af04-4eaa-b523-bcfe9a48c9b7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082254 May 10 21:26:24.766578 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1192/1968] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:24 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:25.054654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ece4d56e-d3d0-41b3-9155-5216ab3fb8a5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:25.055204 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ece4d56e-d3d0-41b3-9155-5216ab3fb8a5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:25.061678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ece4d56e-d3d0-41b3-9155-5216ab3fb8a5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:25.062122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ece4d56e-d3d0-41b3-9155-5216ab3fb8a5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:25.062877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ece4d56e-d3d0-41b3-9155-5216ab3fb8a5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:25.063343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ece4d56e-d3d0-41b3-9155-5216ab3fb8a5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:25.128488 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ece4d56e-d3d0-41b3-9155-5216ab3fb8a5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:25.136697 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ece4d56e-d3d0-41b3-9155-5216ab3fb8a5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:25.138716 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ece4d56e-d3d0-41b3-9155-5216ab3fb8a5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:25.139876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ece4d56e-d3d0-41b3-9155-5216ab3fb8a5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.089349 May 10 21:26:25.140434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1193/1969] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:25 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:25.782846 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-54ed93b9-85a1-462e-b808-ba6adc444c7a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:25.783541 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-54ed93b9-85a1-462e-b808-ba6adc444c7a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:25.789915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54ed93b9-85a1-462e-b808-ba6adc444c7a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:25.790366 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54ed93b9-85a1-462e-b808-ba6adc444c7a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:25.791141 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54ed93b9-85a1-462e-b808-ba6adc444c7a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:25.791581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54ed93b9-85a1-462e-b808-ba6adc444c7a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:25.852103 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-54ed93b9-85a1-462e-b808-ba6adc444c7a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:25.860309 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-54ed93b9-85a1-462e-b808-ba6adc444c7a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081556 May 10 21:26:25.860814 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1194/1970] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:25 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:26.158511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2d4368c7-3231-45ff-b1b1-c3f3350fc64a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:26.159038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2d4368c7-3231-45ff-b1b1-c3f3350fc64a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:26.165266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d4368c7-3231-45ff-b1b1-c3f3350fc64a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:26.165734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d4368c7-3231-45ff-b1b1-c3f3350fc64a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:26.166475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d4368c7-3231-45ff-b1b1-c3f3350fc64a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:26.166910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d4368c7-3231-45ff-b1b1-c3f3350fc64a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:26.229131 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2d4368c7-3231-45ff-b1b1-c3f3350fc64a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:26.237371 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2d4368c7-3231-45ff-b1b1-c3f3350fc64a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:26.239077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2d4368c7-3231-45ff-b1b1-c3f3350fc64a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:26.240302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2d4368c7-3231-45ff-b1b1-c3f3350fc64a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087005 May 10 21:26:26.240858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1195/1971] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:26 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:26.877471 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e6ee769d-fe09-40da-b7da-e5ed5e3586d7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:26.878105 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e6ee769d-fe09-40da-b7da-e5ed5e3586d7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:26.884411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e6ee769d-fe09-40da-b7da-e5ed5e3586d7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:26.888085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e6ee769d-fe09-40da-b7da-e5ed5e3586d7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:26.888085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e6ee769d-fe09-40da-b7da-e5ed5e3586d7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:26.888085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e6ee769d-fe09-40da-b7da-e5ed5e3586d7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:26.946846 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e6ee769d-fe09-40da-b7da-e5ed5e3586d7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:26.955334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e6ee769d-fe09-40da-b7da-e5ed5e3586d7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081931 May 10 21:26:26.957149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1196/1972] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:26 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:27.257916 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ad5dc63b-cf93-41fa-a17b-f2a043fb3d71 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:27.258452 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ad5dc63b-cf93-41fa-a17b-f2a043fb3d71 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:27.265215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ad5dc63b-cf93-41fa-a17b-f2a043fb3d71 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:27.265670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ad5dc63b-cf93-41fa-a17b-f2a043fb3d71 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:27.266441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ad5dc63b-cf93-41fa-a17b-f2a043fb3d71 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:27.266880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ad5dc63b-cf93-41fa-a17b-f2a043fb3d71 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:27.330346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ad5dc63b-cf93-41fa-a17b-f2a043fb3d71 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:27.338595 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ad5dc63b-cf93-41fa-a17b-f2a043fb3d71 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:27.340138 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ad5dc63b-cf93-41fa-a17b-f2a043fb3d71 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:27.341463 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ad5dc63b-cf93-41fa-a17b-f2a043fb3d71 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087562 May 10 21:26:27.342026 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1197/1973] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:27 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:27.971854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fd97b399-695b-43cd-9955-91e5b24614d7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:27.972482 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fd97b399-695b-43cd-9955-91e5b24614d7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:27.978707 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fd97b399-695b-43cd-9955-91e5b24614d7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:27.979176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fd97b399-695b-43cd-9955-91e5b24614d7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:27.979936 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fd97b399-695b-43cd-9955-91e5b24614d7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:27.980365 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fd97b399-695b-43cd-9955-91e5b24614d7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:28.040384 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fd97b399-695b-43cd-9955-91e5b24614d7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:28.047926 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fd97b399-695b-43cd-9955-91e5b24614d7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079991 May 10 21:26:28.048476 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1198/1974] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:27 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:28.359493 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c53b1322-533e-4d65-9fe1-5f7a28b14adc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:28.360122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c53b1322-533e-4d65-9fe1-5f7a28b14adc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:28.366004 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c53b1322-533e-4d65-9fe1-5f7a28b14adc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:28.366449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c53b1322-533e-4d65-9fe1-5f7a28b14adc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:28.367223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c53b1322-533e-4d65-9fe1-5f7a28b14adc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:28.367653 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c53b1322-533e-4d65-9fe1-5f7a28b14adc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:28.425977 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c53b1322-533e-4d65-9fe1-5f7a28b14adc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:28.434050 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c53b1322-533e-4d65-9fe1-5f7a28b14adc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:28.436022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c53b1322-533e-4d65-9fe1-5f7a28b14adc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:28.437175 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c53b1322-533e-4d65-9fe1-5f7a28b14adc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.081852 May 10 21:26:28.437734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1199/1975] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:28 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:29.065470 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4e23a4f2-2adc-4564-a291-ac962cd35c44 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:29.066223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4e23a4f2-2adc-4564-a291-ac962cd35c44 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:29.072534 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4e23a4f2-2adc-4564-a291-ac962cd35c44 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:29.072989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4e23a4f2-2adc-4564-a291-ac962cd35c44 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:29.073759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4e23a4f2-2adc-4564-a291-ac962cd35c44 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:29.074201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4e23a4f2-2adc-4564-a291-ac962cd35c44 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:29.134305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4e23a4f2-2adc-4564-a291-ac962cd35c44 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:29.142200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4e23a4f2-2adc-4564-a291-ac962cd35c44 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080611 May 10 21:26:29.142762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1200/1976] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:29 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:29.456150 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b1a526d5-55b8-488f-920d-601a54785922 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:29.456769 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b1a526d5-55b8-488f-920d-601a54785922 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:29.462706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b1a526d5-55b8-488f-920d-601a54785922 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:29.463183 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b1a526d5-55b8-488f-920d-601a54785922 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:29.463944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b1a526d5-55b8-488f-920d-601a54785922 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:29.464388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b1a526d5-55b8-488f-920d-601a54785922 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:29.527428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b1a526d5-55b8-488f-920d-601a54785922 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:29.535665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b1a526d5-55b8-488f-920d-601a54785922 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:29.537197 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b1a526d5-55b8-488f-920d-601a54785922 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:29.538333 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b1a526d5-55b8-488f-920d-601a54785922 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086420 May 10 21:26:29.538902 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1201/1977] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:29 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:26:30.159349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-59c87723-1518-4933-b223-d0aaa893edad tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:30.160033 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-59c87723-1518-4933-b223-d0aaa893edad tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:30.166329 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-59c87723-1518-4933-b223-d0aaa893edad tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:30.166781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-59c87723-1518-4933-b223-d0aaa893edad tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:30.167578 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-59c87723-1518-4933-b223-d0aaa893edad tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:30.168019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-59c87723-1518-4933-b223-d0aaa893edad tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:30.227835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-59c87723-1518-4933-b223-d0aaa893edad tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:30.235458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-59c87723-1518-4933-b223-d0aaa893edad tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080008 May 10 21:26:30.236070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1202/1978] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:30 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:30.556269 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dc802662-4752-4336-9cb1-216beb5e54a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:30.556794 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dc802662-4752-4336-9cb1-216beb5e54a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:30.563510 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dc802662-4752-4336-9cb1-216beb5e54a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:30.563962 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dc802662-4752-4336-9cb1-216beb5e54a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:30.564734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dc802662-4752-4336-9cb1-216beb5e54a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:30.565202 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dc802662-4752-4336-9cb1-216beb5e54a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:30.626911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dc802662-4752-4336-9cb1-216beb5e54a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:30.635306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dc802662-4752-4336-9cb1-216beb5e54a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:30.636826 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dc802662-4752-4336-9cb1-216beb5e54a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:30.638511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dc802662-4752-4336-9cb1-216beb5e54a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086460 May 10 21:26:30.639076 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1203/1979] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:30 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:31.252755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-640a6fb3-5d05-46c7-88b2-6a870d81a145 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:31.253440 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-640a6fb3-5d05-46c7-88b2-6a870d81a145 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:31.259738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-640a6fb3-5d05-46c7-88b2-6a870d81a145 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:31.260193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-640a6fb3-5d05-46c7-88b2-6a870d81a145 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:31.260965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-640a6fb3-5d05-46c7-88b2-6a870d81a145 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:31.261403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-640a6fb3-5d05-46c7-88b2-6a870d81a145 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:31.320618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-640a6fb3-5d05-46c7-88b2-6a870d81a145 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:31.328271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-640a6fb3-5d05-46c7-88b2-6a870d81a145 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079191 May 10 21:26:31.328842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1204/1980] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:31 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:31.655628 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b984414e-f506-4fa6-b1e9-015e94bdc4ba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:31.656279 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b984414e-f506-4fa6-b1e9-015e94bdc4ba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:31.662220 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b984414e-f506-4fa6-b1e9-015e94bdc4ba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:31.662667 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b984414e-f506-4fa6-b1e9-015e94bdc4ba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:31.663449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b984414e-f506-4fa6-b1e9-015e94bdc4ba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:31.663889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b984414e-f506-4fa6-b1e9-015e94bdc4ba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:31.728177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b984414e-f506-4fa6-b1e9-015e94bdc4ba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:31.736418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b984414e-f506-4fa6-b1e9-015e94bdc4ba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:31.737944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b984414e-f506-4fa6-b1e9-015e94bdc4ba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:31.739093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b984414e-f506-4fa6-b1e9-015e94bdc4ba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087655 May 10 21:26:31.739684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1205/1981] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:31 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:32.345231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8ad9d1e3-aa55-4bd8-bde7-8a1d8d02ef4b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:32.345927 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8ad9d1e3-aa55-4bd8-bde7-8a1d8d02ef4b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:32.352167 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ad9d1e3-aa55-4bd8-bde7-8a1d8d02ef4b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:32.352617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ad9d1e3-aa55-4bd8-bde7-8a1d8d02ef4b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:32.353377 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ad9d1e3-aa55-4bd8-bde7-8a1d8d02ef4b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:32.353815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ad9d1e3-aa55-4bd8-bde7-8a1d8d02ef4b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:32.413415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8ad9d1e3-aa55-4bd8-bde7-8a1d8d02ef4b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:32.421070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8ad9d1e3-aa55-4bd8-bde7-8a1d8d02ef4b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079716 May 10 21:26:32.421634 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1206/1982] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:32 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:32.757560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5efdf4ae-289e-4773-b8d7-49bed7d0f81f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:32.758171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5efdf4ae-289e-4773-b8d7-49bed7d0f81f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:32.764794 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5efdf4ae-289e-4773-b8d7-49bed7d0f81f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:32.765238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5efdf4ae-289e-4773-b8d7-49bed7d0f81f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:32.765988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5efdf4ae-289e-4773-b8d7-49bed7d0f81f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:32.766447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5efdf4ae-289e-4773-b8d7-49bed7d0f81f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:32.824573 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5efdf4ae-289e-4773-b8d7-49bed7d0f81f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:32.833517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5efdf4ae-289e-4773-b8d7-49bed7d0f81f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:32.835003 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5efdf4ae-289e-4773-b8d7-49bed7d0f81f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:32.836232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5efdf4ae-289e-4773-b8d7-49bed7d0f81f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.082553 May 10 21:26:32.836790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1207/1983] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:32 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:33.438498 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f59b1fd5-a200-42e0-a8c5-4ee5931cbf2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:33.439229 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f59b1fd5-a200-42e0-a8c5-4ee5931cbf2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:33.445544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f59b1fd5-a200-42e0-a8c5-4ee5931cbf2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:33.445996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f59b1fd5-a200-42e0-a8c5-4ee5931cbf2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:33.446765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f59b1fd5-a200-42e0-a8c5-4ee5931cbf2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:33.447228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f59b1fd5-a200-42e0-a8c5-4ee5931cbf2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:33.507586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f59b1fd5-a200-42e0-a8c5-4ee5931cbf2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:33.514922 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f59b1fd5-a200-42e0-a8c5-4ee5931cbf2f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080990 May 10 21:26:33.515514 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1208/1984] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:33 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:33.853766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b4678868-b8a8-4f98-80f6-65bd71b50924 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:33.854387 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b4678868-b8a8-4f98-80f6-65bd71b50924 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:33.861393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b4678868-b8a8-4f98-80f6-65bd71b50924 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:33.861846 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b4678868-b8a8-4f98-80f6-65bd71b50924 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:33.862611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b4678868-b8a8-4f98-80f6-65bd71b50924 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:33.863053 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b4678868-b8a8-4f98-80f6-65bd71b50924 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:33.925540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b4678868-b8a8-4f98-80f6-65bd71b50924 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:33.933738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b4678868-b8a8-4f98-80f6-65bd71b50924 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:33.935635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b4678868-b8a8-4f98-80f6-65bd71b50924 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:33.936782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b4678868-b8a8-4f98-80f6-65bd71b50924 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086937 May 10 21:26:33.937346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1209/1985] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:33 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:34.531870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-173ba142-e76e-4794-8af8-d67a35496071 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:34.532562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-173ba142-e76e-4794-8af8-d67a35496071 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:34.538819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-173ba142-e76e-4794-8af8-d67a35496071 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:34.539313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-173ba142-e76e-4794-8af8-d67a35496071 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:34.540073 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-173ba142-e76e-4794-8af8-d67a35496071 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:34.540512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-173ba142-e76e-4794-8af8-d67a35496071 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:34.602368 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-173ba142-e76e-4794-8af8-d67a35496071 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:34.610726 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-173ba142-e76e-4794-8af8-d67a35496071 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083154 May 10 21:26:34.611340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1210/1986] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:34 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:34.954710 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-00aeaeac-6c05-4b65-a641-e25407399531 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:34.955343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-00aeaeac-6c05-4b65-a641-e25407399531 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:34.961253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-00aeaeac-6c05-4b65-a641-e25407399531 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:34.961962 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-00aeaeac-6c05-4b65-a641-e25407399531 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:34.962451 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-00aeaeac-6c05-4b65-a641-e25407399531 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:34.962882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-00aeaeac-6c05-4b65-a641-e25407399531 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:35.024453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-00aeaeac-6c05-4b65-a641-e25407399531 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:35.033418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-00aeaeac-6c05-4b65-a641-e25407399531 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:35.034971 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-00aeaeac-6c05-4b65-a641-e25407399531 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:35.036152 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-00aeaeac-6c05-4b65-a641-e25407399531 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085752 May 10 21:26:35.040356 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1211/1987] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:34 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:35.628392 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ecaec9aa-5b73-42f7-a30e-31b958c560a6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:35.629014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ecaec9aa-5b73-42f7-a30e-31b958c560a6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:35.635439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ecaec9aa-5b73-42f7-a30e-31b958c560a6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:35.635898 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ecaec9aa-5b73-42f7-a30e-31b958c560a6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:35.636671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ecaec9aa-5b73-42f7-a30e-31b958c560a6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:35.637112 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ecaec9aa-5b73-42f7-a30e-31b958c560a6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:35.696255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ecaec9aa-5b73-42f7-a30e-31b958c560a6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:35.704294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ecaec9aa-5b73-42f7-a30e-31b958c560a6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079757 May 10 21:26:35.704864 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1212/1988] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:35 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:36.056270 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-75ee5f63-12f0-469c-a948-2e80803f354c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:36.056806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-75ee5f63-12f0-469c-a948-2e80803f354c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:36.063453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-75ee5f63-12f0-469c-a948-2e80803f354c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:36.072597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-75ee5f63-12f0-469c-a948-2e80803f354c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:36.072597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-75ee5f63-12f0-469c-a948-2e80803f354c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:36.072597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-75ee5f63-12f0-469c-a948-2e80803f354c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:36.130698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-75ee5f63-12f0-469c-a948-2e80803f354c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:36.140370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-75ee5f63-12f0-469c-a948-2e80803f354c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:36.141882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-75ee5f63-12f0-469c-a948-2e80803f354c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:36.143073 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-75ee5f63-12f0-469c-a948-2e80803f354c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.090787 May 10 21:26:36.143806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1213/1989] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:36 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:36.722560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f46aa10e-d481-477a-abed-311875e36e2d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:36.723949 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f46aa10e-d481-477a-abed-311875e36e2d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:36.730448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f46aa10e-d481-477a-abed-311875e36e2d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:36.730907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f46aa10e-d481-477a-abed-311875e36e2d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:36.732789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f46aa10e-d481-477a-abed-311875e36e2d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:36.733234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f46aa10e-d481-477a-abed-311875e36e2d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:36.799308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f46aa10e-d481-477a-abed-311875e36e2d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:36.803073 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f46aa10e-d481-477a-abed-311875e36e2d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.084438 May 10 21:26:36.811355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1214/1990] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:36 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:37.187356 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-76539e83-dd39-4f71-83f5-0910823b4543 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:37.187976 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-76539e83-dd39-4f71-83f5-0910823b4543 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:37.193879 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76539e83-dd39-4f71-83f5-0910823b4543 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:37.194325 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76539e83-dd39-4f71-83f5-0910823b4543 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:37.195108 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76539e83-dd39-4f71-83f5-0910823b4543 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:37.195567 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76539e83-dd39-4f71-83f5-0910823b4543 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:37.256438 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-76539e83-dd39-4f71-83f5-0910823b4543 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:37.265430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-76539e83-dd39-4f71-83f5-0910823b4543 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:37.266921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-76539e83-dd39-4f71-83f5-0910823b4543 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:37.268099 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-76539e83-dd39-4f71-83f5-0910823b4543 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084893 May 10 21:26:37.268665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1215/1991] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:37 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:37.820160 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6cfb2102-a174-45c3-89ad-e0aeff311758 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:37.820835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6cfb2102-a174-45c3-89ad-e0aeff311758 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:37.828056 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6cfb2102-a174-45c3-89ad-e0aeff311758 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:37.828775 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6cfb2102-a174-45c3-89ad-e0aeff311758 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:37.829535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6cfb2102-a174-45c3-89ad-e0aeff311758 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:37.829973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6cfb2102-a174-45c3-89ad-e0aeff311758 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:37.889910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6cfb2102-a174-45c3-89ad-e0aeff311758 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:37.897222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6cfb2102-a174-45c3-89ad-e0aeff311758 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080909 May 10 21:26:37.897782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1216/1992] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:37 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:38.286799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9eebc5b4-a308-4e9b-be01-f924ae7f42dc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:38.287369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9eebc5b4-a308-4e9b-be01-f924ae7f42dc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:38.293267 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9eebc5b4-a308-4e9b-be01-f924ae7f42dc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:38.293855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9eebc5b4-a308-4e9b-be01-f924ae7f42dc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:38.294909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9eebc5b4-a308-4e9b-be01-f924ae7f42dc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:38.295428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9eebc5b4-a308-4e9b-be01-f924ae7f42dc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:38.357668 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9eebc5b4-a308-4e9b-be01-f924ae7f42dc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:38.365877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9eebc5b4-a308-4e9b-be01-f924ae7f42dc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:38.367416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9eebc5b4-a308-4e9b-be01-f924ae7f42dc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:38.368551 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9eebc5b4-a308-4e9b-be01-f924ae7f42dc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085728 May 10 21:26:38.369116 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1217/1993] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:38 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:38.913819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-87eaa383-a0ac-4299-b10e-237da7626293 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:38.914421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-87eaa383-a0ac-4299-b10e-237da7626293 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:38.921313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87eaa383-a0ac-4299-b10e-237da7626293 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:38.921764 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87eaa383-a0ac-4299-b10e-237da7626293 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:38.922518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87eaa383-a0ac-4299-b10e-237da7626293 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:38.922951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87eaa383-a0ac-4299-b10e-237da7626293 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:38.983175 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-87eaa383-a0ac-4299-b10e-237da7626293 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:38.990450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-87eaa383-a0ac-4299-b10e-237da7626293 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080572 May 10 21:26:38.991015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1218/1994] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:38 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:39.387823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-11cb9e36-e0ea-4120-8fcb-a6c5c876df0d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:39.388431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-11cb9e36-e0ea-4120-8fcb-a6c5c876df0d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:39.394314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-11cb9e36-e0ea-4120-8fcb-a6c5c876df0d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:39.394759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-11cb9e36-e0ea-4120-8fcb-a6c5c876df0d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:39.395609 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-11cb9e36-e0ea-4120-8fcb-a6c5c876df0d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:39.396072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-11cb9e36-e0ea-4120-8fcb-a6c5c876df0d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:39.456455 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-11cb9e36-e0ea-4120-8fcb-a6c5c876df0d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:39.464722 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-11cb9e36-e0ea-4120-8fcb-a6c5c876df0d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:39.466842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-11cb9e36-e0ea-4120-8fcb-a6c5c876df0d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:39.468023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-11cb9e36-e0ea-4120-8fcb-a6c5c876df0d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084707 May 10 21:26:39.468588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1219/1995] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:39 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:40.007239 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-141d7b13-6da4-48e9-8c67-bd77208bfa1f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:40.007893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-141d7b13-6da4-48e9-8c67-bd77208bfa1f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:40.014779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-141d7b13-6da4-48e9-8c67-bd77208bfa1f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:40.015249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-141d7b13-6da4-48e9-8c67-bd77208bfa1f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:40.016006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-141d7b13-6da4-48e9-8c67-bd77208bfa1f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:40.016440 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-141d7b13-6da4-48e9-8c67-bd77208bfa1f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:40.076283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-141d7b13-6da4-48e9-8c67-bd77208bfa1f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:40.083822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-141d7b13-6da4-48e9-8c67-bd77208bfa1f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080464 May 10 21:26:40.084384 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1220/1996] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:40 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:40.485226 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-df21d5d1-dd67-4461-8665-cc0e1d69c44d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:40.485841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-df21d5d1-dd67-4461-8665-cc0e1d69c44d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:40.491874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df21d5d1-dd67-4461-8665-cc0e1d69c44d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:40.492330 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df21d5d1-dd67-4461-8665-cc0e1d69c44d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:40.493101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df21d5d1-dd67-4461-8665-cc0e1d69c44d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:40.493619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df21d5d1-dd67-4461-8665-cc0e1d69c44d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:40.558108 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-df21d5d1-dd67-4461-8665-cc0e1d69c44d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:40.567372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-df21d5d1-dd67-4461-8665-cc0e1d69c44d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:40.568897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-df21d5d1-dd67-4461-8665-cc0e1d69c44d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:40.570052 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-df21d5d1-dd67-4461-8665-cc0e1d69c44d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.088964 May 10 21:26:40.570622 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1221/1997] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:40 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:41.100893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f28d7419-c684-4c94-a57e-f834b4cb57f2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:41.101547 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f28d7419-c684-4c94-a57e-f834b4cb57f2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:41.108055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f28d7419-c684-4c94-a57e-f834b4cb57f2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:41.108502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f28d7419-c684-4c94-a57e-f834b4cb57f2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:41.109257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f28d7419-c684-4c94-a57e-f834b4cb57f2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:41.109696 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f28d7419-c684-4c94-a57e-f834b4cb57f2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:41.168959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f28d7419-c684-4c94-a57e-f834b4cb57f2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:41.176251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f28d7419-c684-4c94-a57e-f834b4cb57f2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079255 May 10 21:26:41.176814 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1222/1998] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:41 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:41.588479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dc222a7a-327e-4540-848b-392cb1abd684 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:41.589087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dc222a7a-327e-4540-848b-392cb1abd684 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:41.595299 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dc222a7a-327e-4540-848b-392cb1abd684 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:41.595747 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dc222a7a-327e-4540-848b-392cb1abd684 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:41.596530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dc222a7a-327e-4540-848b-392cb1abd684 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:41.596963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dc222a7a-327e-4540-848b-392cb1abd684 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:41.657892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dc222a7a-327e-4540-848b-392cb1abd684 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:41.665934 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dc222a7a-327e-4540-848b-392cb1abd684 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:41.667471 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dc222a7a-327e-4540-848b-392cb1abd684 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:41.668764 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dc222a7a-327e-4540-848b-392cb1abd684 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084124 May 10 21:26:41.669421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1223/1999] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:41 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:42.193202 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-28d0dc8a-0a0a-4917-b10b-71ee2c1d0260 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:42.193880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-28d0dc8a-0a0a-4917-b10b-71ee2c1d0260 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:42.200912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28d0dc8a-0a0a-4917-b10b-71ee2c1d0260 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:42.201355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28d0dc8a-0a0a-4917-b10b-71ee2c1d0260 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:42.202110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28d0dc8a-0a0a-4917-b10b-71ee2c1d0260 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:42.202544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28d0dc8a-0a0a-4917-b10b-71ee2c1d0260 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:42.261768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-28d0dc8a-0a0a-4917-b10b-71ee2c1d0260 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:42.269899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-28d0dc8a-0a0a-4917-b10b-71ee2c1d0260 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080573 May 10 21:26:42.270457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1224/2000] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:42 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:42.686589 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-70574a41-ccac-49b9-b4fe-1dc196eca343 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:42.687214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-70574a41-ccac-49b9-b4fe-1dc196eca343 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:42.693131 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-70574a41-ccac-49b9-b4fe-1dc196eca343 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:42.693575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-70574a41-ccac-49b9-b4fe-1dc196eca343 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:42.694327 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-70574a41-ccac-49b9-b4fe-1dc196eca343 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:42.694758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-70574a41-ccac-49b9-b4fe-1dc196eca343 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:42.757340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-70574a41-ccac-49b9-b4fe-1dc196eca343 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:42.766308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-70574a41-ccac-49b9-b4fe-1dc196eca343 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:42.767850 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-70574a41-ccac-49b9-b4fe-1dc196eca343 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:42.768986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-70574a41-ccac-49b9-b4fe-1dc196eca343 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086402 May 10 21:26:42.769544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1225/2001] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:42 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:43.286936 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4ee069bf-c3c3-4afb-affb-9cf7cb3d8bcc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:43.287618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4ee069bf-c3c3-4afb-affb-9cf7cb3d8bcc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:43.294085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4ee069bf-c3c3-4afb-affb-9cf7cb3d8bcc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:43.294554 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4ee069bf-c3c3-4afb-affb-9cf7cb3d8bcc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:43.295346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4ee069bf-c3c3-4afb-affb-9cf7cb3d8bcc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:43.295777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4ee069bf-c3c3-4afb-affb-9cf7cb3d8bcc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:43.355467 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4ee069bf-c3c3-4afb-affb-9cf7cb3d8bcc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:43.362826 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4ee069bf-c3c3-4afb-affb-9cf7cb3d8bcc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079772 May 10 21:26:43.363417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1226/2002] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:43 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:43.786978 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ad6bcdd7-1b52-45eb-babb-fe8cee7faa6c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:43.787645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ad6bcdd7-1b52-45eb-babb-fe8cee7faa6c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:43.793888 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ad6bcdd7-1b52-45eb-babb-fe8cee7faa6c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:43.794333 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ad6bcdd7-1b52-45eb-babb-fe8cee7faa6c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:43.795084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ad6bcdd7-1b52-45eb-babb-fe8cee7faa6c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:43.795539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ad6bcdd7-1b52-45eb-babb-fe8cee7faa6c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:43.855027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ad6bcdd7-1b52-45eb-babb-fe8cee7faa6c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:43.863938 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ad6bcdd7-1b52-45eb-babb-fe8cee7faa6c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:43.865376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ad6bcdd7-1b52-45eb-babb-fe8cee7faa6c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:43.866517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ad6bcdd7-1b52-45eb-babb-fe8cee7faa6c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083505 May 10 21:26:43.867070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1227/2003] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:43 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:44.379541 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-99d1b8da-40d0-4006-a49c-4dec4628db3d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:44.380193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-99d1b8da-40d0-4006-a49c-4dec4628db3d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:44.386112 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-99d1b8da-40d0-4006-a49c-4dec4628db3d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:44.386563 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-99d1b8da-40d0-4006-a49c-4dec4628db3d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:44.387927 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-99d1b8da-40d0-4006-a49c-4dec4628db3d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:44.388420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-99d1b8da-40d0-4006-a49c-4dec4628db3d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:44.448428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-99d1b8da-40d0-4006-a49c-4dec4628db3d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:44.456110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-99d1b8da-40d0-4006-a49c-4dec4628db3d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080459 May 10 21:26:44.456668 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1228/2004] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:44 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:44.884932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-604a8fbf-de39-48e4-a8cf-c2ed038e7a98 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:44.885566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-604a8fbf-de39-48e4-a8cf-c2ed038e7a98 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:44.892551 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-604a8fbf-de39-48e4-a8cf-c2ed038e7a98 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:44.893003 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-604a8fbf-de39-48e4-a8cf-c2ed038e7a98 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:44.893765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-604a8fbf-de39-48e4-a8cf-c2ed038e7a98 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:44.894203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-604a8fbf-de39-48e4-a8cf-c2ed038e7a98 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:44.961121 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-604a8fbf-de39-48e4-a8cf-c2ed038e7a98 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:44.970371 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-604a8fbf-de39-48e4-a8cf-c2ed038e7a98 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:44.971986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-604a8fbf-de39-48e4-a8cf-c2ed038e7a98 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:44.973143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-604a8fbf-de39-48e4-a8cf-c2ed038e7a98 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.092173 May 10 21:26:44.973703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1229/2005] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:44 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:45.473497 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9086859e-e463-4e6b-b5ad-cd109003b15e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:45.474171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9086859e-e463-4e6b-b5ad-cd109003b15e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:45.480154 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9086859e-e463-4e6b-b5ad-cd109003b15e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:45.480602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9086859e-e463-4e6b-b5ad-cd109003b15e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:45.481887 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9086859e-e463-4e6b-b5ad-cd109003b15e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:45.482313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9086859e-e463-4e6b-b5ad-cd109003b15e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:45.541890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9086859e-e463-4e6b-b5ad-cd109003b15e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:45.549944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9086859e-e463-4e6b-b5ad-cd109003b15e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080298 May 10 21:26:45.550498 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1230/2006] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:45 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:45.991022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e36fcef0-9e63-464a-a1f1-f9a2744268f2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:45.991674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e36fcef0-9e63-464a-a1f1-f9a2744268f2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:45.998142 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e36fcef0-9e63-464a-a1f1-f9a2744268f2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:45.998604 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e36fcef0-9e63-464a-a1f1-f9a2744268f2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:45.999397 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e36fcef0-9e63-464a-a1f1-f9a2744268f2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:45.999844 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e36fcef0-9e63-464a-a1f1-f9a2744268f2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:46.067170 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e36fcef0-9e63-464a-a1f1-f9a2744268f2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:46.068224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e36fcef0-9e63-464a-a1f1-f9a2744268f2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:46.069744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e36fcef0-9e63-464a-a1f1-f9a2744268f2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:46.070896 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e36fcef0-9e63-464a-a1f1-f9a2744268f2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083836 May 10 21:26:46.071499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1231/2007] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:45 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:46.567930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2aec5004-494f-4fbc-8890-a17c8025615c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:46.568650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2aec5004-494f-4fbc-8890-a17c8025615c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:46.574463 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2aec5004-494f-4fbc-8890-a17c8025615c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:46.575590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2aec5004-494f-4fbc-8890-a17c8025615c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:46.576345 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2aec5004-494f-4fbc-8890-a17c8025615c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:46.576780 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2aec5004-494f-4fbc-8890-a17c8025615c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:46.638500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2aec5004-494f-4fbc-8890-a17c8025615c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:46.645745 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2aec5004-494f-4fbc-8890-a17c8025615c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081793 May 10 21:26:46.646304 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1232/2008] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:46 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:47.090107 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ed887e25-c958-418d-8e19-0c7998e6f3b2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:47.091325 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ed887e25-c958-418d-8e19-0c7998e6f3b2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:47.097655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed887e25-c958-418d-8e19-0c7998e6f3b2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:47.098102 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed887e25-c958-418d-8e19-0c7998e6f3b2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:47.098857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed887e25-c958-418d-8e19-0c7998e6f3b2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:47.099319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed887e25-c958-418d-8e19-0c7998e6f3b2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:47.162431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ed887e25-c958-418d-8e19-0c7998e6f3b2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:47.170844 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ed887e25-c958-418d-8e19-0c7998e6f3b2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:47.172499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ed887e25-c958-418d-8e19-0c7998e6f3b2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:47.173687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ed887e25-c958-418d-8e19-0c7998e6f3b2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087506 May 10 21:26:47.174242 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1233/2009] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:47 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:47.662959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d660388b-7ec7-42d2-a21b-6d7800950407 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:47.663597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d660388b-7ec7-42d2-a21b-6d7800950407 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:47.669706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d660388b-7ec7-42d2-a21b-6d7800950407 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:47.670153 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d660388b-7ec7-42d2-a21b-6d7800950407 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:47.670907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d660388b-7ec7-42d2-a21b-6d7800950407 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:47.671373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d660388b-7ec7-42d2-a21b-6d7800950407 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:47.730386 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d660388b-7ec7-42d2-a21b-6d7800950407 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:47.737786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d660388b-7ec7-42d2-a21b-6d7800950407 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078757 May 10 21:26:47.738339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1234/2010] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:47 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:48.191657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-768b8b52-782c-49d8-9697-1f9af0d652d1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:48.192270 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-768b8b52-782c-49d8-9697-1f9af0d652d1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:48.198600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-768b8b52-782c-49d8-9697-1f9af0d652d1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:48.199055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-768b8b52-782c-49d8-9697-1f9af0d652d1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:48.200968 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-768b8b52-782c-49d8-9697-1f9af0d652d1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:48.201412 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-768b8b52-782c-49d8-9697-1f9af0d652d1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:48.261613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-768b8b52-782c-49d8-9697-1f9af0d652d1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:48.270761 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-768b8b52-782c-49d8-9697-1f9af0d652d1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:48.272299 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-768b8b52-782c-49d8-9697-1f9af0d652d1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:48.273435 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-768b8b52-782c-49d8-9697-1f9af0d652d1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085693 May 10 21:26:48.274002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1235/2011] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:48 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:48.753692 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1e93b79d-4491-46f1-8cb4-695adc2065e5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:48.754342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1e93b79d-4491-46f1-8cb4-695adc2065e5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:48.760298 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1e93b79d-4491-46f1-8cb4-695adc2065e5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:48.760733 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1e93b79d-4491-46f1-8cb4-695adc2065e5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:48.761494 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1e93b79d-4491-46f1-8cb4-695adc2065e5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:48.762046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1e93b79d-4491-46f1-8cb4-695adc2065e5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:48.821125 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1e93b79d-4491-46f1-8cb4-695adc2065e5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:48.829274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1e93b79d-4491-46f1-8cb4-695adc2065e5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079451 May 10 21:26:48.829841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1236/2012] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:48 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:49.291298 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-aee9377b-aa5d-473e-b13a-35a7680cb640 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:49.291918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-aee9377b-aa5d-473e-b13a-35a7680cb640 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:49.299047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aee9377b-aa5d-473e-b13a-35a7680cb640 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:49.299572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aee9377b-aa5d-473e-b13a-35a7680cb640 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:49.300342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aee9377b-aa5d-473e-b13a-35a7680cb640 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:49.300785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aee9377b-aa5d-473e-b13a-35a7680cb640 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:49.365383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-aee9377b-aa5d-473e-b13a-35a7680cb640 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:49.374329 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-aee9377b-aa5d-473e-b13a-35a7680cb640 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:49.375878 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-aee9377b-aa5d-473e-b13a-35a7680cb640 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:49.377019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-aee9377b-aa5d-473e-b13a-35a7680cb640 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.089700 May 10 21:26:49.377579 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1237/2013] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:49 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:49.847004 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dfc327e0-7e9b-4b2c-95aa-73748ecab8ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:49.847663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dfc327e0-7e9b-4b2c-95aa-73748ecab8ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:49.853545 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dfc327e0-7e9b-4b2c-95aa-73748ecab8ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:49.853988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dfc327e0-7e9b-4b2c-95aa-73748ecab8ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:49.854733 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dfc327e0-7e9b-4b2c-95aa-73748ecab8ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:49.855189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dfc327e0-7e9b-4b2c-95aa-73748ecab8ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:49.914802 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dfc327e0-7e9b-4b2c-95aa-73748ecab8ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:49.922256 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dfc327e0-7e9b-4b2c-95aa-73748ecab8ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079103 May 10 21:26:49.922815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1238/2014] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:49 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:50.394959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e742244c-407b-4fb3-91d4-f025fda2b30a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:50.409057 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e742244c-407b-4fb3-91d4-f025fda2b30a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:50.409057 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e742244c-407b-4fb3-91d4-f025fda2b30a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:50.409057 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e742244c-407b-4fb3-91d4-f025fda2b30a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:50.409057 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e742244c-407b-4fb3-91d4-f025fda2b30a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:50.409473 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e742244c-407b-4fb3-91d4-f025fda2b30a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:50.464489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e742244c-407b-4fb3-91d4-f025fda2b30a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:50.473182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e742244c-407b-4fb3-91d4-f025fda2b30a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:50.474631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e742244c-407b-4fb3-91d4-f025fda2b30a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:50.475818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e742244c-407b-4fb3-91d4-f025fda2b30a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084896 May 10 21:26:50.476379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1239/2015] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:50 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:50.940073 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bd6d9ab5-97e3-441e-8fbd-3783a81ce301 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:50.940747 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bd6d9ab5-97e3-441e-8fbd-3783a81ce301 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:50.946562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bd6d9ab5-97e3-441e-8fbd-3783a81ce301 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:50.947014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bd6d9ab5-97e3-441e-8fbd-3783a81ce301 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:50.947803 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bd6d9ab5-97e3-441e-8fbd-3783a81ce301 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:50.948238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bd6d9ab5-97e3-441e-8fbd-3783a81ce301 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:51.008200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bd6d9ab5-97e3-441e-8fbd-3783a81ce301 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:51.015628 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bd6d9ab5-97e3-441e-8fbd-3783a81ce301 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080312 May 10 21:26:51.016182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1240/2016] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:50 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:51.494370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d83aeb39-e19b-4b50-b6c5-a4f572879cae tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:51.494982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d83aeb39-e19b-4b50-b6c5-a4f572879cae tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:51.501734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d83aeb39-e19b-4b50-b6c5-a4f572879cae tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:51.502185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d83aeb39-e19b-4b50-b6c5-a4f572879cae tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:51.502947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d83aeb39-e19b-4b50-b6c5-a4f572879cae tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:51.503418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d83aeb39-e19b-4b50-b6c5-a4f572879cae tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:51.800245 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d83aeb39-e19b-4b50-b6c5-a4f572879cae tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:51.808569 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d83aeb39-e19b-4b50-b6c5-a4f572879cae tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:51.810590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d83aeb39-e19b-4b50-b6c5-a4f572879cae tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:51.811840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d83aeb39-e19b-4b50-b6c5-a4f572879cae tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.321487 May 10 21:26:51.812408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1241/2017] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:51 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:52.032848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-86d271eb-59fd-4d6d-94ed-1435984827bf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:52.033566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-86d271eb-59fd-4d6d-94ed-1435984827bf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:52.039596 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-86d271eb-59fd-4d6d-94ed-1435984827bf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:52.040036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-86d271eb-59fd-4d6d-94ed-1435984827bf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:52.041008 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-86d271eb-59fd-4d6d-94ed-1435984827bf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:52.041443 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-86d271eb-59fd-4d6d-94ed-1435984827bf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:52.101161 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-86d271eb-59fd-4d6d-94ed-1435984827bf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:52.108733 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-86d271eb-59fd-4d6d-94ed-1435984827bf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080282 May 10 21:26:52.109290 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1242/2018] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:52 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:52.830625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-38c4e268-24d0-4238-8b25-14dab428823e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:52.831286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-38c4e268-24d0-4238-8b25-14dab428823e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:52.837856 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38c4e268-24d0-4238-8b25-14dab428823e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:52.838305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38c4e268-24d0-4238-8b25-14dab428823e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:52.839063 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38c4e268-24d0-4238-8b25-14dab428823e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:52.839524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38c4e268-24d0-4238-8b25-14dab428823e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:52.899321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-38c4e268-24d0-4238-8b25-14dab428823e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:52.907685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-38c4e268-24d0-4238-8b25-14dab428823e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:52.909180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-38c4e268-24d0-4238-8b25-14dab428823e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:52.910313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-38c4e268-24d0-4238-8b25-14dab428823e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084841 May 10 21:26:52.910870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1243/2019] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:52 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:53.126211 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e1e5089e-c140-4c2d-8e04-9995f0ac49af tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:53.126875 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e1e5089e-c140-4c2d-8e04-9995f0ac49af tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:53.132762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e1e5089e-c140-4c2d-8e04-9995f0ac49af tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:53.133210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e1e5089e-c140-4c2d-8e04-9995f0ac49af tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:53.133959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e1e5089e-c140-4c2d-8e04-9995f0ac49af tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:53.134392 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e1e5089e-c140-4c2d-8e04-9995f0ac49af tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:53.193473 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e1e5089e-c140-4c2d-8e04-9995f0ac49af tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:53.200954 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e1e5089e-c140-4c2d-8e04-9995f0ac49af tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079360 May 10 21:26:53.201516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1244/2020] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:53 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:53.928854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8baa6ad9-9a38-4b4a-8d23-1a064233bff6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:53.929381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8baa6ad9-9a38-4b4a-8d23-1a064233bff6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:53.936258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8baa6ad9-9a38-4b4a-8d23-1a064233bff6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:53.936703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8baa6ad9-9a38-4b4a-8d23-1a064233bff6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:53.937459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8baa6ad9-9a38-4b4a-8d23-1a064233bff6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:53.937908 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8baa6ad9-9a38-4b4a-8d23-1a064233bff6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:54.000741 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8baa6ad9-9a38-4b4a-8d23-1a064233bff6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:54.008880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8baa6ad9-9a38-4b4a-8d23-1a064233bff6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:54.010371 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8baa6ad9-9a38-4b4a-8d23-1a064233bff6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:54.011535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8baa6ad9-9a38-4b4a-8d23-1a064233bff6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086701 May 10 21:26:54.012088 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1245/2021] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:53 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:54.218174 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-71d8a7b1-0b5d-421b-9bb4-b1c370575801 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:54.218807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-71d8a7b1-0b5d-421b-9bb4-b1c370575801 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:54.224807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71d8a7b1-0b5d-421b-9bb4-b1c370575801 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:54.225252 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71d8a7b1-0b5d-421b-9bb4-b1c370575801 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:54.226011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71d8a7b1-0b5d-421b-9bb4-b1c370575801 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:54.226445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71d8a7b1-0b5d-421b-9bb4-b1c370575801 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:54.285936 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-71d8a7b1-0b5d-421b-9bb4-b1c370575801 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:54.293258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-71d8a7b1-0b5d-421b-9bb4-b1c370575801 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079468 May 10 21:26:54.294856 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1246/2022] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:54 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:55.029999 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c30b5fc1-0763-4dcb-867c-4e7391b462d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:55.030859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c30b5fc1-0763-4dcb-867c-4e7391b462d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:55.037730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c30b5fc1-0763-4dcb-867c-4e7391b462d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:55.038178 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c30b5fc1-0763-4dcb-867c-4e7391b462d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:55.038945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c30b5fc1-0763-4dcb-867c-4e7391b462d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:55.039411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c30b5fc1-0763-4dcb-867c-4e7391b462d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:55.100446 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c30b5fc1-0763-4dcb-867c-4e7391b462d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:55.109472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c30b5fc1-0763-4dcb-867c-4e7391b462d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:55.111062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c30b5fc1-0763-4dcb-867c-4e7391b462d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:55.112238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c30b5fc1-0763-4dcb-867c-4e7391b462d0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086843 May 10 21:26:55.112806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1247/2023] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:55 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:55.311493 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c0b73c8c-3a0a-474b-a2e3-a22d136a25d3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:55.312104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c0b73c8c-3a0a-474b-a2e3-a22d136a25d3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:55.318098 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c0b73c8c-3a0a-474b-a2e3-a22d136a25d3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:55.318548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c0b73c8c-3a0a-474b-a2e3-a22d136a25d3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:55.319346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c0b73c8c-3a0a-474b-a2e3-a22d136a25d3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:55.319784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c0b73c8c-3a0a-474b-a2e3-a22d136a25d3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:55.380285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c0b73c8c-3a0a-474b-a2e3-a22d136a25d3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:55.387492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c0b73c8c-3a0a-474b-a2e3-a22d136a25d3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080794 May 10 21:26:55.388603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1248/2024] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:55 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:56.130296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b2f6b584-2338-439b-a497-17945c4d1097 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:56.130941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b2f6b584-2338-439b-a497-17945c4d1097 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:56.137330 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b2f6b584-2338-439b-a497-17945c4d1097 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:56.138401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b2f6b584-2338-439b-a497-17945c4d1097 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:56.139328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b2f6b584-2338-439b-a497-17945c4d1097 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:56.139773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b2f6b584-2338-439b-a497-17945c4d1097 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:56.203732 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b2f6b584-2338-439b-a497-17945c4d1097 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:56.211904 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b2f6b584-2338-439b-a497-17945c4d1097 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:56.213399 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b2f6b584-2338-439b-a497-17945c4d1097 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:56.214527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b2f6b584-2338-439b-a497-17945c4d1097 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.088132 May 10 21:26:56.215097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1249/2025] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:56 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:56.404506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-aca983ce-38da-431e-bc53-022ba3c29b93 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:56.405138 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-aca983ce-38da-431e-bc53-022ba3c29b93 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:56.411069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aca983ce-38da-431e-bc53-022ba3c29b93 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:56.411553 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aca983ce-38da-431e-bc53-022ba3c29b93 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:56.412317 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aca983ce-38da-431e-bc53-022ba3c29b93 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:56.412752 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aca983ce-38da-431e-bc53-022ba3c29b93 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:56.472209 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-aca983ce-38da-431e-bc53-022ba3c29b93 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:56.479462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-aca983ce-38da-431e-bc53-022ba3c29b93 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078938 May 10 21:26:56.480025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1250/2026] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:56 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:57.232966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-74a9797e-b77a-4812-bf57-f303432b7471 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:57.233580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-74a9797e-b77a-4812-bf57-f303432b7471 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:57.240061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74a9797e-b77a-4812-bf57-f303432b7471 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:57.240516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74a9797e-b77a-4812-bf57-f303432b7471 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:57.241278 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74a9797e-b77a-4812-bf57-f303432b7471 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:57.241716 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74a9797e-b77a-4812-bf57-f303432b7471 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:57.302336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-74a9797e-b77a-4812-bf57-f303432b7471 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:57.311411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-74a9797e-b77a-4812-bf57-f303432b7471 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:57.312920 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-74a9797e-b77a-4812-bf57-f303432b7471 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:57.314059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-74a9797e-b77a-4812-bf57-f303432b7471 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085271 May 10 21:26:57.314625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1251/2027] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:57 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:57.496485 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0270953f-4a6a-4b7c-9a06-089b94be956c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:57.497106 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0270953f-4a6a-4b7c-9a06-089b94be956c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:57.503700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0270953f-4a6a-4b7c-9a06-089b94be956c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:57.504151 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0270953f-4a6a-4b7c-9a06-089b94be956c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:57.504915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0270953f-4a6a-4b7c-9a06-089b94be956c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:57.505350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0270953f-4a6a-4b7c-9a06-089b94be956c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:57.565615 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0270953f-4a6a-4b7c-9a06-089b94be956c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:57.572930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0270953f-4a6a-4b7c-9a06-089b94be956c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080371 May 10 21:26:57.573486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1252/2028] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:57 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:58.332695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-923439dd-6a2a-40a0-a718-c4bb40233824 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:58.333303 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-923439dd-6a2a-40a0-a718-c4bb40233824 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:58.339710 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-923439dd-6a2a-40a0-a718-c4bb40233824 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:58.340157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-923439dd-6a2a-40a0-a718-c4bb40233824 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:58.341562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-923439dd-6a2a-40a0-a718-c4bb40233824 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:58.342024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-923439dd-6a2a-40a0-a718-c4bb40233824 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:58.406658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-923439dd-6a2a-40a0-a718-c4bb40233824 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:58.414772 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-923439dd-6a2a-40a0-a718-c4bb40233824 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:58.416305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-923439dd-6a2a-40a0-a718-c4bb40233824 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:58.417434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-923439dd-6a2a-40a0-a718-c4bb40233824 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.088926 May 10 21:26:58.417988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1253/2029] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:58 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:58.590375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2e2a10b8-3311-4594-a2b1-8dea8597068a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:58.591238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2e2a10b8-3311-4594-a2b1-8dea8597068a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:58.597676 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e2a10b8-3311-4594-a2b1-8dea8597068a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:58.598154 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e2a10b8-3311-4594-a2b1-8dea8597068a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:58.598923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e2a10b8-3311-4594-a2b1-8dea8597068a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:58.599397 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e2a10b8-3311-4594-a2b1-8dea8597068a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:58.659312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2e2a10b8-3311-4594-a2b1-8dea8597068a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:58.666584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2e2a10b8-3311-4594-a2b1-8dea8597068a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079911 May 10 21:26:58.667162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1254/2030] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:58 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:26:59.435514 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6092db1b-c23d-4389-8401-e2052cfdd446 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:59.436126 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6092db1b-c23d-4389-8401-e2052cfdd446 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:59.442532 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6092db1b-c23d-4389-8401-e2052cfdd446 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:59.442983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6092db1b-c23d-4389-8401-e2052cfdd446 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:59.443786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6092db1b-c23d-4389-8401-e2052cfdd446 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:59.444223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6092db1b-c23d-4389-8401-e2052cfdd446 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:59.504654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6092db1b-c23d-4389-8401-e2052cfdd446 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:59.512899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6092db1b-c23d-4389-8401-e2052cfdd446 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:59.514404 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6092db1b-c23d-4389-8401-e2052cfdd446 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:59.515576 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6092db1b-c23d-4389-8401-e2052cfdd446 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084072 May 10 21:26:59.516136 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1255/2031] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:26:59 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:26:59.683682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8d378e99-36a7-4f4f-a629-0efac62f1911 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:26:59.684282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8d378e99-36a7-4f4f-a629-0efac62f1911 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:26:59.690446 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8d378e99-36a7-4f4f-a629-0efac62f1911 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:59.690836 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8d378e99-36a7-4f4f-a629-0efac62f1911 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:59.691618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8d378e99-36a7-4f4f-a629-0efac62f1911 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:26:59.692051 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8d378e99-36a7-4f4f-a629-0efac62f1911 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:26:59.754149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8d378e99-36a7-4f4f-a629-0efac62f1911 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:26:59.761478 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8d378e99-36a7-4f4f-a629-0efac62f1911 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081587 May 10 21:26:59.762030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1256/2032] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:26:59 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:00.534631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-991fe347-f264-4c8e-919a-f81247ffedbc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:00.535178 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-991fe347-f264-4c8e-919a-f81247ffedbc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:00.541550 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-991fe347-f264-4c8e-919a-f81247ffedbc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:00.541997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-991fe347-f264-4c8e-919a-f81247ffedbc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:00.542749 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-991fe347-f264-4c8e-919a-f81247ffedbc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:00.543209 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-991fe347-f264-4c8e-919a-f81247ffedbc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:00.608997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-991fe347-f264-4c8e-919a-f81247ffedbc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:00.617806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-991fe347-f264-4c8e-919a-f81247ffedbc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:00.619365 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-991fe347-f264-4c8e-919a-f81247ffedbc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:00.620510 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-991fe347-f264-4c8e-919a-f81247ffedbc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.089946 May 10 21:27:00.621072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1257/2033] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:00 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:00.778943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-63523af0-2311-42f7-8350-1a989b088d93 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:00.779653 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-63523af0-2311-42f7-8350-1a989b088d93 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:00.785607 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-63523af0-2311-42f7-8350-1a989b088d93 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:00.786015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-63523af0-2311-42f7-8350-1a989b088d93 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:00.786781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-63523af0-2311-42f7-8350-1a989b088d93 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:00.787264 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-63523af0-2311-42f7-8350-1a989b088d93 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:00.846375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-63523af0-2311-42f7-8350-1a989b088d93 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:00.853748 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-63523af0-2311-42f7-8350-1a989b088d93 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078665 May 10 21:27:00.854312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1258/2034] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:00 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:01.638536 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c6a4643f-9468-48cb-8770-0e17d02fd4a4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:01.639155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c6a4643f-9468-48cb-8770-0e17d02fd4a4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:01.645475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c6a4643f-9468-48cb-8770-0e17d02fd4a4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:01.645919 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c6a4643f-9468-48cb-8770-0e17d02fd4a4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:01.646675 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c6a4643f-9468-48cb-8770-0e17d02fd4a4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:01.647109 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c6a4643f-9468-48cb-8770-0e17d02fd4a4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:01.708289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c6a4643f-9468-48cb-8770-0e17d02fd4a4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:01.716892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c6a4643f-9468-48cb-8770-0e17d02fd4a4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:01.718382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c6a4643f-9468-48cb-8770-0e17d02fd4a4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:01.719542 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c6a4643f-9468-48cb-8770-0e17d02fd4a4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085172 May 10 21:27:01.720097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1259/2035] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:01 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:01.870564 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dc5cea26-202a-4092-8a8c-1e3499ba48b0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:01.871234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dc5cea26-202a-4092-8a8c-1e3499ba48b0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:01.877252 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dc5cea26-202a-4092-8a8c-1e3499ba48b0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:01.877693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dc5cea26-202a-4092-8a8c-1e3499ba48b0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:01.878442 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dc5cea26-202a-4092-8a8c-1e3499ba48b0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:01.878874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dc5cea26-202a-4092-8a8c-1e3499ba48b0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:01.939301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dc5cea26-202a-4092-8a8c-1e3499ba48b0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:01.946549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dc5cea26-202a-4092-8a8c-1e3499ba48b0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079896 May 10 21:27:01.947103 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1260/2036] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:01 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:02.737939 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8ea25e48-c9f2-4f0c-9d5c-931aa6cc0dc5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:02.738551 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8ea25e48-c9f2-4f0c-9d5c-931aa6cc0dc5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:02.745041 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ea25e48-c9f2-4f0c-9d5c-931aa6cc0dc5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:02.745501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ea25e48-c9f2-4f0c-9d5c-931aa6cc0dc5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:02.746271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ea25e48-c9f2-4f0c-9d5c-931aa6cc0dc5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:02.746715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ea25e48-c9f2-4f0c-9d5c-931aa6cc0dc5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:02.813439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8ea25e48-c9f2-4f0c-9d5c-931aa6cc0dc5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:02.821743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8ea25e48-c9f2-4f0c-9d5c-931aa6cc0dc5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:02.823283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8ea25e48-c9f2-4f0c-9d5c-931aa6cc0dc5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:02.824415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8ea25e48-c9f2-4f0c-9d5c-931aa6cc0dc5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.090471 May 10 21:27:02.824980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1261/2037] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:02 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:02.964035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-29f5bccb-669e-4b69-a5e9-a855c5f24cb1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:02.964671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-29f5bccb-669e-4b69-a5e9-a855c5f24cb1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:02.971113 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-29f5bccb-669e-4b69-a5e9-a855c5f24cb1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:02.971591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-29f5bccb-669e-4b69-a5e9-a855c5f24cb1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:02.972356 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-29f5bccb-669e-4b69-a5e9-a855c5f24cb1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:02.972794 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-29f5bccb-669e-4b69-a5e9-a855c5f24cb1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:03.033988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-29f5bccb-669e-4b69-a5e9-a855c5f24cb1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:03.041273 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-29f5bccb-669e-4b69-a5e9-a855c5f24cb1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081070 May 10 21:27:03.041840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1262/2038] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:02 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:03.842557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3c88cdc8-b8ad-495e-88de-6b82b935e788 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:03.843193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3c88cdc8-b8ad-495e-88de-6b82b935e788 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:03.849548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3c88cdc8-b8ad-495e-88de-6b82b935e788 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:03.850001 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3c88cdc8-b8ad-495e-88de-6b82b935e788 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:03.850781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3c88cdc8-b8ad-495e-88de-6b82b935e788 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:03.851249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3c88cdc8-b8ad-495e-88de-6b82b935e788 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:03.911846 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3c88cdc8-b8ad-495e-88de-6b82b935e788 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:03.920797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3c88cdc8-b8ad-495e-88de-6b82b935e788 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:03.922318 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3c88cdc8-b8ad-495e-88de-6b82b935e788 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:03.923515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3c88cdc8-b8ad-495e-88de-6b82b935e788 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085429 May 10 21:27:03.924088 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1263/2039] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:03 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:04.057912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7e6716fd-0c0a-474e-bcce-37a907cd1b3a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:04.058548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7e6716fd-0c0a-474e-bcce-37a907cd1b3a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:04.064598 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7e6716fd-0c0a-474e-bcce-37a907cd1b3a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:04.065048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7e6716fd-0c0a-474e-bcce-37a907cd1b3a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:04.065812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7e6716fd-0c0a-474e-bcce-37a907cd1b3a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:04.066249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7e6716fd-0c0a-474e-bcce-37a907cd1b3a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:04.125846 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7e6716fd-0c0a-474e-bcce-37a907cd1b3a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:04.133137 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7e6716fd-0c0a-474e-bcce-37a907cd1b3a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078966 May 10 21:27:04.133698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1264/2040] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:04 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:04.941792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2012eb58-2046-4b15-a47b-5984f603e043 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:04.942315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2012eb58-2046-4b15-a47b-5984f603e043 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:04.948608 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2012eb58-2046-4b15-a47b-5984f603e043 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:04.949054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2012eb58-2046-4b15-a47b-5984f603e043 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:04.949806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2012eb58-2046-4b15-a47b-5984f603e043 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:04.950535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2012eb58-2046-4b15-a47b-5984f603e043 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:05.015720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2012eb58-2046-4b15-a47b-5984f603e043 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:05.024015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2012eb58-2046-4b15-a47b-5984f603e043 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:05.029640 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2012eb58-2046-4b15-a47b-5984f603e043 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:05.029640 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2012eb58-2046-4b15-a47b-5984f603e043 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.088853 May 10 21:27:05.029640 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1265/2041] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:04 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:05.149577 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d6a8e871-28f6-45b3-9246-c700270ca9c8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:05.150240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d6a8e871-28f6-45b3-9246-c700270ca9c8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:05.156245 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6a8e871-28f6-45b3-9246-c700270ca9c8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:05.156738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6a8e871-28f6-45b3-9246-c700270ca9c8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:05.157503 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6a8e871-28f6-45b3-9246-c700270ca9c8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:05.157941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6a8e871-28f6-45b3-9246-c700270ca9c8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:05.217911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d6a8e871-28f6-45b3-9246-c700270ca9c8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:05.225329 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d6a8e871-28f6-45b3-9246-c700270ca9c8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079538 May 10 21:27:05.225897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1266/2042] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:05 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:06.044770 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-77d85f61-ab27-4adb-82ad-f7e24da76242 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:06.045169 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-77d85f61-ab27-4adb-82ad-f7e24da76242 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:06.051595 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-77d85f61-ab27-4adb-82ad-f7e24da76242 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:06.052042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-77d85f61-ab27-4adb-82ad-f7e24da76242 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:06.052806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-77d85f61-ab27-4adb-82ad-f7e24da76242 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:06.053243 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-77d85f61-ab27-4adb-82ad-f7e24da76242 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:06.115660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-77d85f61-ab27-4adb-82ad-f7e24da76242 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:06.124289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-77d85f61-ab27-4adb-82ad-f7e24da76242 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:06.125790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-77d85f61-ab27-4adb-82ad-f7e24da76242 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:06.126925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-77d85f61-ab27-4adb-82ad-f7e24da76242 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087072 May 10 21:27:06.127546 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1267/2043] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:06 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:06.242883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bed3f236-fad1-413b-9586-56c81cb64971 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:06.243587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bed3f236-fad1-413b-9586-56c81cb64971 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:06.249957 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bed3f236-fad1-413b-9586-56c81cb64971 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:06.250401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bed3f236-fad1-413b-9586-56c81cb64971 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:06.251181 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bed3f236-fad1-413b-9586-56c81cb64971 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:06.251620 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bed3f236-fad1-413b-9586-56c81cb64971 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:06.315034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bed3f236-fad1-413b-9586-56c81cb64971 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:06.322448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bed3f236-fad1-413b-9586-56c81cb64971 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083535 May 10 21:27:06.323011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1268/2044] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:06 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:07.144754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8a225e90-d75f-4e1f-9e90-c2e3d5ce6e27 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:07.145360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8a225e90-d75f-4e1f-9e90-c2e3d5ce6e27 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:07.151727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8a225e90-d75f-4e1f-9e90-c2e3d5ce6e27 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:07.152172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8a225e90-d75f-4e1f-9e90-c2e3d5ce6e27 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:07.152923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8a225e90-d75f-4e1f-9e90-c2e3d5ce6e27 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:07.153413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8a225e90-d75f-4e1f-9e90-c2e3d5ce6e27 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:07.218893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8a225e90-d75f-4e1f-9e90-c2e3d5ce6e27 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:07.227051 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8a225e90-d75f-4e1f-9e90-c2e3d5ce6e27 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:07.228576 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8a225e90-d75f-4e1f-9e90-c2e3d5ce6e27 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:07.229712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8a225e90-d75f-4e1f-9e90-c2e3d5ce6e27 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.088886 May 10 21:27:07.230275 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1269/2045] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:07 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:27:07.340199 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f4a9499b-6229-4e3d-a84a-8dfb5077f653 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:07.341429 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f4a9499b-6229-4e3d-a84a-8dfb5077f653 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:07.347541 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4a9499b-6229-4e3d-a84a-8dfb5077f653 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:07.347987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4a9499b-6229-4e3d-a84a-8dfb5077f653 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:07.348773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4a9499b-6229-4e3d-a84a-8dfb5077f653 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:07.349200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4a9499b-6229-4e3d-a84a-8dfb5077f653 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:07.408873 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f4a9499b-6229-4e3d-a84a-8dfb5077f653 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:07.416100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f4a9499b-6229-4e3d-a84a-8dfb5077f653 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079734 May 10 21:27:07.416661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1270/2046] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:07 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:08.248098 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f5117671-b921-4fd5-891c-b92f2722f840 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:08.248698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f5117671-b921-4fd5-891c-b92f2722f840 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:08.255009 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5117671-b921-4fd5-891c-b92f2722f840 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:08.255488 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5117671-b921-4fd5-891c-b92f2722f840 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:08.256242 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5117671-b921-4fd5-891c-b92f2722f840 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:08.256675 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5117671-b921-4fd5-891c-b92f2722f840 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:08.317958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f5117671-b921-4fd5-891c-b92f2722f840 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:08.327280 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f5117671-b921-4fd5-891c-b92f2722f840 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:08.329046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f5117671-b921-4fd5-891c-b92f2722f840 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:08.330191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f5117671-b921-4fd5-891c-b92f2722f840 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086500 May 10 21:27:08.330754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1271/2047] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:08 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:08.432867 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7dccb50b-122a-4624-89b7-d1d2c69ea0f7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:08.433542 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7dccb50b-122a-4624-89b7-d1d2c69ea0f7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:08.440041 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7dccb50b-122a-4624-89b7-d1d2c69ea0f7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:08.440503 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7dccb50b-122a-4624-89b7-d1d2c69ea0f7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:08.441276 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7dccb50b-122a-4624-89b7-d1d2c69ea0f7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:08.441771 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7dccb50b-122a-4624-89b7-d1d2c69ea0f7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:08.508462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7dccb50b-122a-4624-89b7-d1d2c69ea0f7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:08.516347 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7dccb50b-122a-4624-89b7-d1d2c69ea0f7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.087331 May 10 21:27:08.516911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1272/2048] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:08 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:09.347969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-da503bdb-13f8-4628-92d6-3498612d8c89 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:09.348576 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-da503bdb-13f8-4628-92d6-3498612d8c89 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:09.354903 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-da503bdb-13f8-4628-92d6-3498612d8c89 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:09.355379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-da503bdb-13f8-4628-92d6-3498612d8c89 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:09.356132 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-da503bdb-13f8-4628-92d6-3498612d8c89 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:09.357296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-da503bdb-13f8-4628-92d6-3498612d8c89 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:09.420537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-da503bdb-13f8-4628-92d6-3498612d8c89 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:09.428707 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-da503bdb-13f8-4628-92d6-3498612d8c89 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:09.430206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-da503bdb-13f8-4628-92d6-3498612d8c89 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:09.431366 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-da503bdb-13f8-4628-92d6-3498612d8c89 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087275 May 10 21:27:09.431925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1273/2049] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:09 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:09.532901 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a09cdd2c-8a70-4107-953e-19857b46f581 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:09.533544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a09cdd2c-8a70-4107-953e-19857b46f581 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:09.539393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a09cdd2c-8a70-4107-953e-19857b46f581 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:09.539840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a09cdd2c-8a70-4107-953e-19857b46f581 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:09.540591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a09cdd2c-8a70-4107-953e-19857b46f581 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:09.541023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a09cdd2c-8a70-4107-953e-19857b46f581 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:09.600073 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a09cdd2c-8a70-4107-953e-19857b46f581 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:09.608479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a09cdd2c-8a70-4107-953e-19857b46f581 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079161 May 10 21:27:09.609002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1274/2050] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:09 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:10.450013 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-78b1ce91-9b77-45af-8bd7-f417d3063b2c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:10.450697 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-78b1ce91-9b77-45af-8bd7-f417d3063b2c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:10.457499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-78b1ce91-9b77-45af-8bd7-f417d3063b2c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:10.457957 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-78b1ce91-9b77-45af-8bd7-f417d3063b2c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:10.458727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-78b1ce91-9b77-45af-8bd7-f417d3063b2c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:10.459187 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-78b1ce91-9b77-45af-8bd7-f417d3063b2c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:10.522183 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-78b1ce91-9b77-45af-8bd7-f417d3063b2c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:10.531071 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-78b1ce91-9b77-45af-8bd7-f417d3063b2c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:10.532727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-78b1ce91-9b77-45af-8bd7-f417d3063b2c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:10.533859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-78b1ce91-9b77-45af-8bd7-f417d3063b2c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087873 May 10 21:27:10.534439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1275/2051] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:10 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:10.625179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f5b42b49-c0ae-473c-aa16-e0bd68e7b1c3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:10.625800 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f5b42b49-c0ae-473c-aa16-e0bd68e7b1c3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:10.631953 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5b42b49-c0ae-473c-aa16-e0bd68e7b1c3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:10.632411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5b42b49-c0ae-473c-aa16-e0bd68e7b1c3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:10.633177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5b42b49-c0ae-473c-aa16-e0bd68e7b1c3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:10.633621 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5b42b49-c0ae-473c-aa16-e0bd68e7b1c3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:10.694062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f5b42b49-c0ae-473c-aa16-e0bd68e7b1c3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:10.701481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f5b42b49-c0ae-473c-aa16-e0bd68e7b1c3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080077 May 10 21:27:10.702067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1276/2052] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:10 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:11.551907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-47f41ef6-c7b2-4ef6-9d49-13b61da683de tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:11.552582 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-47f41ef6-c7b2-4ef6-9d49-13b61da683de tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:11.558862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47f41ef6-c7b2-4ef6-9d49-13b61da683de tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:11.559348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47f41ef6-c7b2-4ef6-9d49-13b61da683de tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:11.560112 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47f41ef6-c7b2-4ef6-9d49-13b61da683de tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:11.560553 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47f41ef6-c7b2-4ef6-9d49-13b61da683de tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:11.627349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-47f41ef6-c7b2-4ef6-9d49-13b61da683de tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:11.635735 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-47f41ef6-c7b2-4ef6-9d49-13b61da683de tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:11.637234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-47f41ef6-c7b2-4ef6-9d49-13b61da683de tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:11.638365 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-47f41ef6-c7b2-4ef6-9d49-13b61da683de tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.090362 May 10 21:27:11.639697 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1277/2053] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:11 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:27:11.719231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1c257184-aedd-4aa1-9609-221299ba11e2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:11.719841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1c257184-aedd-4aa1-9609-221299ba11e2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:11.725734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1c257184-aedd-4aa1-9609-221299ba11e2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:11.726175 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1c257184-aedd-4aa1-9609-221299ba11e2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:11.726927 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1c257184-aedd-4aa1-9609-221299ba11e2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:11.727386 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1c257184-aedd-4aa1-9609-221299ba11e2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:11.789793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1c257184-aedd-4aa1-9609-221299ba11e2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:11.797380 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1c257184-aedd-4aa1-9609-221299ba11e2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082613 May 10 21:27:11.797941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1278/2054] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:11 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:12.657224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-af7ddd70-5a91-4b30-850d-42a75c0e5610 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:12.657891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-af7ddd70-5a91-4b30-850d-42a75c0e5610 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:12.664278 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af7ddd70-5a91-4b30-850d-42a75c0e5610 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:12.664730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af7ddd70-5a91-4b30-850d-42a75c0e5610 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:12.665500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af7ddd70-5a91-4b30-850d-42a75c0e5610 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:12.665944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af7ddd70-5a91-4b30-850d-42a75c0e5610 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:12.735522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-af7ddd70-5a91-4b30-850d-42a75c0e5610 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:12.743944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-af7ddd70-5a91-4b30-850d-42a75c0e5610 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:12.745458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-af7ddd70-5a91-4b30-850d-42a75c0e5610 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:12.746606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-af7ddd70-5a91-4b30-850d-42a75c0e5610 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.094013 May 10 21:27:12.747616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1279/2055] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:12 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:12.814332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5b789642-0c5d-4c1e-b4c3-980d50d0babd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:12.814948 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5b789642-0c5d-4c1e-b4c3-980d50d0babd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:12.820882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b789642-0c5d-4c1e-b4c3-980d50d0babd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:12.821340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b789642-0c5d-4c1e-b4c3-980d50d0babd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:12.822110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b789642-0c5d-4c1e-b4c3-980d50d0babd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:12.822552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b789642-0c5d-4c1e-b4c3-980d50d0babd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:12.899887 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5b789642-0c5d-4c1e-b4c3-980d50d0babd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:12.907313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5b789642-0c5d-4c1e-b4c3-980d50d0babd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.097428 May 10 21:27:12.907887 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1280/2056] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:12 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:13.765584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-699f34ff-2510-4709-8331-f6c709b532ea tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:13.766226 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-699f34ff-2510-4709-8331-f6c709b532ea tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:13.772336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-699f34ff-2510-4709-8331-f6c709b532ea tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:13.772845 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-699f34ff-2510-4709-8331-f6c709b532ea tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:13.773599 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-699f34ff-2510-4709-8331-f6c709b532ea tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:13.774030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-699f34ff-2510-4709-8331-f6c709b532ea tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:13.836169 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-699f34ff-2510-4709-8331-f6c709b532ea tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:13.844696 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-699f34ff-2510-4709-8331-f6c709b532ea tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:13.846214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-699f34ff-2510-4709-8331-f6c709b532ea tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:13.847395 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-699f34ff-2510-4709-8331-f6c709b532ea tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086441 May 10 21:27:13.847963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1281/2057] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:13 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:13.924548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4702fd76-224b-4d73-bdca-322f008b1b6b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:13.925112 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4702fd76-224b-4d73-bdca-322f008b1b6b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:13.930956 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4702fd76-224b-4d73-bdca-322f008b1b6b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:13.931434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4702fd76-224b-4d73-bdca-322f008b1b6b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:13.932191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4702fd76-224b-4d73-bdca-322f008b1b6b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:13.932630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4702fd76-224b-4d73-bdca-322f008b1b6b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:13.993564 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4702fd76-224b-4d73-bdca-322f008b1b6b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:14.002002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4702fd76-224b-4d73-bdca-322f008b1b6b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081835 May 10 21:27:14.002612 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1282/2058] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:13 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:14.865812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8dfd782c-3d94-46dd-b0ac-c280febdb907 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:14.866463 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8dfd782c-3d94-46dd-b0ac-c280febdb907 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:14.872737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8dfd782c-3d94-46dd-b0ac-c280febdb907 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:14.873783 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8dfd782c-3d94-46dd-b0ac-c280febdb907 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:14.874582 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8dfd782c-3d94-46dd-b0ac-c280febdb907 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:14.875013 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8dfd782c-3d94-46dd-b0ac-c280febdb907 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:14.934966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8dfd782c-3d94-46dd-b0ac-c280febdb907 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:14.943176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8dfd782c-3d94-46dd-b0ac-c280febdb907 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:14.944676 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8dfd782c-3d94-46dd-b0ac-c280febdb907 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:14.945802 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8dfd782c-3d94-46dd-b0ac-c280febdb907 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084032 May 10 21:27:14.946362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1283/2059] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:14 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:15.018995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e4b8fc5d-65b6-458e-a460-18943e3805be tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:15.019666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e4b8fc5d-65b6-458e-a460-18943e3805be tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:15.025638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4b8fc5d-65b6-458e-a460-18943e3805be tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:15.026096 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4b8fc5d-65b6-458e-a460-18943e3805be tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:15.026863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4b8fc5d-65b6-458e-a460-18943e3805be tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:15.027346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4b8fc5d-65b6-458e-a460-18943e3805be tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:15.090497 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e4b8fc5d-65b6-458e-a460-18943e3805be tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:15.098583 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e4b8fc5d-65b6-458e-a460-18943e3805be tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083484 May 10 21:27:15.099163 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1284/2060] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:15 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:15.963777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-772e1471-2fe9-482c-996b-67e92b466999 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:15.964420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-772e1471-2fe9-482c-996b-67e92b466999 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:15.971477 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-772e1471-2fe9-482c-996b-67e92b466999 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:15.971925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-772e1471-2fe9-482c-996b-67e92b466999 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:15.972678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-772e1471-2fe9-482c-996b-67e92b466999 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:15.973110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-772e1471-2fe9-482c-996b-67e92b466999 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:16.033039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-772e1471-2fe9-482c-996b-67e92b466999 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:16.041167 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-772e1471-2fe9-482c-996b-67e92b466999 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:16.042648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-772e1471-2fe9-482c-996b-67e92b466999 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:16.043798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-772e1471-2fe9-482c-996b-67e92b466999 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084008 May 10 21:27:16.044356 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1285/2061] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:15 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:16.116139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-62cd35fc-7d84-4ad3-a555-09b56ce5a4a1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:16.116762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-62cd35fc-7d84-4ad3-a555-09b56ce5a4a1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:16.122789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-62cd35fc-7d84-4ad3-a555-09b56ce5a4a1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:16.123307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-62cd35fc-7d84-4ad3-a555-09b56ce5a4a1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:16.124078 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-62cd35fc-7d84-4ad3-a555-09b56ce5a4a1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:16.124519 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-62cd35fc-7d84-4ad3-a555-09b56ce5a4a1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:16.185922 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-62cd35fc-7d84-4ad3-a555-09b56ce5a4a1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:16.193264 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-62cd35fc-7d84-4ad3-a555-09b56ce5a4a1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081030 May 10 21:27:16.193824 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1286/2062] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:16 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:17.063927 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ad394b67-b1de-46c3-8ccc-c3b6f5d68a0c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:17.064583 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ad394b67-b1de-46c3-8ccc-c3b6f5d68a0c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:17.070781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ad394b67-b1de-46c3-8ccc-c3b6f5d68a0c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:17.071272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ad394b67-b1de-46c3-8ccc-c3b6f5d68a0c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:17.072088 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ad394b67-b1de-46c3-8ccc-c3b6f5d68a0c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:17.072525 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ad394b67-b1de-46c3-8ccc-c3b6f5d68a0c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:17.133079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ad394b67-b1de-46c3-8ccc-c3b6f5d68a0c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:17.142029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ad394b67-b1de-46c3-8ccc-c3b6f5d68a0c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:17.143578 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ad394b67-b1de-46c3-8ccc-c3b6f5d68a0c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:17.144725 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ad394b67-b1de-46c3-8ccc-c3b6f5d68a0c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086087 May 10 21:27:17.145283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1287/2063] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:17 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:17.210324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8da75246-087c-47e1-ae3c-b92567f1cab3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:17.210924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8da75246-087c-47e1-ae3c-b92567f1cab3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:17.216658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8da75246-087c-47e1-ae3c-b92567f1cab3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:17.217186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8da75246-087c-47e1-ae3c-b92567f1cab3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:17.218076 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8da75246-087c-47e1-ae3c-b92567f1cab3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:17.218508 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8da75246-087c-47e1-ae3c-b92567f1cab3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:17.280810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8da75246-087c-47e1-ae3c-b92567f1cab3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:17.288119 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8da75246-087c-47e1-ae3c-b92567f1cab3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081424 May 10 21:27:17.288679 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1288/2064] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:17 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:18.163438 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-27fba762-2c57-4c18-9734-eface6cc2a34 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:18.164100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-27fba762-2c57-4c18-9734-eface6cc2a34 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:18.171562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27fba762-2c57-4c18-9734-eface6cc2a34 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:18.172021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27fba762-2c57-4c18-9734-eface6cc2a34 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:18.172784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27fba762-2c57-4c18-9734-eface6cc2a34 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:18.173224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27fba762-2c57-4c18-9734-eface6cc2a34 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:18.235258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-27fba762-2c57-4c18-9734-eface6cc2a34 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:18.243520 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-27fba762-2c57-4c18-9734-eface6cc2a34 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:18.245024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-27fba762-2c57-4c18-9734-eface6cc2a34 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:18.246161 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-27fba762-2c57-4c18-9734-eface6cc2a34 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086712 May 10 21:27:18.246723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1289/2065] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:18 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:18.304877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f60d1324-d17b-412c-8669-cdc549e9b9f6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:18.305487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f60d1324-d17b-412c-8669-cdc549e9b9f6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:18.311814 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f60d1324-d17b-412c-8669-cdc549e9b9f6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:18.312268 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f60d1324-d17b-412c-8669-cdc549e9b9f6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:18.313034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f60d1324-d17b-412c-8669-cdc549e9b9f6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:18.313472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f60d1324-d17b-412c-8669-cdc549e9b9f6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:18.374092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f60d1324-d17b-412c-8669-cdc549e9b9f6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:18.381369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f60d1324-d17b-412c-8669-cdc549e9b9f6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080094 May 10 21:27:18.381930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1290/2066] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:18 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:19.264441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-601fbd39-fc18-4f4a-834a-e437418c03f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:19.265112 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-601fbd39-fc18-4f4a-834a-e437418c03f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:19.271402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-601fbd39-fc18-4f4a-834a-e437418c03f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:19.271852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-601fbd39-fc18-4f4a-834a-e437418c03f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:19.272611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-601fbd39-fc18-4f4a-834a-e437418c03f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:19.273044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-601fbd39-fc18-4f4a-834a-e437418c03f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:19.332816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-601fbd39-fc18-4f4a-834a-e437418c03f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:19.341130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-601fbd39-fc18-4f4a-834a-e437418c03f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:19.342822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-601fbd39-fc18-4f4a-834a-e437418c03f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:19.344011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-601fbd39-fc18-4f4a-834a-e437418c03f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083601 May 10 21:27:19.344584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1291/2067] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:19 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:19.398594 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7bd56dff-650a-46fc-93d8-89953c5f121f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:19.399228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7bd56dff-650a-46fc-93d8-89953c5f121f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:19.405791 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7bd56dff-650a-46fc-93d8-89953c5f121f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:19.406243 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7bd56dff-650a-46fc-93d8-89953c5f121f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:19.407002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7bd56dff-650a-46fc-93d8-89953c5f121f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:19.407466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7bd56dff-650a-46fc-93d8-89953c5f121f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:19.469458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7bd56dff-650a-46fc-93d8-89953c5f121f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:19.476769 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7bd56dff-650a-46fc-93d8-89953c5f121f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081723 May 10 21:27:19.477328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1292/2068] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:19 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:20.361832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1c970c1e-564e-48d8-bc11-cd58aec0b5cd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:20.362484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1c970c1e-564e-48d8-bc11-cd58aec0b5cd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:20.368819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1c970c1e-564e-48d8-bc11-cd58aec0b5cd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:20.369269 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1c970c1e-564e-48d8-bc11-cd58aec0b5cd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:20.370031 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1c970c1e-564e-48d8-bc11-cd58aec0b5cd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:20.370466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1c970c1e-564e-48d8-bc11-cd58aec0b5cd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:20.431572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1c970c1e-564e-48d8-bc11-cd58aec0b5cd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:20.440321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1c970c1e-564e-48d8-bc11-cd58aec0b5cd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:20.441830 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1c970c1e-564e-48d8-bc11-cd58aec0b5cd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:20.442970 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1c970c1e-564e-48d8-bc11-cd58aec0b5cd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085086 May 10 21:27:20.443562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1293/2069] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:20 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:20.493564 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-500be84a-c4ab-4432-94df-8c09170be8a5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:20.494157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-500be84a-c4ab-4432-94df-8c09170be8a5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:20.500753 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-500be84a-c4ab-4432-94df-8c09170be8a5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:20.502679 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-500be84a-c4ab-4432-94df-8c09170be8a5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:20.502679 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-500be84a-c4ab-4432-94df-8c09170be8a5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:20.502679 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-500be84a-c4ab-4432-94df-8c09170be8a5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:20.564726 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-500be84a-c4ab-4432-94df-8c09170be8a5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:20.572157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-500be84a-c4ab-4432-94df-8c09170be8a5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082399 May 10 21:27:20.572783 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1294/2070] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:20 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:21.462035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3df838ed-0fb0-4747-aefd-e25c2342e76f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:21.462727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3df838ed-0fb0-4747-aefd-e25c2342e76f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:21.469059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3df838ed-0fb0-4747-aefd-e25c2342e76f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:21.469516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3df838ed-0fb0-4747-aefd-e25c2342e76f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:21.470286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3df838ed-0fb0-4747-aefd-e25c2342e76f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:21.470737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3df838ed-0fb0-4747-aefd-e25c2342e76f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:21.531106 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3df838ed-0fb0-4747-aefd-e25c2342e76f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:21.539288 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3df838ed-0fb0-4747-aefd-e25c2342e76f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:21.540803 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3df838ed-0fb0-4747-aefd-e25c2342e76f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:21.541947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3df838ed-0fb0-4747-aefd-e25c2342e76f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083828 May 10 21:27:21.542510 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1295/2071] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:21 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:21.589183 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2e0f6d28-6bfe-4c10-a309-07f5c6bd99a7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:21.589785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2e0f6d28-6bfe-4c10-a309-07f5c6bd99a7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:21.595827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e0f6d28-6bfe-4c10-a309-07f5c6bd99a7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:21.596272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e0f6d28-6bfe-4c10-a309-07f5c6bd99a7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:21.597030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e0f6d28-6bfe-4c10-a309-07f5c6bd99a7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:21.597462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e0f6d28-6bfe-4c10-a309-07f5c6bd99a7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:21.661458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2e0f6d28-6bfe-4c10-a309-07f5c6bd99a7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:21.668653 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2e0f6d28-6bfe-4c10-a309-07f5c6bd99a7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083165 May 10 21:27:21.669220 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1296/2072] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:21 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:22.559819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-82bd4823-db0d-4110-bd4a-beb216b070cb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:22.560920 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-82bd4823-db0d-4110-bd4a-beb216b070cb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:22.567357 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-82bd4823-db0d-4110-bd4a-beb216b070cb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:22.567813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-82bd4823-db0d-4110-bd4a-beb216b070cb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:22.568586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-82bd4823-db0d-4110-bd4a-beb216b070cb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:22.569016 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-82bd4823-db0d-4110-bd4a-beb216b070cb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:22.629560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-82bd4823-db0d-4110-bd4a-beb216b070cb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:22.637997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-82bd4823-db0d-4110-bd4a-beb216b070cb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:22.640292 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-82bd4823-db0d-4110-bd4a-beb216b070cb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:22.641428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-82bd4823-db0d-4110-bd4a-beb216b070cb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085682 May 10 21:27:22.641993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1297/2073] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:22 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:22.685229 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-272a0173-ca77-477f-a28b-77ca81c1d0cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:22.686508 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-272a0173-ca77-477f-a28b-77ca81c1d0cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:22.692351 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-272a0173-ca77-477f-a28b-77ca81c1d0cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:22.692804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-272a0173-ca77-477f-a28b-77ca81c1d0cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:22.693572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-272a0173-ca77-477f-a28b-77ca81c1d0cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:22.694013 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-272a0173-ca77-477f-a28b-77ca81c1d0cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:22.753183 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-272a0173-ca77-477f-a28b-77ca81c1d0cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:22.760498 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-272a0173-ca77-477f-a28b-77ca81c1d0cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078824 May 10 21:27:22.761033 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1298/2074] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:22 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:23.659813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-90addd30-3f33-40e9-a1f3-1c34fce7bc4f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:23.660451 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-90addd30-3f33-40e9-a1f3-1c34fce7bc4f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:23.666723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-90addd30-3f33-40e9-a1f3-1c34fce7bc4f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:23.667202 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-90addd30-3f33-40e9-a1f3-1c34fce7bc4f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:23.667963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-90addd30-3f33-40e9-a1f3-1c34fce7bc4f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:23.668394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-90addd30-3f33-40e9-a1f3-1c34fce7bc4f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:23.731280 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-90addd30-3f33-40e9-a1f3-1c34fce7bc4f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:23.739497 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-90addd30-3f33-40e9-a1f3-1c34fce7bc4f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:23.741011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-90addd30-3f33-40e9-a1f3-1c34fce7bc4f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:23.742120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-90addd30-3f33-40e9-a1f3-1c34fce7bc4f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086197 May 10 21:27:23.742672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1299/2075] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:23 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:27:23.777249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4f5295de-a6e3-4226-b9d3-4c0158133496 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:23.777851 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4f5295de-a6e3-4226-b9d3-4c0158133496 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:23.784105 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f5295de-a6e3-4226-b9d3-4c0158133496 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:23.784546 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f5295de-a6e3-4226-b9d3-4c0158133496 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:23.785301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f5295de-a6e3-4226-b9d3-4c0158133496 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:23.785732 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f5295de-a6e3-4226-b9d3-4c0158133496 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:23.852372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4f5295de-a6e3-4226-b9d3-4c0158133496 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:23.860487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4f5295de-a6e3-4226-b9d3-4c0158133496 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.086741 May 10 21:27:23.860993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1300/2076] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:23 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:24.760585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-04bb029b-6cb3-43d1-b8b6-b8b2c6aada74 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:24.761379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-04bb029b-6cb3-43d1-b8b6-b8b2c6aada74 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:24.768919 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04bb029b-6cb3-43d1-b8b6-b8b2c6aada74 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:24.769367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04bb029b-6cb3-43d1-b8b6-b8b2c6aada74 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:24.770253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04bb029b-6cb3-43d1-b8b6-b8b2c6aada74 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:24.770694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04bb029b-6cb3-43d1-b8b6-b8b2c6aada74 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:24.836081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-04bb029b-6cb3-43d1-b8b6-b8b2c6aada74 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:24.844910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-04bb029b-6cb3-43d1-b8b6-b8b2c6aada74 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:24.846403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-04bb029b-6cb3-43d1-b8b6-b8b2c6aada74 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:24.847571 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-04bb029b-6cb3-43d1-b8b6-b8b2c6aada74 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.091118 May 10 21:27:24.848140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1301/2077] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:24 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:24.878419 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6de814ac-fee5-430e-9ade-1e31964bed93 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:24.878936 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6de814ac-fee5-430e-9ade-1e31964bed93 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:24.885170 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6de814ac-fee5-430e-9ade-1e31964bed93 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:24.885623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6de814ac-fee5-430e-9ade-1e31964bed93 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:24.886391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6de814ac-fee5-430e-9ade-1e31964bed93 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:24.886822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6de814ac-fee5-430e-9ade-1e31964bed93 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:24.952655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6de814ac-fee5-430e-9ade-1e31964bed93 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:24.960396 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6de814ac-fee5-430e-9ade-1e31964bed93 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.086199 May 10 21:27:24.960960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1302/2078] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:24 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:25.866126 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4eb6c5eb-9d5c-4abd-963a-785af28ede54 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:25.866769 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4eb6c5eb-9d5c-4abd-963a-785af28ede54 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:25.873835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4eb6c5eb-9d5c-4abd-963a-785af28ede54 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:25.874283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4eb6c5eb-9d5c-4abd-963a-785af28ede54 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:25.875047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4eb6c5eb-9d5c-4abd-963a-785af28ede54 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:25.875515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4eb6c5eb-9d5c-4abd-963a-785af28ede54 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:25.937121 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4eb6c5eb-9d5c-4abd-963a-785af28ede54 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:25.945364 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4eb6c5eb-9d5c-4abd-963a-785af28ede54 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:25.946893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4eb6c5eb-9d5c-4abd-963a-785af28ede54 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:25.948045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4eb6c5eb-9d5c-4abd-963a-785af28ede54 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085964 May 10 21:27:25.948615 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1303/2079] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:25 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:25.977208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9c6b2836-30ff-40ab-9958-d818f57b0eca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:25.977820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9c6b2836-30ff-40ab-9958-d818f57b0eca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:25.984684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c6b2836-30ff-40ab-9958-d818f57b0eca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:25.985476 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c6b2836-30ff-40ab-9958-d818f57b0eca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:25.986795 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c6b2836-30ff-40ab-9958-d818f57b0eca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:25.987267 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c6b2836-30ff-40ab-9958-d818f57b0eca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:26.049042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9c6b2836-30ff-40ab-9958-d818f57b0eca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:26.056511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9c6b2836-30ff-40ab-9958-d818f57b0eca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082828 May 10 21:27:26.057277 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1304/2080] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:25 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:26.646628 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:27:26.646782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Tue May 10 21:27:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 21:27:26.966235 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2b451076-1564-4139-afdb-d7a84c686a27 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:26.967482 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2b451076-1564-4139-afdb-d7a84c686a27 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:26.973896 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2b451076-1564-4139-afdb-d7a84c686a27 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:26.974342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2b451076-1564-4139-afdb-d7a84c686a27 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:26.975094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2b451076-1564-4139-afdb-d7a84c686a27 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:26.975549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2b451076-1564-4139-afdb-d7a84c686a27 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:27.036775 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2b451076-1564-4139-afdb-d7a84c686a27 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:27.045600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2b451076-1564-4139-afdb-d7a84c686a27 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:27.047090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2b451076-1564-4139-afdb-d7a84c686a27 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:27.048241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2b451076-1564-4139-afdb-d7a84c686a27 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086066 May 10 21:27:27.048796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1305/2081] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:26 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:27.073334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6cb23a85-b509-45b8-9143-749f0eef88da tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:27.073949 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6cb23a85-b509-45b8-9143-749f0eef88da tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:27.080111 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6cb23a85-b509-45b8-9143-749f0eef88da tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:27.080568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6cb23a85-b509-45b8-9143-749f0eef88da tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:27.081332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6cb23a85-b509-45b8-9143-749f0eef88da tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:27.081774 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6cb23a85-b509-45b8-9143-749f0eef88da tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:27.141607 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6cb23a85-b509-45b8-9143-749f0eef88da tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:27.149036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6cb23a85-b509-45b8-9143-749f0eef88da tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079324 May 10 21:27:27.149613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1306/2082] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:27 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:28.066520 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d2ed8075-0a0a-4e28-b3a5-5cddd62f3e4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:28.067254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d2ed8075-0a0a-4e28-b3a5-5cddd62f3e4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:28.073739 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2ed8075-0a0a-4e28-b3a5-5cddd62f3e4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:28.074180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2ed8075-0a0a-4e28-b3a5-5cddd62f3e4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:28.074930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2ed8075-0a0a-4e28-b3a5-5cddd62f3e4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:28.075391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2ed8075-0a0a-4e28-b3a5-5cddd62f3e4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:28.136007 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d2ed8075-0a0a-4e28-b3a5-5cddd62f3e4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:28.144336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d2ed8075-0a0a-4e28-b3a5-5cddd62f3e4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:28.145844 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d2ed8075-0a0a-4e28-b3a5-5cddd62f3e4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:28.147021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d2ed8075-0a0a-4e28-b3a5-5cddd62f3e4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084371 May 10 21:27:28.147634 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1307/2083] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:28 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:28.165186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9dec1efd-652a-4595-9c28-091f22a8aa7f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:28.165796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9dec1efd-652a-4595-9c28-091f22a8aa7f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:28.172210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9dec1efd-652a-4595-9c28-091f22a8aa7f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:28.172666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9dec1efd-652a-4595-9c28-091f22a8aa7f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:28.173430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9dec1efd-652a-4595-9c28-091f22a8aa7f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:28.173872 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9dec1efd-652a-4595-9c28-091f22a8aa7f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:28.236299 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9dec1efd-652a-4595-9c28-091f22a8aa7f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:28.243612 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9dec1efd-652a-4595-9c28-091f22a8aa7f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081958 May 10 21:27:28.244170 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1308/2084] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:28 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:29.165180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4ff52883-bfdf-4ccb-9080-3dc88cbba0a1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:29.165807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4ff52883-bfdf-4ccb-9080-3dc88cbba0a1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:29.172251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4ff52883-bfdf-4ccb-9080-3dc88cbba0a1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:29.172711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4ff52883-bfdf-4ccb-9080-3dc88cbba0a1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:29.173481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4ff52883-bfdf-4ccb-9080-3dc88cbba0a1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:29.173922 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4ff52883-bfdf-4ccb-9080-3dc88cbba0a1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:29.233854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4ff52883-bfdf-4ccb-9080-3dc88cbba0a1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:29.242060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4ff52883-bfdf-4ccb-9080-3dc88cbba0a1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:29.243615 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4ff52883-bfdf-4ccb-9080-3dc88cbba0a1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:29.244762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4ff52883-bfdf-4ccb-9080-3dc88cbba0a1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083604 May 10 21:27:29.245321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1309/2085] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:29 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:29.260653 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e7db0a3f-c8e8-4a2c-bc3b-4a989bf80e38 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:29.261267 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e7db0a3f-c8e8-4a2c-bc3b-4a989bf80e38 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:29.267772 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e7db0a3f-c8e8-4a2c-bc3b-4a989bf80e38 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:29.268227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e7db0a3f-c8e8-4a2c-bc3b-4a989bf80e38 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:29.268997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e7db0a3f-c8e8-4a2c-bc3b-4a989bf80e38 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:29.269435 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e7db0a3f-c8e8-4a2c-bc3b-4a989bf80e38 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:29.330540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e7db0a3f-c8e8-4a2c-bc3b-4a989bf80e38 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:29.337785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e7db0a3f-c8e8-4a2c-bc3b-4a989bf80e38 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080658 May 10 21:27:29.338353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1310/2086] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:29 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:30.262923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8059accf-6380-4de8-a98d-ab062b0bc98e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:30.263632 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8059accf-6380-4de8-a98d-ab062b0bc98e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:30.269951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8059accf-6380-4de8-a98d-ab062b0bc98e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:30.270400 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8059accf-6380-4de8-a98d-ab062b0bc98e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:30.271187 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8059accf-6380-4de8-a98d-ab062b0bc98e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:30.271625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8059accf-6380-4de8-a98d-ab062b0bc98e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:30.333053 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8059accf-6380-4de8-a98d-ab062b0bc98e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:30.341296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8059accf-6380-4de8-a98d-ab062b0bc98e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:30.343771 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8059accf-6380-4de8-a98d-ab062b0bc98e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:30.344932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8059accf-6380-4de8-a98d-ab062b0bc98e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085935 May 10 21:27:30.345488 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1311/2087] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:30 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:30.354300 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-056d2a85-9417-4d6d-9ade-4ff08ecf6d04 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:30.354936 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-056d2a85-9417-4d6d-9ade-4ff08ecf6d04 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:30.360745 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-056d2a85-9417-4d6d-9ade-4ff08ecf6d04 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:30.361202 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-056d2a85-9417-4d6d-9ade-4ff08ecf6d04 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:30.361972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-056d2a85-9417-4d6d-9ade-4ff08ecf6d04 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:30.362420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-056d2a85-9417-4d6d-9ade-4ff08ecf6d04 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:30.425266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-056d2a85-9417-4d6d-9ade-4ff08ecf6d04 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:30.432705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-056d2a85-9417-4d6d-9ade-4ff08ecf6d04 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081936 May 10 21:27:30.433274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1312/2088] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:30 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:27:31.363428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6dcd0ffd-84df-4405-9dd7-0c4aed7485a1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:31.364120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6dcd0ffd-84df-4405-9dd7-0c4aed7485a1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:31.370315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6dcd0ffd-84df-4405-9dd7-0c4aed7485a1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:31.370762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6dcd0ffd-84df-4405-9dd7-0c4aed7485a1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:31.371553 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6dcd0ffd-84df-4405-9dd7-0c4aed7485a1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:31.371986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6dcd0ffd-84df-4405-9dd7-0c4aed7485a1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:31.432932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6dcd0ffd-84df-4405-9dd7-0c4aed7485a1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:31.443899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6dcd0ffd-84df-4405-9dd7-0c4aed7485a1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:31.446304 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6dcd0ffd-84df-4405-9dd7-0c4aed7485a1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:31.450045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6dcd0ffd-84df-4405-9dd7-0c4aed7485a1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.088146 May 10 21:27:31.450629 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1313/2089] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:31 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:31.455457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a4a5d632-290b-467b-9665-0dd8df9c82b7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:31.456064 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a4a5d632-290b-467b-9665-0dd8df9c82b7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:31.465149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a4a5d632-290b-467b-9665-0dd8df9c82b7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:31.465598 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a4a5d632-290b-467b-9665-0dd8df9c82b7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:31.466360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a4a5d632-290b-467b-9665-0dd8df9c82b7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:31.466830 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a4a5d632-290b-467b-9665-0dd8df9c82b7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:31.526161 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a4a5d632-290b-467b-9665-0dd8df9c82b7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:31.533720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a4a5d632-290b-467b-9665-0dd8df9c82b7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081988 May 10 21:27:31.534274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1314/2090] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:31 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:32.469737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a6fc8e52-0023-49bb-b353-dc5f3ddb397e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:32.470425 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a6fc8e52-0023-49bb-b353-dc5f3ddb397e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:32.476747 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a6fc8e52-0023-49bb-b353-dc5f3ddb397e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:32.477196 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a6fc8e52-0023-49bb-b353-dc5f3ddb397e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:32.477950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a6fc8e52-0023-49bb-b353-dc5f3ddb397e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:32.478386 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a6fc8e52-0023-49bb-b353-dc5f3ddb397e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:32.538553 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a6fc8e52-0023-49bb-b353-dc5f3ddb397e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:32.547719 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a6fc8e52-0023-49bb-b353-dc5f3ddb397e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:32.549213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a6fc8e52-0023-49bb-b353-dc5f3ddb397e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:32.550345 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a6fc8e52-0023-49bb-b353-dc5f3ddb397e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085368 May 10 21:27:32.550927 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1315/2091] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:32 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:32.555201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a3189820-5326-4339-885e-3e801722f4ab tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:32.555799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a3189820-5326-4339-885e-3e801722f4ab tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:32.561672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a3189820-5326-4339-885e-3e801722f4ab tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:32.562161 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a3189820-5326-4339-885e-3e801722f4ab tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:32.562969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a3189820-5326-4339-885e-3e801722f4ab tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:32.563456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a3189820-5326-4339-885e-3e801722f4ab tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:32.626108 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a3189820-5326-4339-885e-3e801722f4ab tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:32.633522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a3189820-5326-4339-885e-3e801722f4ab tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081648 May 10 21:27:32.634076 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1316/2092] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:32 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:33.568308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9ae2c129-7fa2-4bad-ada6-996e766daa47 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:33.568996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9ae2c129-7fa2-4bad-ada6-996e766daa47 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:33.575338 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ae2c129-7fa2-4bad-ada6-996e766daa47 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:33.575790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ae2c129-7fa2-4bad-ada6-996e766daa47 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:33.577504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ae2c129-7fa2-4bad-ada6-996e766daa47 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:33.577947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ae2c129-7fa2-4bad-ada6-996e766daa47 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:33.639808 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9ae2c129-7fa2-4bad-ada6-996e766daa47 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:33.648340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9ae2c129-7fa2-4bad-ada6-996e766daa47 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:33.649848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9ae2c129-7fa2-4bad-ada6-996e766daa47 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:33.650984 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9ae2c129-7fa2-4bad-ada6-996e766daa47 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086584 May 10 21:27:33.651582 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1317/2093] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:33 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:33.657081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fb575b76-9640-4450-aaef-4eeeb1d61d89 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:33.657691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fb575b76-9640-4450-aaef-4eeeb1d61d89 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:33.663658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb575b76-9640-4450-aaef-4eeeb1d61d89 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:33.664112 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb575b76-9640-4450-aaef-4eeeb1d61d89 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:33.664892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb575b76-9640-4450-aaef-4eeeb1d61d89 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:33.665326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb575b76-9640-4450-aaef-4eeeb1d61d89 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:33.725786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fb575b76-9640-4450-aaef-4eeeb1d61d89 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:33.733567 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fb575b76-9640-4450-aaef-4eeeb1d61d89 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081043 May 10 21:27:33.734142 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1318/2094] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:33 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:34.668744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5d7a517c-3b8a-430a-9853-6fcf4e215b91 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:34.669364 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5d7a517c-3b8a-430a-9853-6fcf4e215b91 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:34.675934 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5d7a517c-3b8a-430a-9853-6fcf4e215b91 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:34.676381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5d7a517c-3b8a-430a-9853-6fcf4e215b91 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:34.677136 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5d7a517c-3b8a-430a-9853-6fcf4e215b91 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:34.677568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5d7a517c-3b8a-430a-9853-6fcf4e215b91 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:34.739271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5d7a517c-3b8a-430a-9853-6fcf4e215b91 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:34.747453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5d7a517c-3b8a-430a-9853-6fcf4e215b91 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:34.749498 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5d7a517c-3b8a-430a-9853-6fcf4e215b91 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:34.750642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5d7a517c-3b8a-430a-9853-6fcf4e215b91 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085825 May 10 21:27:34.751216 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1319/2095] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:34 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:34.755516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d70a35e2-225f-43ec-945e-1261b62dac94 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:34.756118 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d70a35e2-225f-43ec-945e-1261b62dac94 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:34.761958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d70a35e2-225f-43ec-945e-1261b62dac94 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:34.762419 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d70a35e2-225f-43ec-945e-1261b62dac94 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:34.763294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d70a35e2-225f-43ec-945e-1261b62dac94 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:34.764390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d70a35e2-225f-43ec-945e-1261b62dac94 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:34.826432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d70a35e2-225f-43ec-945e-1261b62dac94 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:34.834449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d70a35e2-225f-43ec-945e-1261b62dac94 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082305 May 10 21:27:34.835008 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1320/2096] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:34 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:35.768639 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2057f76f-604a-434e-aaf1-55f7de54e74e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:35.769245 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2057f76f-604a-434e-aaf1-55f7de54e74e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:35.775572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2057f76f-604a-434e-aaf1-55f7de54e74e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:35.776023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2057f76f-604a-434e-aaf1-55f7de54e74e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:35.776797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2057f76f-604a-434e-aaf1-55f7de54e74e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:35.777209 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2057f76f-604a-434e-aaf1-55f7de54e74e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:35.838250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2057f76f-604a-434e-aaf1-55f7de54e74e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:35.846874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2057f76f-604a-434e-aaf1-55f7de54e74e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:35.848606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2057f76f-604a-434e-aaf1-55f7de54e74e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:35.849793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2057f76f-604a-434e-aaf1-55f7de54e74e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085078 May 10 21:27:35.850355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1321/2097] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:35 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:35.854711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4b0ca899-d143-4079-bc74-32752b3fba1b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:35.855355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4b0ca899-d143-4079-bc74-32752b3fba1b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:35.861879 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4b0ca899-d143-4079-bc74-32752b3fba1b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:35.862402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4b0ca899-d143-4079-bc74-32752b3fba1b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:35.863228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4b0ca899-d143-4079-bc74-32752b3fba1b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:35.863672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4b0ca899-d143-4079-bc74-32752b3fba1b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:35.923336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4b0ca899-d143-4079-bc74-32752b3fba1b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:35.930638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4b0ca899-d143-4079-bc74-32752b3fba1b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079331 May 10 21:27:35.931223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1322/2098] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:35 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:36.868202 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f95c2a9d-2824-4bff-a9f2-7f5252cda15f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:36.868845 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f95c2a9d-2824-4bff-a9f2-7f5252cda15f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:36.875377 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f95c2a9d-2824-4bff-a9f2-7f5252cda15f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:36.875835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f95c2a9d-2824-4bff-a9f2-7f5252cda15f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:36.876609 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f95c2a9d-2824-4bff-a9f2-7f5252cda15f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:36.877048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f95c2a9d-2824-4bff-a9f2-7f5252cda15f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:36.940629 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f95c2a9d-2824-4bff-a9f2-7f5252cda15f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:36.950827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f95c2a9d-2824-4bff-a9f2-7f5252cda15f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:36.952730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f95c2a9d-2824-4bff-a9f2-7f5252cda15f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:36.953893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f95c2a9d-2824-4bff-a9f2-7f5252cda15f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.089692 May 10 21:27:36.955171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1323/2099] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:36 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:36.962753 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8a09508e-a8c6-447c-8832-2314930584d4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:36.963410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8a09508e-a8c6-447c-8832-2314930584d4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:36.970126 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8a09508e-a8c6-447c-8832-2314930584d4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:36.970583 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8a09508e-a8c6-447c-8832-2314930584d4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:36.971394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8a09508e-a8c6-447c-8832-2314930584d4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:36.971845 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8a09508e-a8c6-447c-8832-2314930584d4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:37.035488 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8a09508e-a8c6-447c-8832-2314930584d4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:37.043367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8a09508e-a8c6-447c-8832-2314930584d4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.087168 May 10 21:27:37.043950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1324/2100] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:36 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:37.972644 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5dadb7f9-6eaa-49ff-8872-192a7b951832 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:37.979270 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5dadb7f9-6eaa-49ff-8872-192a7b951832 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:37.979933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5dadb7f9-6eaa-49ff-8872-192a7b951832 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:37.980290 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5dadb7f9-6eaa-49ff-8872-192a7b951832 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:37.980959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5dadb7f9-6eaa-49ff-8872-192a7b951832 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:37.981402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5dadb7f9-6eaa-49ff-8872-192a7b951832 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:38.044099 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5dadb7f9-6eaa-49ff-8872-192a7b951832 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:38.052537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5dadb7f9-6eaa-49ff-8872-192a7b951832 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:38.054051 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5dadb7f9-6eaa-49ff-8872-192a7b951832 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:38.055227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5dadb7f9-6eaa-49ff-8872-192a7b951832 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086516 May 10 21:27:38.055810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1325/2101] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:37 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:38.060419 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b83a0ca2-c6c9-41e8-b252-45efd20705c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:38.061242 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b83a0ca2-c6c9-41e8-b252-45efd20705c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:38.066942 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b83a0ca2-c6c9-41e8-b252-45efd20705c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:38.067430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b83a0ca2-c6c9-41e8-b252-45efd20705c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:38.068201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b83a0ca2-c6c9-41e8-b252-45efd20705c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:38.068645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b83a0ca2-c6c9-41e8-b252-45efd20705c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:38.129482 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b83a0ca2-c6c9-41e8-b252-45efd20705c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:38.136878 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b83a0ca2-c6c9-41e8-b252-45efd20705c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079945 May 10 21:27:38.137674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1326/2102] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:38 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:39.072714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a8ddc6bf-2efd-49be-beb1-a248a6fcd880 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:39.073363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a8ddc6bf-2efd-49be-beb1-a248a6fcd880 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:39.080762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a8ddc6bf-2efd-49be-beb1-a248a6fcd880 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:39.081213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a8ddc6bf-2efd-49be-beb1-a248a6fcd880 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:39.081981 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a8ddc6bf-2efd-49be-beb1-a248a6fcd880 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:39.082418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a8ddc6bf-2efd-49be-beb1-a248a6fcd880 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:39.142598 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a8ddc6bf-2efd-49be-beb1-a248a6fcd880 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:39.150892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a8ddc6bf-2efd-49be-beb1-a248a6fcd880 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:39.152449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a8ddc6bf-2efd-49be-beb1-a248a6fcd880 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:39.153602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a8ddc6bf-2efd-49be-beb1-a248a6fcd880 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084944 May 10 21:27:39.154188 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1327/2103] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:39 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:39.158550 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-abe5027c-7315-42b2-9ef7-9f046af992f8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:39.159177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-abe5027c-7315-42b2-9ef7-9f046af992f8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:39.164818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-abe5027c-7315-42b2-9ef7-9f046af992f8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:39.165273 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-abe5027c-7315-42b2-9ef7-9f046af992f8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:39.166039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-abe5027c-7315-42b2-9ef7-9f046af992f8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:39.166480 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-abe5027c-7315-42b2-9ef7-9f046af992f8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:39.230264 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-abe5027c-7315-42b2-9ef7-9f046af992f8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:39.238066 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-abe5027c-7315-42b2-9ef7-9f046af992f8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082942 May 10 21:27:39.238630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1328/2104] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:39 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:40.171964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b3f68179-074e-4c75-998a-2ec1cd3923bc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:40.172612 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b3f68179-074e-4c75-998a-2ec1cd3923bc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:40.178955 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3f68179-074e-4c75-998a-2ec1cd3923bc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:40.179443 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3f68179-074e-4c75-998a-2ec1cd3923bc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:40.180194 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3f68179-074e-4c75-998a-2ec1cd3923bc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:40.180669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3f68179-074e-4c75-998a-2ec1cd3923bc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:40.240817 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b3f68179-074e-4c75-998a-2ec1cd3923bc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:40.249210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b3f68179-074e-4c75-998a-2ec1cd3923bc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:40.250706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b3f68179-074e-4c75-998a-2ec1cd3923bc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:40.251857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b3f68179-074e-4c75-998a-2ec1cd3923bc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084189 May 10 21:27:40.252413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1329/2105] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:40 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:40.256699 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b8ef7c34-34b5-4dc6-aac1-ab99cb32db00 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:40.257296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b8ef7c34-34b5-4dc6-aac1-ab99cb32db00 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:40.262939 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b8ef7c34-34b5-4dc6-aac1-ab99cb32db00 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:40.264043 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b8ef7c34-34b5-4dc6-aac1-ab99cb32db00 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:40.264827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b8ef7c34-34b5-4dc6-aac1-ab99cb32db00 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:40.265263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b8ef7c34-34b5-4dc6-aac1-ab99cb32db00 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:40.325246 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b8ef7c34-34b5-4dc6-aac1-ab99cb32db00 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:40.332779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b8ef7c34-34b5-4dc6-aac1-ab99cb32db00 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079454 May 10 21:27:40.333341 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1330/2106] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:40 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:41.270208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e8b19f6c-7425-4d71-b3da-07b6cf4cd18a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:41.270883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e8b19f6c-7425-4d71-b3da-07b6cf4cd18a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:41.277130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e8b19f6c-7425-4d71-b3da-07b6cf4cd18a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:41.277575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e8b19f6c-7425-4d71-b3da-07b6cf4cd18a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:41.278324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e8b19f6c-7425-4d71-b3da-07b6cf4cd18a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:41.278761 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e8b19f6c-7425-4d71-b3da-07b6cf4cd18a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:41.338969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e8b19f6c-7425-4d71-b3da-07b6cf4cd18a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:41.347654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e8b19f6c-7425-4d71-b3da-07b6cf4cd18a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:41.349160 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e8b19f6c-7425-4d71-b3da-07b6cf4cd18a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:41.350290 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e8b19f6c-7425-4d71-b3da-07b6cf4cd18a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083996 May 10 21:27:41.350846 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1331/2107] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:41 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:41.355191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e80d6580-93e0-4af1-af54-40f7688ee2ed tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:41.355802 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e80d6580-93e0-4af1-af54-40f7688ee2ed tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:41.361712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e80d6580-93e0-4af1-af54-40f7688ee2ed tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:41.362160 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e80d6580-93e0-4af1-af54-40f7688ee2ed tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:41.362919 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e80d6580-93e0-4af1-af54-40f7688ee2ed tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:41.363380 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e80d6580-93e0-4af1-af54-40f7688ee2ed tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:41.425302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e80d6580-93e0-4af1-af54-40f7688ee2ed tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:41.432556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e80d6580-93e0-4af1-af54-40f7688ee2ed tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080761 May 10 21:27:41.433114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1332/2108] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:41 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:42.368322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-26a9f9b2-6b44-4565-b059-a9341ed0e0d9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:42.369083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-26a9f9b2-6b44-4565-b059-a9341ed0e0d9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:42.375655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-26a9f9b2-6b44-4565-b059-a9341ed0e0d9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:42.376106 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-26a9f9b2-6b44-4565-b059-a9341ed0e0d9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:42.376868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-26a9f9b2-6b44-4565-b059-a9341ed0e0d9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:42.377304 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-26a9f9b2-6b44-4565-b059-a9341ed0e0d9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:42.437333 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-26a9f9b2-6b44-4565-b059-a9341ed0e0d9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:42.445492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-26a9f9b2-6b44-4565-b059-a9341ed0e0d9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:42.446996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-26a9f9b2-6b44-4565-b059-a9341ed0e0d9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:42.448159 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-26a9f9b2-6b44-4565-b059-a9341ed0e0d9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083797 May 10 21:27:42.448712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1333/2109] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:42 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:42.453617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-af299a5d-24fd-4544-870e-d80da93c2eb3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:42.454476 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-af299a5d-24fd-4544-870e-d80da93c2eb3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:42.460397 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af299a5d-24fd-4544-870e-d80da93c2eb3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:42.460874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af299a5d-24fd-4544-870e-d80da93c2eb3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:42.461633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af299a5d-24fd-4544-870e-d80da93c2eb3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:42.462099 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af299a5d-24fd-4544-870e-d80da93c2eb3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:42.523105 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-af299a5d-24fd-4544-870e-d80da93c2eb3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:42.530980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-af299a5d-24fd-4544-870e-d80da93c2eb3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081347 May 10 21:27:42.531569 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1334/2110] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:42 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:43.467378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c950d205-9028-4bc0-aa90-1feec52b7457 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:43.468080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c950d205-9028-4bc0-aa90-1feec52b7457 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:43.474282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c950d205-9028-4bc0-aa90-1feec52b7457 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:43.474728 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c950d205-9028-4bc0-aa90-1feec52b7457 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:43.475517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c950d205-9028-4bc0-aa90-1feec52b7457 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:43.475950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c950d205-9028-4bc0-aa90-1feec52b7457 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:43.535808 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c950d205-9028-4bc0-aa90-1feec52b7457 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:43.543923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c950d205-9028-4bc0-aa90-1feec52b7457 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:43.545700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c950d205-9028-4bc0-aa90-1feec52b7457 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:43.546834 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c950d205-9028-4bc0-aa90-1feec52b7457 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083588 May 10 21:27:43.547432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1335/2111] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:43 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:43.551750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cbddef25-6523-4a8d-8680-097915f74067 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:43.552346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cbddef25-6523-4a8d-8680-097915f74067 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:43.557875 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbddef25-6523-4a8d-8680-097915f74067 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:43.558318 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbddef25-6523-4a8d-8680-097915f74067 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:43.559069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbddef25-6523-4a8d-8680-097915f74067 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:43.559544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbddef25-6523-4a8d-8680-097915f74067 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:43.622278 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cbddef25-6523-4a8d-8680-097915f74067 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:43.630342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cbddef25-6523-4a8d-8680-097915f74067 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082000 May 10 21:27:43.630899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1336/2112] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:43 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:44.564805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-31cfa36a-2954-40da-a18f-b5f1a588fafa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:44.565477 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-31cfa36a-2954-40da-a18f-b5f1a588fafa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:44.571480 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-31cfa36a-2954-40da-a18f-b5f1a588fafa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:44.571927 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-31cfa36a-2954-40da-a18f-b5f1a588fafa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:44.572683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-31cfa36a-2954-40da-a18f-b5f1a588fafa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:44.573115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-31cfa36a-2954-40da-a18f-b5f1a588fafa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:44.636118 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-31cfa36a-2954-40da-a18f-b5f1a588fafa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:44.645315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-31cfa36a-2954-40da-a18f-b5f1a588fafa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:44.646813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-31cfa36a-2954-40da-a18f-b5f1a588fafa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:44.647969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-31cfa36a-2954-40da-a18f-b5f1a588fafa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087217 May 10 21:27:44.648521 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1337/2113] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:44 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:44.652781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-00ef2889-2ee0-48c9-95b4-fb68c48634df tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:44.653380 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-00ef2889-2ee0-48c9-95b4-fb68c48634df tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:44.659851 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-00ef2889-2ee0-48c9-95b4-fb68c48634df tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:44.660298 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-00ef2889-2ee0-48c9-95b4-fb68c48634df tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:44.661047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-00ef2889-2ee0-48c9-95b4-fb68c48634df tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:44.661480 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-00ef2889-2ee0-48c9-95b4-fb68c48634df tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:44.721573 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-00ef2889-2ee0-48c9-95b4-fb68c48634df tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:44.728928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-00ef2889-2ee0-48c9-95b4-fb68c48634df tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079484 May 10 21:27:44.729500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1338/2114] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:44 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:45.665709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d4c3c917-4907-4a55-a7dd-c9173ec2f25f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:45.666315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d4c3c917-4907-4a55-a7dd-c9173ec2f25f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:45.672789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d4c3c917-4907-4a55-a7dd-c9173ec2f25f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:45.673235 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d4c3c917-4907-4a55-a7dd-c9173ec2f25f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:45.673985 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d4c3c917-4907-4a55-a7dd-c9173ec2f25f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:45.674417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d4c3c917-4907-4a55-a7dd-c9173ec2f25f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:45.735349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d4c3c917-4907-4a55-a7dd-c9173ec2f25f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:45.743535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d4c3c917-4907-4a55-a7dd-c9173ec2f25f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:45.745094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d4c3c917-4907-4a55-a7dd-c9173ec2f25f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:45.746222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d4c3c917-4907-4a55-a7dd-c9173ec2f25f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084392 May 10 21:27:45.746778 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1339/2115] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:45 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:45.751915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3f92a4a1-7806-4176-84d8-273947c736cb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:45.752514 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3f92a4a1-7806-4176-84d8-273947c736cb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:45.757984 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3f92a4a1-7806-4176-84d8-273947c736cb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:45.758459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3f92a4a1-7806-4176-84d8-273947c736cb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:45.759249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3f92a4a1-7806-4176-84d8-273947c736cb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:45.759683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3f92a4a1-7806-4176-84d8-273947c736cb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:45.822692 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3f92a4a1-7806-4176-84d8-273947c736cb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:45.830828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3f92a4a1-7806-4176-84d8-273947c736cb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083103 May 10 21:27:45.831514 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1340/2116] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:45 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:46.765380 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a7314c11-9e79-46df-bed9-b90821838c30 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:46.765989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a7314c11-9e79-46df-bed9-b90821838c30 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:46.772351 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a7314c11-9e79-46df-bed9-b90821838c30 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:46.772801 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a7314c11-9e79-46df-bed9-b90821838c30 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:46.773553 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a7314c11-9e79-46df-bed9-b90821838c30 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:46.773982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a7314c11-9e79-46df-bed9-b90821838c30 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:46.835176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a7314c11-9e79-46df-bed9-b90821838c30 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:46.846921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a7314c11-9e79-46df-bed9-b90821838c30 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:46.846921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a7314c11-9e79-46df-bed9-b90821838c30 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:46.846921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a7314c11-9e79-46df-bed9-b90821838c30 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085536 May 10 21:27:46.847309 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1341/2117] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:46 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:46.851093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4a4de6cc-b4d3-4e91-ba47-350bd8d22906 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:46.851734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4a4de6cc-b4d3-4e91-ba47-350bd8d22906 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:46.858257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a4de6cc-b4d3-4e91-ba47-350bd8d22906 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:46.858623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a4de6cc-b4d3-4e91-ba47-350bd8d22906 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:46.859421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a4de6cc-b4d3-4e91-ba47-350bd8d22906 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:46.859858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a4de6cc-b4d3-4e91-ba47-350bd8d22906 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:46.921393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4a4de6cc-b4d3-4e91-ba47-350bd8d22906 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:46.928981 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4a4de6cc-b4d3-4e91-ba47-350bd8d22906 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081275 May 10 21:27:46.929562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1342/2118] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:46 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:47.864324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bdee07a9-defa-4fb8-9dca-3a5f530bf428 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:47.864952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bdee07a9-defa-4fb8-9dca-3a5f530bf428 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:47.871315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bdee07a9-defa-4fb8-9dca-3a5f530bf428 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:47.871768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bdee07a9-defa-4fb8-9dca-3a5f530bf428 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:47.872545 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bdee07a9-defa-4fb8-9dca-3a5f530bf428 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:47.873022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bdee07a9-defa-4fb8-9dca-3a5f530bf428 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:47.934260 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bdee07a9-defa-4fb8-9dca-3a5f530bf428 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:47.943566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bdee07a9-defa-4fb8-9dca-3a5f530bf428 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:47.945085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bdee07a9-defa-4fb8-9dca-3a5f530bf428 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:47.946237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bdee07a9-defa-4fb8-9dca-3a5f530bf428 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085977 May 10 21:27:47.946809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1343/2119] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:47 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:47.951746 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-78937121-c954-49ff-b014-6175a8e9744f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:47.952390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-78937121-c954-49ff-b014-6175a8e9744f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:47.958663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-78937121-c954-49ff-b014-6175a8e9744f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:47.959106 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-78937121-c954-49ff-b014-6175a8e9744f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:47.959928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-78937121-c954-49ff-b014-6175a8e9744f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:47.960360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-78937121-c954-49ff-b014-6175a8e9744f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:48.023057 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-78937121-c954-49ff-b014-6175a8e9744f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:48.030606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-78937121-c954-49ff-b014-6175a8e9744f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082839 May 10 21:27:48.031175 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1344/2120] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:47 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:48.965169 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-47dedae7-170e-44f3-b2c5-e87f796cf056 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:48.965806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-47dedae7-170e-44f3-b2c5-e87f796cf056 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:48.972585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47dedae7-170e-44f3-b2c5-e87f796cf056 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:48.973040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47dedae7-170e-44f3-b2c5-e87f796cf056 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:48.973831 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47dedae7-170e-44f3-b2c5-e87f796cf056 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:48.974275 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47dedae7-170e-44f3-b2c5-e87f796cf056 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:49.035140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-47dedae7-170e-44f3-b2c5-e87f796cf056 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:49.043384 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-47dedae7-170e-44f3-b2c5-e87f796cf056 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:49.045918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-47dedae7-170e-44f3-b2c5-e87f796cf056 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:49.047100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-47dedae7-170e-44f3-b2c5-e87f796cf056 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085961 May 10 21:27:49.047691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1345/2121] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:48 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:49.051983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7d9ebd23-a6e1-4303-a964-fd548e94c121 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:49.052589 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7d9ebd23-a6e1-4303-a964-fd548e94c121 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:49.058123 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7d9ebd23-a6e1-4303-a964-fd548e94c121 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:49.058572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7d9ebd23-a6e1-4303-a964-fd548e94c121 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:49.059367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7d9ebd23-a6e1-4303-a964-fd548e94c121 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:49.059804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7d9ebd23-a6e1-4303-a964-fd548e94c121 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:49.120124 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7d9ebd23-a6e1-4303-a964-fd548e94c121 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:49.128661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7d9ebd23-a6e1-4303-a964-fd548e94c121 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080012 May 10 21:27:49.129224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1346/2122] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:49 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:50.064647 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-553a0b19-c57b-45d8-9fdf-a6089537f4b0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:50.065312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-553a0b19-c57b-45d8-9fdf-a6089537f4b0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:50.071708 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-553a0b19-c57b-45d8-9fdf-a6089537f4b0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:50.072168 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-553a0b19-c57b-45d8-9fdf-a6089537f4b0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:50.072933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-553a0b19-c57b-45d8-9fdf-a6089537f4b0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:50.073378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-553a0b19-c57b-45d8-9fdf-a6089537f4b0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:50.133517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-553a0b19-c57b-45d8-9fdf-a6089537f4b0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:50.142212 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-553a0b19-c57b-45d8-9fdf-a6089537f4b0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:50.143770 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-553a0b19-c57b-45d8-9fdf-a6089537f4b0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:50.144911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-553a0b19-c57b-45d8-9fdf-a6089537f4b0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084485 May 10 21:27:50.145469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1347/2123] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:50 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:50.149772 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2f85b980-2883-43cc-9682-44b3ba013f14 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:50.150381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2f85b980-2883-43cc-9682-44b3ba013f14 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:50.156631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2f85b980-2883-43cc-9682-44b3ba013f14 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:50.157086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2f85b980-2883-43cc-9682-44b3ba013f14 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:50.157858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2f85b980-2883-43cc-9682-44b3ba013f14 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:50.158294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2f85b980-2883-43cc-9682-44b3ba013f14 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:50.221904 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2f85b980-2883-43cc-9682-44b3ba013f14 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:50.229326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2f85b980-2883-43cc-9682-44b3ba013f14 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082915 May 10 21:27:50.229895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1348/2124] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:50 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:51.163543 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5ec9e90f-fd3a-42c9-94d5-b8f669342ab9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:51.164222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5ec9e90f-fd3a-42c9-94d5-b8f669342ab9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:51.170609 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ec9e90f-fd3a-42c9-94d5-b8f669342ab9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:51.171053 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ec9e90f-fd3a-42c9-94d5-b8f669342ab9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:51.171832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ec9e90f-fd3a-42c9-94d5-b8f669342ab9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:51.172267 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ec9e90f-fd3a-42c9-94d5-b8f669342ab9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:51.232638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5ec9e90f-fd3a-42c9-94d5-b8f669342ab9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:51.240853 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5ec9e90f-fd3a-42c9-94d5-b8f669342ab9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:51.242510 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5ec9e90f-fd3a-42c9-94d5-b8f669342ab9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:51.243674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5ec9e90f-fd3a-42c9-94d5-b8f669342ab9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084107 May 10 21:27:51.244227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1349/2125] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:51 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:51.249188 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c463b51e-185d-445a-8010-41d3579e8fc2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:51.249785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c463b51e-185d-445a-8010-41d3579e8fc2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:51.255599 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c463b51e-185d-445a-8010-41d3579e8fc2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:51.256054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c463b51e-185d-445a-8010-41d3579e8fc2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:51.256853 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c463b51e-185d-445a-8010-41d3579e8fc2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:51.257292 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c463b51e-185d-445a-8010-41d3579e8fc2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:51.317689 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c463b51e-185d-445a-8010-41d3579e8fc2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:51.324919 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c463b51e-185d-445a-8010-41d3579e8fc2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079777 May 10 21:27:51.325478 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1350/2126] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:51 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:52.262032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d9f14fe0-f2b2-4fd6-8a2d-3f05908f907e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:52.262679 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d9f14fe0-f2b2-4fd6-8a2d-3f05908f907e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:52.269641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d9f14fe0-f2b2-4fd6-8a2d-3f05908f907e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:52.270087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d9f14fe0-f2b2-4fd6-8a2d-3f05908f907e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:52.270843 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d9f14fe0-f2b2-4fd6-8a2d-3f05908f907e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:52.271322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d9f14fe0-f2b2-4fd6-8a2d-3f05908f907e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:52.333405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d9f14fe0-f2b2-4fd6-8a2d-3f05908f907e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:52.341648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d9f14fe0-f2b2-4fd6-8a2d-3f05908f907e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:52.343897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d9f14fe0-f2b2-4fd6-8a2d-3f05908f907e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:52.345026 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d9f14fe0-f2b2-4fd6-8a2d-3f05908f907e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087074 May 10 21:27:52.345583 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1351/2127] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:52 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:52.349879 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d0415bcd-6be3-488c-bf6d-3720ce13217d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:52.350477 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d0415bcd-6be3-488c-bf6d-3720ce13217d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:52.356261 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0415bcd-6be3-488c-bf6d-3720ce13217d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:52.356705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0415bcd-6be3-488c-bf6d-3720ce13217d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:52.357738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0415bcd-6be3-488c-bf6d-3720ce13217d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:52.358138 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0415bcd-6be3-488c-bf6d-3720ce13217d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:52.420677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d0415bcd-6be3-488c-bf6d-3720ce13217d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:52.427957 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d0415bcd-6be3-488c-bf6d-3720ce13217d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081434 May 10 21:27:52.428516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1352/2128] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:52 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:53.362958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5e22115d-52d1-4f36-b099-08d1df879a42 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:53.363665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5e22115d-52d1-4f36-b099-08d1df879a42 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:53.369898 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5e22115d-52d1-4f36-b099-08d1df879a42 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:53.370343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5e22115d-52d1-4f36-b099-08d1df879a42 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:53.371100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5e22115d-52d1-4f36-b099-08d1df879a42 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:53.371698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5e22115d-52d1-4f36-b099-08d1df879a42 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:53.431049 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5e22115d-52d1-4f36-b099-08d1df879a42 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:53.439863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5e22115d-52d1-4f36-b099-08d1df879a42 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:53.441352 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5e22115d-52d1-4f36-b099-08d1df879a42 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:53.442477 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5e22115d-52d1-4f36-b099-08d1df879a42 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083461 May 10 21:27:53.443032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1353/2129] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:53 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:53.447370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ed24922e-21b1-413b-8983-26b4ce99d221 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:53.447976 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ed24922e-21b1-413b-8983-26b4ce99d221 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:53.454267 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed24922e-21b1-413b-8983-26b4ce99d221 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:53.454963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed24922e-21b1-413b-8983-26b4ce99d221 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:53.455748 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed24922e-21b1-413b-8983-26b4ce99d221 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:53.456183 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed24922e-21b1-413b-8983-26b4ce99d221 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:53.515739 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ed24922e-21b1-413b-8983-26b4ce99d221 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:53.522960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ed24922e-21b1-413b-8983-26b4ce99d221 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078912 May 10 21:27:53.523567 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1354/2130] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:53 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:54.461671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ac5020eb-b552-43ac-8a21-7082f08bedc6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:54.462356 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ac5020eb-b552-43ac-8a21-7082f08bedc6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:54.468968 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ac5020eb-b552-43ac-8a21-7082f08bedc6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:54.469424 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ac5020eb-b552-43ac-8a21-7082f08bedc6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:54.470196 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ac5020eb-b552-43ac-8a21-7082f08bedc6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:54.470642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ac5020eb-b552-43ac-8a21-7082f08bedc6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:54.533381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ac5020eb-b552-43ac-8a21-7082f08bedc6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:54.541566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ac5020eb-b552-43ac-8a21-7082f08bedc6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:54.543058 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ac5020eb-b552-43ac-8a21-7082f08bedc6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:54.544210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ac5020eb-b552-43ac-8a21-7082f08bedc6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086626 May 10 21:27:54.544766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1355/2131] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:54 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:54.549969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0a5b5628-ebfd-400e-8d3d-0c0a9660f5cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:54.550577 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0a5b5628-ebfd-400e-8d3d-0c0a9660f5cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:54.556664 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0a5b5628-ebfd-400e-8d3d-0c0a9660f5cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:54.558557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0a5b5628-ebfd-400e-8d3d-0c0a9660f5cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:54.558557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0a5b5628-ebfd-400e-8d3d-0c0a9660f5cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:54.558557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0a5b5628-ebfd-400e-8d3d-0c0a9660f5cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:54.623007 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0a5b5628-ebfd-400e-8d3d-0c0a9660f5cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:54.632084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0a5b5628-ebfd-400e-8d3d-0c0a9660f5cc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.086371 May 10 21:27:54.632650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1356/2132] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:54 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:55.562598 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-97876031-2c99-4aec-87c0-eb78f7d2015f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:55.563316 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-97876031-2c99-4aec-87c0-eb78f7d2015f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:55.569628 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-97876031-2c99-4aec-87c0-eb78f7d2015f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:55.570078 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-97876031-2c99-4aec-87c0-eb78f7d2015f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:55.570840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-97876031-2c99-4aec-87c0-eb78f7d2015f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:55.571317 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-97876031-2c99-4aec-87c0-eb78f7d2015f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:55.632008 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-97876031-2c99-4aec-87c0-eb78f7d2015f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:55.641010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-97876031-2c99-4aec-87c0-eb78f7d2015f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:55.642524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-97876031-2c99-4aec-87c0-eb78f7d2015f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:55.643720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-97876031-2c99-4aec-87c0-eb78f7d2015f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085594 May 10 21:27:55.644278 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1357/2133] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:55 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:55.648617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-33ea5e6f-b460-4bb5-aae6-57d520be18d9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:55.649221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-33ea5e6f-b460-4bb5-aae6-57d520be18d9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:55.655198 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-33ea5e6f-b460-4bb5-aae6-57d520be18d9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:55.655658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-33ea5e6f-b460-4bb5-aae6-57d520be18d9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:55.656627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-33ea5e6f-b460-4bb5-aae6-57d520be18d9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:55.657059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-33ea5e6f-b460-4bb5-aae6-57d520be18d9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:55.717751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-33ea5e6f-b460-4bb5-aae6-57d520be18d9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:55.724936 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-33ea5e6f-b460-4bb5-aae6-57d520be18d9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079710 May 10 21:27:55.725495 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1358/2134] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:55 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:56.662005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7b51f156-c498-4130-b89c-75aa1128c084 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:56.662615 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7b51f156-c498-4130-b89c-75aa1128c084 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:56.668974 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b51f156-c498-4130-b89c-75aa1128c084 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:56.669418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b51f156-c498-4130-b89c-75aa1128c084 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:56.670172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b51f156-c498-4130-b89c-75aa1128c084 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:56.671114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b51f156-c498-4130-b89c-75aa1128c084 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:56.731349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7b51f156-c498-4130-b89c-75aa1128c084 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:56.740137 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7b51f156-c498-4130-b89c-75aa1128c084 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:56.741643 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7b51f156-c498-4130-b89c-75aa1128c084 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:56.742770 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7b51f156-c498-4130-b89c-75aa1128c084 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084675 May 10 21:27:56.743365 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1359/2135] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:56 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:56.747714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-66fdf7bd-4b32-445e-a483-7e3995a9d2c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:56.748307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-66fdf7bd-4b32-445e-a483-7e3995a9d2c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:56.754335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-66fdf7bd-4b32-445e-a483-7e3995a9d2c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:56.754779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-66fdf7bd-4b32-445e-a483-7e3995a9d2c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:56.755563 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-66fdf7bd-4b32-445e-a483-7e3995a9d2c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:56.755997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-66fdf7bd-4b32-445e-a483-7e3995a9d2c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:56.818145 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-66fdf7bd-4b32-445e-a483-7e3995a9d2c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:56.825447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-66fdf7bd-4b32-445e-a483-7e3995a9d2c6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081136 May 10 21:27:56.825998 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1360/2136] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:56 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:57.761456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-eb09ed1c-a8df-4889-a552-975479117e25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:57.762089 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-eb09ed1c-a8df-4889-a552-975479117e25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:57.769431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eb09ed1c-a8df-4889-a552-975479117e25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:57.769887 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eb09ed1c-a8df-4889-a552-975479117e25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:57.770649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eb09ed1c-a8df-4889-a552-975479117e25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:57.771088 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eb09ed1c-a8df-4889-a552-975479117e25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:57.831876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-eb09ed1c-a8df-4889-a552-975479117e25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:57.840143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-eb09ed1c-a8df-4889-a552-975479117e25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:57.841647 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-eb09ed1c-a8df-4889-a552-975479117e25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:57.842804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-eb09ed1c-a8df-4889-a552-975479117e25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085331 May 10 21:27:57.843400 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1361/2137] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:57 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:57.848292 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-db344812-9a55-4f47-bf0c-9422a65f2964 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:57.848914 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-db344812-9a55-4f47-bf0c-9422a65f2964 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:57.854775 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-db344812-9a55-4f47-bf0c-9422a65f2964 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:57.855263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-db344812-9a55-4f47-bf0c-9422a65f2964 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:57.856057 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-db344812-9a55-4f47-bf0c-9422a65f2964 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:57.856495 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-db344812-9a55-4f47-bf0c-9422a65f2964 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:57.915450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-db344812-9a55-4f47-bf0c-9422a65f2964 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:57.922756 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-db344812-9a55-4f47-bf0c-9422a65f2964 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.077852 May 10 21:27:57.923366 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1362/2138] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:57 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:58.861459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f40077a6-c20e-4415-88f5-c64bdd6294f7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:58.862131 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f40077a6-c20e-4415-88f5-c64bdd6294f7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:58.868396 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f40077a6-c20e-4415-88f5-c64bdd6294f7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:58.868849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f40077a6-c20e-4415-88f5-c64bdd6294f7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:58.869601 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f40077a6-c20e-4415-88f5-c64bdd6294f7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:58.870036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f40077a6-c20e-4415-88f5-c64bdd6294f7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:58.930738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f40077a6-c20e-4415-88f5-c64bdd6294f7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:58.940095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f40077a6-c20e-4415-88f5-c64bdd6294f7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:58.941587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f40077a6-c20e-4415-88f5-c64bdd6294f7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:58.942720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f40077a6-c20e-4415-88f5-c64bdd6294f7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085844 May 10 21:27:58.943312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1363/2139] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:58 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:27:58.947656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f1680fb8-eeb9-44ce-906c-e1b0bb973b9d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:58.948249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f1680fb8-eeb9-44ce-906c-e1b0bb973b9d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:58.953966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f1680fb8-eeb9-44ce-906c-e1b0bb973b9d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:58.954660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f1680fb8-eeb9-44ce-906c-e1b0bb973b9d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:58.955441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f1680fb8-eeb9-44ce-906c-e1b0bb973b9d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:58.955875 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f1680fb8-eeb9-44ce-906c-e1b0bb973b9d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:59.017890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f1680fb8-eeb9-44ce-906c-e1b0bb973b9d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:27:59.025092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f1680fb8-eeb9-44ce-906c-e1b0bb973b9d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080842 May 10 21:27:59.025653 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1364/2140] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:27:58 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:27:59.961074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-03b22960-4eaf-4db2-b24a-a226ab546164 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:27:59.961702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-03b22960-4eaf-4db2-b24a-a226ab546164 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:27:59.967931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03b22960-4eaf-4db2-b24a-a226ab546164 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:59.968379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03b22960-4eaf-4db2-b24a-a226ab546164 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:27:59.969284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03b22960-4eaf-4db2-b24a-a226ab546164 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:27:59.969720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03b22960-4eaf-4db2-b24a-a226ab546164 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:00.030450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-03b22960-4eaf-4db2-b24a-a226ab546164 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:00.038975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-03b22960-4eaf-4db2-b24a-a226ab546164 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:00.040501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-03b22960-4eaf-4db2-b24a-a226ab546164 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:00.041637 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-03b22960-4eaf-4db2-b24a-a226ab546164 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084623 May 10 21:28:00.042190 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1365/2141] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:27:59 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:00.046494 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9787b817-7276-4b0d-a853-23e63d2e12b6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:00.047278 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9787b817-7276-4b0d-a853-23e63d2e12b6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:00.052883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9787b817-7276-4b0d-a853-23e63d2e12b6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:00.053334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9787b817-7276-4b0d-a853-23e63d2e12b6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:00.054087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9787b817-7276-4b0d-a853-23e63d2e12b6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:00.054518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9787b817-7276-4b0d-a853-23e63d2e12b6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:00.113972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9787b817-7276-4b0d-a853-23e63d2e12b6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:00.121301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9787b817-7276-4b0d-a853-23e63d2e12b6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078194 May 10 21:28:00.121868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1366/2142] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:00 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:01.060254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5937c32e-58e1-4a7c-80db-ecfe5c0dcacc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:01.060890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5937c32e-58e1-4a7c-80db-ecfe5c0dcacc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:01.067192 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5937c32e-58e1-4a7c-80db-ecfe5c0dcacc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:01.067655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5937c32e-58e1-4a7c-80db-ecfe5c0dcacc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:01.068432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5937c32e-58e1-4a7c-80db-ecfe5c0dcacc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:01.068876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5937c32e-58e1-4a7c-80db-ecfe5c0dcacc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:01.131011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5937c32e-58e1-4a7c-80db-ecfe5c0dcacc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:01.139219 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5937c32e-58e1-4a7c-80db-ecfe5c0dcacc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:01.141360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5937c32e-58e1-4a7c-80db-ecfe5c0dcacc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:01.142503 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5937c32e-58e1-4a7c-80db-ecfe5c0dcacc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086505 May 10 21:28:01.143075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1367/2143] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:01 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:01.147421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e0f32793-db50-4a71-b2ac-7ff192db1ad9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:01.148036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e0f32793-db50-4a71-b2ac-7ff192db1ad9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:01.153990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e0f32793-db50-4a71-b2ac-7ff192db1ad9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:01.154443 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e0f32793-db50-4a71-b2ac-7ff192db1ad9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:01.155248 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e0f32793-db50-4a71-b2ac-7ff192db1ad9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:01.155689 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e0f32793-db50-4a71-b2ac-7ff192db1ad9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:01.217850 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e0f32793-db50-4a71-b2ac-7ff192db1ad9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:01.225741 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e0f32793-db50-4a71-b2ac-7ff192db1ad9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081727 May 10 21:28:01.226289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1368/2144] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:01 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:02.160497 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-01b3d659-f048-4964-b44c-05cf1827e398 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:02.161140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-01b3d659-f048-4964-b44c-05cf1827e398 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:02.167505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01b3d659-f048-4964-b44c-05cf1827e398 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:02.167962 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01b3d659-f048-4964-b44c-05cf1827e398 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:02.168739 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01b3d659-f048-4964-b44c-05cf1827e398 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:02.169184 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01b3d659-f048-4964-b44c-05cf1827e398 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:02.230299 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-01b3d659-f048-4964-b44c-05cf1827e398 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:02.238634 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-01b3d659-f048-4964-b44c-05cf1827e398 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:02.240168 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-01b3d659-f048-4964-b44c-05cf1827e398 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:02.241297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-01b3d659-f048-4964-b44c-05cf1827e398 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084754 May 10 21:28:02.241847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1369/2145] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:02 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:02.246116 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f995adb4-89a3-4200-86c5-831566262733 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:02.246715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f995adb4-89a3-4200-86c5-831566262733 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:02.252994 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f995adb4-89a3-4200-86c5-831566262733 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:02.253438 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f995adb4-89a3-4200-86c5-831566262733 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:02.254194 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f995adb4-89a3-4200-86c5-831566262733 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:02.254623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f995adb4-89a3-4200-86c5-831566262733 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:02.315264 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f995adb4-89a3-4200-86c5-831566262733 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:02.322578 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f995adb4-89a3-4200-86c5-831566262733 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079779 May 10 21:28:02.323156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1370/2146] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:02 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:03.259804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dcee2dc3-8c52-41cd-be71-c7eb1d1b8349 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:03.260493 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dcee2dc3-8c52-41cd-be71-c7eb1d1b8349 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:03.267438 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dcee2dc3-8c52-41cd-be71-c7eb1d1b8349 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:03.267882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dcee2dc3-8c52-41cd-be71-c7eb1d1b8349 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:03.268669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dcee2dc3-8c52-41cd-be71-c7eb1d1b8349 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:03.269100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dcee2dc3-8c52-41cd-be71-c7eb1d1b8349 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:03.327786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dcee2dc3-8c52-41cd-be71-c7eb1d1b8349 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:03.336803 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dcee2dc3-8c52-41cd-be71-c7eb1d1b8349 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:03.338298 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dcee2dc3-8c52-41cd-be71-c7eb1d1b8349 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:03.339447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dcee2dc3-8c52-41cd-be71-c7eb1d1b8349 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083556 May 10 21:28:03.339997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1371/2147] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:03 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:28:03.344340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-76c9b26c-e5b9-45ad-8f1d-b9594a7843ba tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:03.345548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-76c9b26c-e5b9-45ad-8f1d-b9594a7843ba tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:03.351335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76c9b26c-e5b9-45ad-8f1d-b9594a7843ba tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:03.351779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76c9b26c-e5b9-45ad-8f1d-b9594a7843ba tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:03.352533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76c9b26c-e5b9-45ad-8f1d-b9594a7843ba tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:03.352966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76c9b26c-e5b9-45ad-8f1d-b9594a7843ba tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:03.416375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-76c9b26c-e5b9-45ad-8f1d-b9594a7843ba tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:03.424337 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-76c9b26c-e5b9-45ad-8f1d-b9594a7843ba tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083421 May 10 21:28:03.424904 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1372/2148] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:03 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:04.358046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bd5e66da-e074-4a10-88db-ae77d30b176f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:04.358730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bd5e66da-e074-4a10-88db-ae77d30b176f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:04.365649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bd5e66da-e074-4a10-88db-ae77d30b176f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:04.366189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bd5e66da-e074-4a10-88db-ae77d30b176f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:04.366951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bd5e66da-e074-4a10-88db-ae77d30b176f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:04.367410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bd5e66da-e074-4a10-88db-ae77d30b176f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:04.427888 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bd5e66da-e074-4a10-88db-ae77d30b176f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:04.435969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bd5e66da-e074-4a10-88db-ae77d30b176f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:04.437567 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bd5e66da-e074-4a10-88db-ae77d30b176f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:04.438964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bd5e66da-e074-4a10-88db-ae77d30b176f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084719 May 10 21:28:04.439563 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1373/2149] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:04 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:04.443941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-54249ca5-ab88-4f1c-9008-b857b81a141d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:04.444541 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-54249ca5-ab88-4f1c-9008-b857b81a141d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:04.450354 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54249ca5-ab88-4f1c-9008-b857b81a141d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:04.450806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54249ca5-ab88-4f1c-9008-b857b81a141d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:04.451710 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54249ca5-ab88-4f1c-9008-b857b81a141d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:04.452150 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54249ca5-ab88-4f1c-9008-b857b81a141d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:04.513853 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-54249ca5-ab88-4f1c-9008-b857b81a141d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:04.521448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-54249ca5-ab88-4f1c-9008-b857b81a141d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080928 May 10 21:28:04.522018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1374/2150] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:04 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:05.457702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c4eb0b31-7b4a-4132-a63c-46830e8aabf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:05.458355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c4eb0b31-7b4a-4132-a63c-46830e8aabf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:05.464648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4eb0b31-7b4a-4132-a63c-46830e8aabf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:05.465100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4eb0b31-7b4a-4132-a63c-46830e8aabf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:05.465863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4eb0b31-7b4a-4132-a63c-46830e8aabf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:05.466308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4eb0b31-7b4a-4132-a63c-46830e8aabf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:05.527301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c4eb0b31-7b4a-4132-a63c-46830e8aabf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:05.535679 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c4eb0b31-7b4a-4132-a63c-46830e8aabf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:05.537200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c4eb0b31-7b4a-4132-a63c-46830e8aabf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:05.538383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c4eb0b31-7b4a-4132-a63c-46830e8aabf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085563 May 10 21:28:05.538946 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1375/2151] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:05 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:05.543355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3abbf15e-3be1-4a0f-a61c-88447befcffd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:05.543961 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3abbf15e-3be1-4a0f-a61c-88447befcffd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:05.550225 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3abbf15e-3be1-4a0f-a61c-88447befcffd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:05.550681 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3abbf15e-3be1-4a0f-a61c-88447befcffd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:05.551510 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3abbf15e-3be1-4a0f-a61c-88447befcffd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:05.551959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3abbf15e-3be1-4a0f-a61c-88447befcffd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:05.614343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3abbf15e-3be1-4a0f-a61c-88447befcffd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:05.621807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3abbf15e-3be1-4a0f-a61c-88447befcffd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081830 May 10 21:28:05.622379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1376/2152] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:05 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:06.557310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-19d412dd-5478-43e3-b28b-08191375eba2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:06.557993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-19d412dd-5478-43e3-b28b-08191375eba2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:06.565469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-19d412dd-5478-43e3-b28b-08191375eba2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:06.565925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-19d412dd-5478-43e3-b28b-08191375eba2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:06.566695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-19d412dd-5478-43e3-b28b-08191375eba2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:06.567162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-19d412dd-5478-43e3-b28b-08191375eba2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:06.629007 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-19d412dd-5478-43e3-b28b-08191375eba2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:06.637333 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-19d412dd-5478-43e3-b28b-08191375eba2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:06.638847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-19d412dd-5478-43e3-b28b-08191375eba2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:06.640049 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-19d412dd-5478-43e3-b28b-08191375eba2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086694 May 10 21:28:06.647172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1377/2153] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:06 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:06.647172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c5da7822-29fe-47d7-a0dd-f436585fe67a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:06.647172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c5da7822-29fe-47d7-a0dd-f436585fe67a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:06.652119 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5da7822-29fe-47d7-a0dd-f436585fe67a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:06.652662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5da7822-29fe-47d7-a0dd-f436585fe67a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:06.653321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5da7822-29fe-47d7-a0dd-f436585fe67a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:06.653758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5da7822-29fe-47d7-a0dd-f436585fe67a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:06.718616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c5da7822-29fe-47d7-a0dd-f436585fe67a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:06.726986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c5da7822-29fe-47d7-a0dd-f436585fe67a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.085455 May 10 21:28:06.727577 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1378/2154] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:06 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:07.657871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-19da424b-e3b6-43d9-a3c5-34824eebd8e0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:07.658507 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-19da424b-e3b6-43d9-a3c5-34824eebd8e0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:07.664852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-19da424b-e3b6-43d9-a3c5-34824eebd8e0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:07.665291 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-19da424b-e3b6-43d9-a3c5-34824eebd8e0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:07.666045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-19da424b-e3b6-43d9-a3c5-34824eebd8e0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:07.666476 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-19da424b-e3b6-43d9-a3c5-34824eebd8e0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:07.726501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-19da424b-e3b6-43d9-a3c5-34824eebd8e0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:07.734826 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-19da424b-e3b6-43d9-a3c5-34824eebd8e0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:07.737023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-19da424b-e3b6-43d9-a3c5-34824eebd8e0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:07.738147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-19da424b-e3b6-43d9-a3c5-34824eebd8e0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084289 May 10 21:28:07.738701 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1379/2155] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:07 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:07.745049 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-87b9cc38-00d0-4edb-8517-383378cbbc27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:07.745649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-87b9cc38-00d0-4edb-8517-383378cbbc27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:07.752203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87b9cc38-00d0-4edb-8517-383378cbbc27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:07.752651 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87b9cc38-00d0-4edb-8517-383378cbbc27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:07.753401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87b9cc38-00d0-4edb-8517-383378cbbc27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:07.753833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87b9cc38-00d0-4edb-8517-383378cbbc27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:07.815174 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-87b9cc38-00d0-4edb-8517-383378cbbc27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:07.822398 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-87b9cc38-00d0-4edb-8517-383378cbbc27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080748 May 10 21:28:07.822961 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1380/2156] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:07 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:28:08.756080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b8c9fcef-e954-45e0-ae1d-067809b1a5a9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:08.756708 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b8c9fcef-e954-45e0-ae1d-067809b1a5a9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:08.763095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b8c9fcef-e954-45e0-ae1d-067809b1a5a9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:08.763568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b8c9fcef-e954-45e0-ae1d-067809b1a5a9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:08.764338 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b8c9fcef-e954-45e0-ae1d-067809b1a5a9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:08.764783 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b8c9fcef-e954-45e0-ae1d-067809b1a5a9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:08.825864 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b8c9fcef-e954-45e0-ae1d-067809b1a5a9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:08.835151 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b8c9fcef-e954-45e0-ae1d-067809b1a5a9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:08.836673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b8c9fcef-e954-45e0-ae1d-067809b1a5a9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:08.837794 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b8c9fcef-e954-45e0-ae1d-067809b1a5a9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085676 May 10 21:28:08.838353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1381/2157] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:08 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:08.842642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7b276605-c878-49f0-8b83-8d54e5a0c94d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:08.843276 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7b276605-c878-49f0-8b83-8d54e5a0c94d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:08.849036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b276605-c878-49f0-8b83-8d54e5a0c94d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:08.849491 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b276605-c878-49f0-8b83-8d54e5a0c94d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:08.850250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b276605-c878-49f0-8b83-8d54e5a0c94d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:08.850690 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b276605-c878-49f0-8b83-8d54e5a0c94d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:08.910006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7b276605-c878-49f0-8b83-8d54e5a0c94d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:08.917208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7b276605-c878-49f0-8b83-8d54e5a0c94d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.077929 May 10 21:28:08.917772 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1382/2158] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:08 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:09.855181 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-70cdde60-0c31-4f91-bb34-6a285fcbe20d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:09.855844 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-70cdde60-0c31-4f91-bb34-6a285fcbe20d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:09.863349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-70cdde60-0c31-4f91-bb34-6a285fcbe20d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:09.863750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-70cdde60-0c31-4f91-bb34-6a285fcbe20d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:09.864511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-70cdde60-0c31-4f91-bb34-6a285fcbe20d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:09.864950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-70cdde60-0c31-4f91-bb34-6a285fcbe20d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:09.927054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-70cdde60-0c31-4f91-bb34-6a285fcbe20d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:09.935348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-70cdde60-0c31-4f91-bb34-6a285fcbe20d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:09.936851 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-70cdde60-0c31-4f91-bb34-6a285fcbe20d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:09.937988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-70cdde60-0c31-4f91-bb34-6a285fcbe20d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086767 May 10 21:28:09.939046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1383/2159] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:09 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:09.943403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2d837767-b9ed-4134-be2b-d35f15d19d95 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:09.944012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2d837767-b9ed-4134-be2b-d35f15d19d95 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:09.950005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d837767-b9ed-4134-be2b-d35f15d19d95 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:09.950463 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d837767-b9ed-4134-be2b-d35f15d19d95 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:09.951269 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d837767-b9ed-4134-be2b-d35f15d19d95 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:09.951715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d837767-b9ed-4134-be2b-d35f15d19d95 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:10.018363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2d837767-b9ed-4134-be2b-d35f15d19d95 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:10.025764 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2d837767-b9ed-4134-be2b-d35f15d19d95 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.085758 May 10 21:28:10.026316 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1384/2160] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:09 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:10.957498 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c30cb91a-5b5e-4f6e-9067-799f62fb9276 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:10.958187 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c30cb91a-5b5e-4f6e-9067-799f62fb9276 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:10.964416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c30cb91a-5b5e-4f6e-9067-799f62fb9276 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:10.964863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c30cb91a-5b5e-4f6e-9067-799f62fb9276 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:10.965616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c30cb91a-5b5e-4f6e-9067-799f62fb9276 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:10.966050 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c30cb91a-5b5e-4f6e-9067-799f62fb9276 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:11.028003 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c30cb91a-5b5e-4f6e-9067-799f62fb9276 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:11.036752 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c30cb91a-5b5e-4f6e-9067-799f62fb9276 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:11.038251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c30cb91a-5b5e-4f6e-9067-799f62fb9276 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:11.039416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c30cb91a-5b5e-4f6e-9067-799f62fb9276 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086816 May 10 21:28:11.039967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1385/2161] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:10 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:11.044250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-04918ee2-27dc-4d35-ab86-acb8e54f89dc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:11.044850 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-04918ee2-27dc-4d35-ab86-acb8e54f89dc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:11.050393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04918ee2-27dc-4d35-ab86-acb8e54f89dc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:11.050836 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04918ee2-27dc-4d35-ab86-acb8e54f89dc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:11.051616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04918ee2-27dc-4d35-ab86-acb8e54f89dc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:11.052055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04918ee2-27dc-4d35-ab86-acb8e54f89dc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:11.111727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-04918ee2-27dc-4d35-ab86-acb8e54f89dc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:11.118949 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-04918ee2-27dc-4d35-ab86-acb8e54f89dc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078054 May 10 21:28:11.119543 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1386/2162] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:11 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:12.057321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-76785d10-ff44-49e8-9d5b-457a6bd6d34e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:12.057936 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-76785d10-ff44-49e8-9d5b-457a6bd6d34e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:12.064861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76785d10-ff44-49e8-9d5b-457a6bd6d34e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:12.065309 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76785d10-ff44-49e8-9d5b-457a6bd6d34e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:12.066068 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76785d10-ff44-49e8-9d5b-457a6bd6d34e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:12.066502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76785d10-ff44-49e8-9d5b-457a6bd6d34e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:12.126852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-76785d10-ff44-49e8-9d5b-457a6bd6d34e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:12.135565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-76785d10-ff44-49e8-9d5b-457a6bd6d34e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:12.137062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-76785d10-ff44-49e8-9d5b-457a6bd6d34e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:12.138200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-76785d10-ff44-49e8-9d5b-457a6bd6d34e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084914 May 10 21:28:12.138756 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1387/2163] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:12 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:12.143738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-28a002ab-6dfa-4f0a-bfe5-cf163ab703c9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:12.144345 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-28a002ab-6dfa-4f0a-bfe5-cf163ab703c9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:12.150110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28a002ab-6dfa-4f0a-bfe5-cf163ab703c9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:12.150562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28a002ab-6dfa-4f0a-bfe5-cf163ab703c9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:12.151392 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28a002ab-6dfa-4f0a-bfe5-cf163ab703c9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:12.151830 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28a002ab-6dfa-4f0a-bfe5-cf163ab703c9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:12.213415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-28a002ab-6dfa-4f0a-bfe5-cf163ab703c9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:12.220854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-28a002ab-6dfa-4f0a-bfe5-cf163ab703c9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081142 May 10 21:28:12.221416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1388/2164] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:12 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:13.157584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4afb882f-fa24-4772-bb64-1948031e6880 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:13.158285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4afb882f-fa24-4772-bb64-1948031e6880 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:13.164508 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4afb882f-fa24-4772-bb64-1948031e6880 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:13.164956 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4afb882f-fa24-4772-bb64-1948031e6880 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:13.165721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4afb882f-fa24-4772-bb64-1948031e6880 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:13.166144 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4afb882f-fa24-4772-bb64-1948031e6880 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:13.225976 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4afb882f-fa24-4772-bb64-1948031e6880 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:13.234168 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4afb882f-fa24-4772-bb64-1948031e6880 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:13.235736 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4afb882f-fa24-4772-bb64-1948031e6880 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:13.236885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4afb882f-fa24-4772-bb64-1948031e6880 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084031 May 10 21:28:13.237440 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1389/2165] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:13 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:13.241723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0124d43d-1472-4a8c-85d1-a3416391131a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:13.242330 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0124d43d-1472-4a8c-85d1-a3416391131a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:13.248203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0124d43d-1472-4a8c-85d1-a3416391131a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:13.248663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0124d43d-1472-4a8c-85d1-a3416391131a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:13.249432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0124d43d-1472-4a8c-85d1-a3416391131a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:13.249876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0124d43d-1472-4a8c-85d1-a3416391131a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:13.309210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0124d43d-1472-4a8c-85d1-a3416391131a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:13.317302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0124d43d-1472-4a8c-85d1-a3416391131a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078920 May 10 21:28:13.317892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1390/2166] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:13 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:14.255655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cb73e4bc-593d-4039-9af9-726febcac388 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:14.256328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cb73e4bc-593d-4039-9af9-726febcac388 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:14.262287 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb73e4bc-593d-4039-9af9-726febcac388 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:14.262735 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb73e4bc-593d-4039-9af9-726febcac388 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:14.263531 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb73e4bc-593d-4039-9af9-726febcac388 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:14.263984 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb73e4bc-593d-4039-9af9-726febcac388 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:14.325590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cb73e4bc-593d-4039-9af9-726febcac388 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:14.334915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cb73e4bc-593d-4039-9af9-726febcac388 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:14.336410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cb73e4bc-593d-4039-9af9-726febcac388 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:14.337546 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cb73e4bc-593d-4039-9af9-726febcac388 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086764 May 10 21:28:14.338106 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1391/2167] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:14 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:14.342385 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f28c6ff0-d40d-4396-aa41-f84430462a86 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:14.342981 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f28c6ff0-d40d-4396-aa41-f84430462a86 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:14.348538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f28c6ff0-d40d-4396-aa41-f84430462a86 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:14.348979 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f28c6ff0-d40d-4396-aa41-f84430462a86 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:14.349730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f28c6ff0-d40d-4396-aa41-f84430462a86 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:14.350159 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f28c6ff0-d40d-4396-aa41-f84430462a86 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:14.413475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f28c6ff0-d40d-4396-aa41-f84430462a86 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:14.420778 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f28c6ff0-d40d-4396-aa41-f84430462a86 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081757 May 10 21:28:14.421336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1392/2168] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:14 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:15.359439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-eaf69fec-266c-412e-b494-fcbb9a3e0cbf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:15.359439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-eaf69fec-266c-412e-b494-fcbb9a3e0cbf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:15.363092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eaf69fec-266c-412e-b494-fcbb9a3e0cbf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:15.363567 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eaf69fec-266c-412e-b494-fcbb9a3e0cbf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:15.364338 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eaf69fec-266c-412e-b494-fcbb9a3e0cbf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:15.364773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eaf69fec-266c-412e-b494-fcbb9a3e0cbf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:15.424878 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-eaf69fec-266c-412e-b494-fcbb9a3e0cbf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:15.433009 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-eaf69fec-266c-412e-b494-fcbb9a3e0cbf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:15.434505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-eaf69fec-266c-412e-b494-fcbb9a3e0cbf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:15.435675 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-eaf69fec-266c-412e-b494-fcbb9a3e0cbf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084307 May 10 21:28:15.436228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1393/2169] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:15 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:15.440817 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-28638914-348e-43d4-a8a7-c9da72108474 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:15.441413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-28638914-348e-43d4-a8a7-c9da72108474 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:15.447145 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28638914-348e-43d4-a8a7-c9da72108474 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:15.447621 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28638914-348e-43d4-a8a7-c9da72108474 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:15.448380 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28638914-348e-43d4-a8a7-c9da72108474 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:15.448813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28638914-348e-43d4-a8a7-c9da72108474 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:15.509032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-28638914-348e-43d4-a8a7-c9da72108474 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:15.516110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-28638914-348e-43d4-a8a7-c9da72108474 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078971 May 10 21:28:15.516668 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1394/2170] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:15 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:16.453998 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d80880ba-9340-4b87-a1d6-679e4523dec0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:16.454933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d80880ba-9340-4b87-a1d6-679e4523dec0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:16.461269 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d80880ba-9340-4b87-a1d6-679e4523dec0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:16.461723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d80880ba-9340-4b87-a1d6-679e4523dec0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:16.462472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d80880ba-9340-4b87-a1d6-679e4523dec0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:16.462907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d80880ba-9340-4b87-a1d6-679e4523dec0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:16.522332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d80880ba-9340-4b87-a1d6-679e4523dec0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:16.530445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d80880ba-9340-4b87-a1d6-679e4523dec0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:16.531972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d80880ba-9340-4b87-a1d6-679e4523dec0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:16.533742 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d80880ba-9340-4b87-a1d6-679e4523dec0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083030 May 10 21:28:16.534301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1395/2171] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:16 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:16.538569 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-54aa8a6b-b274-43ca-9a4a-56ef13b54087 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:16.539189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-54aa8a6b-b274-43ca-9a4a-56ef13b54087 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:16.544934 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54aa8a6b-b274-43ca-9a4a-56ef13b54087 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:16.545389 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54aa8a6b-b274-43ca-9a4a-56ef13b54087 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:16.546185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54aa8a6b-b274-43ca-9a4a-56ef13b54087 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:16.546624 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54aa8a6b-b274-43ca-9a4a-56ef13b54087 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:16.613219 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-54aa8a6b-b274-43ca-9a4a-56ef13b54087 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:16.620489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-54aa8a6b-b274-43ca-9a4a-56ef13b54087 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.085262 May 10 21:28:16.621055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1396/2172] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:16 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:17.551279 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b56816e1-240f-4358-abf4-3987bc39a586 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:17.551993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b56816e1-240f-4358-abf4-3987bc39a586 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:17.558232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b56816e1-240f-4358-abf4-3987bc39a586 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:17.558682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b56816e1-240f-4358-abf4-3987bc39a586 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:17.559473 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b56816e1-240f-4358-abf4-3987bc39a586 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:17.559910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b56816e1-240f-4358-abf4-3987bc39a586 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:17.620778 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b56816e1-240f-4358-abf4-3987bc39a586 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:17.629281 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b56816e1-240f-4358-abf4-3987bc39a586 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:17.630789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b56816e1-240f-4358-abf4-3987bc39a586 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:17.633856 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b56816e1-240f-4358-abf4-3987bc39a586 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085203 May 10 21:28:17.634457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1397/2173] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:17 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:17.642849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e0a5ae45-5d23-48df-9033-9ada63438822 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:17.643490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e0a5ae45-5d23-48df-9033-9ada63438822 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:17.652231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e0a5ae45-5d23-48df-9033-9ada63438822 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:17.652686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e0a5ae45-5d23-48df-9033-9ada63438822 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:17.653455 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e0a5ae45-5d23-48df-9033-9ada63438822 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:17.653896 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e0a5ae45-5d23-48df-9033-9ada63438822 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:17.713995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e0a5ae45-5d23-48df-9033-9ada63438822 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:17.721876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e0a5ae45-5d23-48df-9033-9ada63438822 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.086474 May 10 21:28:17.722431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1398/2174] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:17 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:18.652432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-eda84df7-413c-42b8-a4bf-bbfa37224741 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:18.653076 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-eda84df7-413c-42b8-a4bf-bbfa37224741 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:18.660019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eda84df7-413c-42b8-a4bf-bbfa37224741 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:18.660478 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eda84df7-413c-42b8-a4bf-bbfa37224741 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:18.661242 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eda84df7-413c-42b8-a4bf-bbfa37224741 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:18.661675 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eda84df7-413c-42b8-a4bf-bbfa37224741 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:18.723831 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-eda84df7-413c-42b8-a4bf-bbfa37224741 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:18.731979 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-eda84df7-413c-42b8-a4bf-bbfa37224741 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:18.733477 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-eda84df7-413c-42b8-a4bf-bbfa37224741 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:18.734607 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-eda84df7-413c-42b8-a4bf-bbfa37224741 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086084 May 10 21:28:18.735174 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1399/2175] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:18 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:18.740104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f1906361-61ce-4d13-bc82-4bb619b8af27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:18.740701 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f1906361-61ce-4d13-bc82-4bb619b8af27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:18.746575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f1906361-61ce-4d13-bc82-4bb619b8af27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:18.747063 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f1906361-61ce-4d13-bc82-4bb619b8af27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:18.747893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f1906361-61ce-4d13-bc82-4bb619b8af27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:18.748365 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f1906361-61ce-4d13-bc82-4bb619b8af27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:18.810594 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f1906361-61ce-4d13-bc82-4bb619b8af27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:18.817933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f1906361-61ce-4d13-bc82-4bb619b8af27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081845 May 10 21:28:18.818487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1400/2176] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:18 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:19.753261 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d95f7ec6-a001-4144-ad99-b714cd289fb6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:19.753888 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d95f7ec6-a001-4144-ad99-b714cd289fb6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:19.760316 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d95f7ec6-a001-4144-ad99-b714cd289fb6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:19.760768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d95f7ec6-a001-4144-ad99-b714cd289fb6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:19.761533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d95f7ec6-a001-4144-ad99-b714cd289fb6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:19.761977 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d95f7ec6-a001-4144-ad99-b714cd289fb6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:19.822156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d95f7ec6-a001-4144-ad99-b714cd289fb6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:19.830910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d95f7ec6-a001-4144-ad99-b714cd289fb6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:19.832477 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d95f7ec6-a001-4144-ad99-b714cd289fb6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:19.833629 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d95f7ec6-a001-4144-ad99-b714cd289fb6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084389 May 10 21:28:19.834188 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1401/2177] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:19 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:19.838503 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6c6e85a3-223a-44fa-9fff-b3fcdd1cfc57 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:19.839159 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6c6e85a3-223a-44fa-9fff-b3fcdd1cfc57 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:19.844864 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6c6e85a3-223a-44fa-9fff-b3fcdd1cfc57 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:19.845907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6c6e85a3-223a-44fa-9fff-b3fcdd1cfc57 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:19.846787 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6c6e85a3-223a-44fa-9fff-b3fcdd1cfc57 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:19.847262 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6c6e85a3-223a-44fa-9fff-b3fcdd1cfc57 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:19.905746 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6c6e85a3-223a-44fa-9fff-b3fcdd1cfc57 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:19.913797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6c6e85a3-223a-44fa-9fff-b3fcdd1cfc57 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078664 May 10 21:28:19.914363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1402/2178] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:19 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:20.850784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-513e2526-a893-4d33-90d9-f88ed1131646 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:20.851461 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-513e2526-a893-4d33-90d9-f88ed1131646 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:20.857753 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-513e2526-a893-4d33-90d9-f88ed1131646 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:20.858141 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-513e2526-a893-4d33-90d9-f88ed1131646 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:20.858895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-513e2526-a893-4d33-90d9-f88ed1131646 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:20.859354 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-513e2526-a893-4d33-90d9-f88ed1131646 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:20.919429 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-513e2526-a893-4d33-90d9-f88ed1131646 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:20.927937 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-513e2526-a893-4d33-90d9-f88ed1131646 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:20.929433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-513e2526-a893-4d33-90d9-f88ed1131646 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:20.930583 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-513e2526-a893-4d33-90d9-f88ed1131646 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083767 May 10 21:28:20.931163 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1403/2179] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:20 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:20.935435 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-eecaec87-780c-41e6-82dd-3161934d0c7f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:20.936038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-eecaec87-780c-41e6-82dd-3161934d0c7f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:20.942444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eecaec87-780c-41e6-82dd-3161934d0c7f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:20.942892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eecaec87-780c-41e6-82dd-3161934d0c7f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:20.943687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eecaec87-780c-41e6-82dd-3161934d0c7f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:20.944128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eecaec87-780c-41e6-82dd-3161934d0c7f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:21.006010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-eecaec87-780c-41e6-82dd-3161934d0c7f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:21.013256 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-eecaec87-780c-41e6-82dd-3161934d0c7f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081171 May 10 21:28:21.013821 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1404/2180] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:20 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:21.949094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1fdef890-ef66-4355-8268-dc688caa99d4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:21.949732 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1fdef890-ef66-4355-8268-dc688caa99d4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:21.956748 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1fdef890-ef66-4355-8268-dc688caa99d4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:21.957177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1fdef890-ef66-4355-8268-dc688caa99d4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:21.957938 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1fdef890-ef66-4355-8268-dc688caa99d4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:21.958373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1fdef890-ef66-4355-8268-dc688caa99d4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:22.018602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1fdef890-ef66-4355-8268-dc688caa99d4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:22.026869 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1fdef890-ef66-4355-8268-dc688caa99d4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:22.028407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1fdef890-ef66-4355-8268-dc688caa99d4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:22.029532 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1fdef890-ef66-4355-8268-dc688caa99d4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084457 May 10 21:28:22.030085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1405/2181] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:21 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:22.034350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cdfd10cf-33fc-4e3d-bdca-6a5c03e142e4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:22.034945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cdfd10cf-33fc-4e3d-bdca-6a5c03e142e4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:22.040878 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cdfd10cf-33fc-4e3d-bdca-6a5c03e142e4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:22.041362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cdfd10cf-33fc-4e3d-bdca-6a5c03e142e4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:22.042251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cdfd10cf-33fc-4e3d-bdca-6a5c03e142e4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:22.042702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cdfd10cf-33fc-4e3d-bdca-6a5c03e142e4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:22.104937 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cdfd10cf-33fc-4e3d-bdca-6a5c03e142e4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:22.113113 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cdfd10cf-33fc-4e3d-bdca-6a5c03e142e4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082089 May 10 21:28:22.113683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1406/2182] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:22 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:23.046635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f7e02a50-7539-4315-99c5-39a8c47e3c84 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:23.047310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f7e02a50-7539-4315-99c5-39a8c47e3c84 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:23.054252 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f7e02a50-7539-4315-99c5-39a8c47e3c84 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:23.054702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f7e02a50-7539-4315-99c5-39a8c47e3c84 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:23.055496 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f7e02a50-7539-4315-99c5-39a8c47e3c84 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:23.055934 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f7e02a50-7539-4315-99c5-39a8c47e3c84 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:23.117363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f7e02a50-7539-4315-99c5-39a8c47e3c84 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:23.125501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f7e02a50-7539-4315-99c5-39a8c47e3c84 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:23.127492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f7e02a50-7539-4315-99c5-39a8c47e3c84 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:23.128839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f7e02a50-7539-4315-99c5-39a8c47e3c84 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086137 May 10 21:28:23.129406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1407/2183] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:23 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:23.133697 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-db2cf67c-8d2f-4b33-8cee-22ea23fbff92 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:23.134301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-db2cf67c-8d2f-4b33-8cee-22ea23fbff92 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:23.140157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-db2cf67c-8d2f-4b33-8cee-22ea23fbff92 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:23.140604 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-db2cf67c-8d2f-4b33-8cee-22ea23fbff92 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:23.141392 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-db2cf67c-8d2f-4b33-8cee-22ea23fbff92 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:23.141825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-db2cf67c-8d2f-4b33-8cee-22ea23fbff92 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:23.203490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-db2cf67c-8d2f-4b33-8cee-22ea23fbff92 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:23.210991 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-db2cf67c-8d2f-4b33-8cee-22ea23fbff92 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080667 May 10 21:28:23.211582 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1408/2184] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:23 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:24.147112 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cea89244-093d-4d66-a68d-37ef16bcf835 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:24.147777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cea89244-093d-4d66-a68d-37ef16bcf835 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:24.154203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cea89244-093d-4d66-a68d-37ef16bcf835 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:24.154658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cea89244-093d-4d66-a68d-37ef16bcf835 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:24.155456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cea89244-093d-4d66-a68d-37ef16bcf835 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:24.155902 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cea89244-093d-4d66-a68d-37ef16bcf835 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:24.217858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cea89244-093d-4d66-a68d-37ef16bcf835 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:24.226419 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cea89244-093d-4d66-a68d-37ef16bcf835 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:24.227980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cea89244-093d-4d66-a68d-37ef16bcf835 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:24.229149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cea89244-093d-4d66-a68d-37ef16bcf835 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085976 May 10 21:28:24.229709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1409/2185] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:24 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:24.234048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a174e2f5-b7be-42c3-aa40-e4acd301fba1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:24.234658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a174e2f5-b7be-42c3-aa40-e4acd301fba1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:24.240967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a174e2f5-b7be-42c3-aa40-e4acd301fba1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:24.241423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a174e2f5-b7be-42c3-aa40-e4acd301fba1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:24.242193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a174e2f5-b7be-42c3-aa40-e4acd301fba1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:24.242633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a174e2f5-b7be-42c3-aa40-e4acd301fba1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:24.306045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a174e2f5-b7be-42c3-aa40-e4acd301fba1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:24.313602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a174e2f5-b7be-42c3-aa40-e4acd301fba1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082961 May 10 21:28:24.314823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1410/2186] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:24 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:25.247924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8d577898-17a6-4540-92c9-8af332a97d23 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:25.248581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8d577898-17a6-4540-92c9-8af332a97d23 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:25.255152 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8d577898-17a6-4540-92c9-8af332a97d23 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:25.255622 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8d577898-17a6-4540-92c9-8af332a97d23 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:25.256388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8d577898-17a6-4540-92c9-8af332a97d23 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:25.256830 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8d577898-17a6-4540-92c9-8af332a97d23 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:25.318799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8d577898-17a6-4540-92c9-8af332a97d23 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:25.327192 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8d577898-17a6-4540-92c9-8af332a97d23 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:25.328727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8d577898-17a6-4540-92c9-8af332a97d23 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:25.330706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8d577898-17a6-4540-92c9-8af332a97d23 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085905 May 10 21:28:25.331516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1411/2187] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:25 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:25.335918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b2087159-a1f2-44d9-91b2-280efe413183 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:25.336524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b2087159-a1f2-44d9-91b2-280efe413183 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:25.342283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b2087159-a1f2-44d9-91b2-280efe413183 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:25.342741 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b2087159-a1f2-44d9-91b2-280efe413183 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:25.343541 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b2087159-a1f2-44d9-91b2-280efe413183 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:25.343988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b2087159-a1f2-44d9-91b2-280efe413183 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:25.407698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b2087159-a1f2-44d9-91b2-280efe413183 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:25.415482 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b2087159-a1f2-44d9-91b2-280efe413183 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082993 May 10 21:28:25.416043 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1412/2188] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:25 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:26.348808 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-651f8577-f42d-4d5a-8b2c-d995ea8f33fa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:26.349415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-651f8577-f42d-4d5a-8b2c-d995ea8f33fa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:26.355777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-651f8577-f42d-4d5a-8b2c-d995ea8f33fa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:26.356227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-651f8577-f42d-4d5a-8b2c-d995ea8f33fa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:26.356980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-651f8577-f42d-4d5a-8b2c-d995ea8f33fa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:26.357412 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-651f8577-f42d-4d5a-8b2c-d995ea8f33fa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:26.418349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-651f8577-f42d-4d5a-8b2c-d995ea8f33fa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:26.427457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-651f8577-f42d-4d5a-8b2c-d995ea8f33fa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:26.428993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-651f8577-f42d-4d5a-8b2c-d995ea8f33fa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:26.430230 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-651f8577-f42d-4d5a-8b2c-d995ea8f33fa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085496 May 10 21:28:26.430798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1413/2189] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:26 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:26.435201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c804c0f5-eb87-411e-b8bb-6bb26eb2c8ea tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:26.435812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c804c0f5-eb87-411e-b8bb-6bb26eb2c8ea tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:26.442990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c804c0f5-eb87-411e-b8bb-6bb26eb2c8ea tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:26.443473 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c804c0f5-eb87-411e-b8bb-6bb26eb2c8ea tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:26.444266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c804c0f5-eb87-411e-b8bb-6bb26eb2c8ea tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:26.444704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c804c0f5-eb87-411e-b8bb-6bb26eb2c8ea tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:26.505338 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c804c0f5-eb87-411e-b8bb-6bb26eb2c8ea tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:26.512831 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c804c0f5-eb87-411e-b8bb-6bb26eb2c8ea tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081019 May 10 21:28:26.513395 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1414/2190] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:26 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:27.448616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b857edc9-eda6-481a-86ab-a0c80965dbee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:27.449339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b857edc9-eda6-481a-86ab-a0c80965dbee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:27.456342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b857edc9-eda6-481a-86ab-a0c80965dbee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:27.456803 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b857edc9-eda6-481a-86ab-a0c80965dbee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:27.457569 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b857edc9-eda6-481a-86ab-a0c80965dbee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:27.458007 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b857edc9-eda6-481a-86ab-a0c80965dbee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:27.521020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b857edc9-eda6-481a-86ab-a0c80965dbee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:27.529442 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b857edc9-eda6-481a-86ab-a0c80965dbee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:27.530909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b857edc9-eda6-481a-86ab-a0c80965dbee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:27.532101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b857edc9-eda6-481a-86ab-a0c80965dbee tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087463 May 10 21:28:27.532691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1415/2191] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:27 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:27.537143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b19c5489-6027-4c4a-af78-cbab69d2f310 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:27.537744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b19c5489-6027-4c4a-af78-cbab69d2f310 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:27.543677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b19c5489-6027-4c4a-af78-cbab69d2f310 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:27.544136 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b19c5489-6027-4c4a-af78-cbab69d2f310 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:27.544941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b19c5489-6027-4c4a-af78-cbab69d2f310 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:27.545421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b19c5489-6027-4c4a-af78-cbab69d2f310 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:27.609933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b19c5489-6027-4c4a-af78-cbab69d2f310 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:27.618388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b19c5489-6027-4c4a-af78-cbab69d2f310 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.084598 May 10 21:28:27.619008 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1416/2192] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:27 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:28.550057 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cd127ee8-3751-440d-97ad-f96aa0ee3651 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:28.550744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cd127ee8-3751-440d-97ad-f96aa0ee3651 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:28.557154 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd127ee8-3751-440d-97ad-f96aa0ee3651 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:28.557600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd127ee8-3751-440d-97ad-f96aa0ee3651 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:28.558375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd127ee8-3751-440d-97ad-f96aa0ee3651 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:28.558818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd127ee8-3751-440d-97ad-f96aa0ee3651 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:28.619735 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cd127ee8-3751-440d-97ad-f96aa0ee3651 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:28.628441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cd127ee8-3751-440d-97ad-f96aa0ee3651 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:28.629934 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cd127ee8-3751-440d-97ad-f96aa0ee3651 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:28.631073 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cd127ee8-3751-440d-97ad-f96aa0ee3651 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085071 May 10 21:28:28.631651 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1417/2193] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:28 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:28.635933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a8c98f05-3b34-4568-99fb-f94601e3f57d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:28.636530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a8c98f05-3b34-4568-99fb-f94601e3f57d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:28.642067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a8c98f05-3b34-4568-99fb-f94601e3f57d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:28.643115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a8c98f05-3b34-4568-99fb-f94601e3f57d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:28.643897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a8c98f05-3b34-4568-99fb-f94601e3f57d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:28.644338 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a8c98f05-3b34-4568-99fb-f94601e3f57d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:28.703318 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a8c98f05-3b34-4568-99fb-f94601e3f57d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:28.711091 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a8c98f05-3b34-4568-99fb-f94601e3f57d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078519 May 10 21:28:28.711673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1418/2194] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:28 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:29.649380 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-69bcee7d-0ac8-453c-bdef-82b221763027 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:29.650065 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-69bcee7d-0ac8-453c-bdef-82b221763027 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:29.656366 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-69bcee7d-0ac8-453c-bdef-82b221763027 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:29.656818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-69bcee7d-0ac8-453c-bdef-82b221763027 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:29.657604 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-69bcee7d-0ac8-453c-bdef-82b221763027 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:29.658682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-69bcee7d-0ac8-453c-bdef-82b221763027 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:29.725919 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-69bcee7d-0ac8-453c-bdef-82b221763027 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:29.734217 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-69bcee7d-0ac8-453c-bdef-82b221763027 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:29.735804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-69bcee7d-0ac8-453c-bdef-82b221763027 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:29.737032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-69bcee7d-0ac8-453c-bdef-82b221763027 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.091633 May 10 21:28:29.737592 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1419/2195] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:29 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:29.741898 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-65eca929-c092-40e4-86f9-50db653453c8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:29.742497 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-65eca929-c092-40e4-86f9-50db653453c8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:29.748059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65eca929-c092-40e4-86f9-50db653453c8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:29.748512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65eca929-c092-40e4-86f9-50db653453c8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:29.749280 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65eca929-c092-40e4-86f9-50db653453c8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:29.749723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65eca929-c092-40e4-86f9-50db653453c8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:29.810852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-65eca929-c092-40e4-86f9-50db653453c8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:29.819033 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-65eca929-c092-40e4-86f9-50db653453c8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080505 May 10 21:28:29.819650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1420/2196] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:29 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:30.755461 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1bc80f69-73a1-4ae4-9120-9ccf653ef4e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:30.756097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1bc80f69-73a1-4ae4-9120-9ccf653ef4e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:30.762524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1bc80f69-73a1-4ae4-9120-9ccf653ef4e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:30.762981 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1bc80f69-73a1-4ae4-9120-9ccf653ef4e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:30.763777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1bc80f69-73a1-4ae4-9120-9ccf653ef4e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:30.764218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1bc80f69-73a1-4ae4-9120-9ccf653ef4e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:30.824153 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1bc80f69-73a1-4ae4-9120-9ccf653ef4e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:30.833738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1bc80f69-73a1-4ae4-9120-9ccf653ef4e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:30.835322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1bc80f69-73a1-4ae4-9120-9ccf653ef4e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:30.836469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1bc80f69-73a1-4ae4-9120-9ccf653ef4e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085656 May 10 21:28:30.837036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1421/2197] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:30 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:30.841336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cf598a4e-c628-4361-80cf-35cc58cafd25 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:30.841942 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cf598a4e-c628-4361-80cf-35cc58cafd25 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:30.847911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cf598a4e-c628-4361-80cf-35cc58cafd25 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:30.848355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cf598a4e-c628-4361-80cf-35cc58cafd25 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:30.849118 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cf598a4e-c628-4361-80cf-35cc58cafd25 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:30.849581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cf598a4e-c628-4361-80cf-35cc58cafd25 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:30.909235 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cf598a4e-c628-4361-80cf-35cc58cafd25 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:30.916434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cf598a4e-c628-4361-80cf-35cc58cafd25 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078467 May 10 21:28:30.916988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1422/2198] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:30 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:31.853806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a3c3c76b-7780-42a6-bc12-77eacf47ea7d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:31.854530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a3c3c76b-7780-42a6-bc12-77eacf47ea7d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:31.860793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a3c3c76b-7780-42a6-bc12-77eacf47ea7d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:31.861353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a3c3c76b-7780-42a6-bc12-77eacf47ea7d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:31.862098 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a3c3c76b-7780-42a6-bc12-77eacf47ea7d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:31.862527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a3c3c76b-7780-42a6-bc12-77eacf47ea7d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:31.922878 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a3c3c76b-7780-42a6-bc12-77eacf47ea7d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:31.931271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a3c3c76b-7780-42a6-bc12-77eacf47ea7d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:31.932764 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a3c3c76b-7780-42a6-bc12-77eacf47ea7d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:31.934010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a3c3c76b-7780-42a6-bc12-77eacf47ea7d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084159 May 10 21:28:31.934567 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1423/2199] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:31 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:31.938916 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-064a6792-ebd1-4886-9889-ff0c5681ef9d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:31.939748 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-064a6792-ebd1-4886-9889-ff0c5681ef9d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:31.945692 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-064a6792-ebd1-4886-9889-ff0c5681ef9d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:31.946137 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-064a6792-ebd1-4886-9889-ff0c5681ef9d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:31.946893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-064a6792-ebd1-4886-9889-ff0c5681ef9d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:31.947360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-064a6792-ebd1-4886-9889-ff0c5681ef9d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:32.011537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-064a6792-ebd1-4886-9889-ff0c5681ef9d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:32.019828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-064a6792-ebd1-4886-9889-ff0c5681ef9d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.084234 May 10 21:28:32.020414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1424/2200] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:31 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:32.951162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3ff3a3ec-2a00-491a-92ee-8ea22e949656 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:32.951805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3ff3a3ec-2a00-491a-92ee-8ea22e949656 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:32.958724 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ff3a3ec-2a00-491a-92ee-8ea22e949656 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:32.959193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ff3a3ec-2a00-491a-92ee-8ea22e949656 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:32.959950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ff3a3ec-2a00-491a-92ee-8ea22e949656 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:32.960384 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ff3a3ec-2a00-491a-92ee-8ea22e949656 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:33.021513 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3ff3a3ec-2a00-491a-92ee-8ea22e949656 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:33.029706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3ff3a3ec-2a00-491a-92ee-8ea22e949656 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:33.031551 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3ff3a3ec-2a00-491a-92ee-8ea22e949656 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:33.032440 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3ff3a3ec-2a00-491a-92ee-8ea22e949656 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085439 May 10 21:28:33.033642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1425/2201] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:32 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:33.205463 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4c09a63b-d05c-42fc-b542-047bdf9fb63d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:33.206046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4c09a63b-d05c-42fc-b542-047bdf9fb63d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:33.212135 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4c09a63b-d05c-42fc-b542-047bdf9fb63d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:33.212584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4c09a63b-d05c-42fc-b542-047bdf9fb63d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:33.213377 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4c09a63b-d05c-42fc-b542-047bdf9fb63d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:33.213837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4c09a63b-d05c-42fc-b542-047bdf9fb63d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:33.272816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4c09a63b-d05c-42fc-b542-047bdf9fb63d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:33.280039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4c09a63b-d05c-42fc-b542-047bdf9fb63d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.245170 May 10 21:28:33.280595 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1426/2202] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:33 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:28:34.050445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4265c0ac-878e-4de5-929d-415ea327d3d1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:34.051083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4265c0ac-878e-4de5-929d-415ea327d3d1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:34.057462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4265c0ac-878e-4de5-929d-415ea327d3d1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:34.057921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4265c0ac-878e-4de5-929d-415ea327d3d1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:34.058754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4265c0ac-878e-4de5-929d-415ea327d3d1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:34.059246 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4265c0ac-878e-4de5-929d-415ea327d3d1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:34.119545 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4265c0ac-878e-4de5-929d-415ea327d3d1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:34.128539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4265c0ac-878e-4de5-929d-415ea327d3d1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:34.130047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4265c0ac-878e-4de5-929d-415ea327d3d1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:34.131202 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4265c0ac-878e-4de5-929d-415ea327d3d1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085278 May 10 21:28:34.131761 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1427/2203] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:34 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:34.297419 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e77e2e6e-1b14-43cf-8785-e6b1c6bb5531 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:34.298028 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e77e2e6e-1b14-43cf-8785-e6b1c6bb5531 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:34.304648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e77e2e6e-1b14-43cf-8785-e6b1c6bb5531 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:34.305033 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e77e2e6e-1b14-43cf-8785-e6b1c6bb5531 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:34.305786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e77e2e6e-1b14-43cf-8785-e6b1c6bb5531 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:34.306218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e77e2e6e-1b14-43cf-8785-e6b1c6bb5531 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:34.368172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e77e2e6e-1b14-43cf-8785-e6b1c6bb5531 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:34.375381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e77e2e6e-1b14-43cf-8785-e6b1c6bb5531 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081696 May 10 21:28:34.375940 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1428/2204] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:34 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:28:35.149560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9d0245e4-4f1b-4c29-a9de-6e4c23eac6a3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:35.150200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9d0245e4-4f1b-4c29-a9de-6e4c23eac6a3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:35.156708 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9d0245e4-4f1b-4c29-a9de-6e4c23eac6a3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:35.157166 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9d0245e4-4f1b-4c29-a9de-6e4c23eac6a3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:35.157941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9d0245e4-4f1b-4c29-a9de-6e4c23eac6a3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:35.158381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9d0245e4-4f1b-4c29-a9de-6e4c23eac6a3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:35.219331 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9d0245e4-4f1b-4c29-a9de-6e4c23eac6a3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:35.228154 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9d0245e4-4f1b-4c29-a9de-6e4c23eac6a3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:35.229658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9d0245e4-4f1b-4c29-a9de-6e4c23eac6a3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:35.230791 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9d0245e4-4f1b-4c29-a9de-6e4c23eac6a3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085270 May 10 21:28:35.231383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1429/2205] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:35 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:35.392137 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0a05192c-af8b-451a-aa2e-7bac531d04b8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:35.392742 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0a05192c-af8b-451a-aa2e-7bac531d04b8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:35.399241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0a05192c-af8b-451a-aa2e-7bac531d04b8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:35.399742 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0a05192c-af8b-451a-aa2e-7bac531d04b8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:35.400452 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0a05192c-af8b-451a-aa2e-7bac531d04b8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:35.400883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0a05192c-af8b-451a-aa2e-7bac531d04b8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:35.460133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0a05192c-af8b-451a-aa2e-7bac531d04b8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:35.467405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0a05192c-af8b-451a-aa2e-7bac531d04b8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078946 May 10 21:28:35.467962 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1430/2206] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:35 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:28:36.248767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ef4bfcfb-48af-4295-808c-7f7d48f564b4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:36.249447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ef4bfcfb-48af-4295-808c-7f7d48f564b4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:36.256385 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ef4bfcfb-48af-4295-808c-7f7d48f564b4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:36.256832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ef4bfcfb-48af-4295-808c-7f7d48f564b4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:36.257606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ef4bfcfb-48af-4295-808c-7f7d48f564b4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:36.258039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ef4bfcfb-48af-4295-808c-7f7d48f564b4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:36.320241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ef4bfcfb-48af-4295-808c-7f7d48f564b4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:36.328437 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ef4bfcfb-48af-4295-808c-7f7d48f564b4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:36.329919 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ef4bfcfb-48af-4295-808c-7f7d48f564b4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:36.331457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ef4bfcfb-48af-4295-808c-7f7d48f564b4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086529 May 10 21:28:36.331944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1431/2207] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:36 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:36.485330 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d064f1f8-e1ed-4ddd-8475-55b733107d05 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:36.485940 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d064f1f8-e1ed-4ddd-8475-55b733107d05 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:36.492267 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d064f1f8-e1ed-4ddd-8475-55b733107d05 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:36.492712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d064f1f8-e1ed-4ddd-8475-55b733107d05 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:36.493466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d064f1f8-e1ed-4ddd-8475-55b733107d05 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:36.493898 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d064f1f8-e1ed-4ddd-8475-55b733107d05 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:36.555852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d064f1f8-e1ed-4ddd-8475-55b733107d05 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:36.563143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d064f1f8-e1ed-4ddd-8475-55b733107d05 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081503 May 10 21:28:36.563704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1432/2208] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:36 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:28:37.348768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9a2ee2e4-1a83-4552-8c6f-1bc4dcb5f800 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:37.349441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9a2ee2e4-1a83-4552-8c6f-1bc4dcb5f800 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:37.355891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9a2ee2e4-1a83-4552-8c6f-1bc4dcb5f800 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:37.356336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9a2ee2e4-1a83-4552-8c6f-1bc4dcb5f800 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:37.357094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9a2ee2e4-1a83-4552-8c6f-1bc4dcb5f800 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:37.357529 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9a2ee2e4-1a83-4552-8c6f-1bc4dcb5f800 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:37.417087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9a2ee2e4-1a83-4552-8c6f-1bc4dcb5f800 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:37.425946 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9a2ee2e4-1a83-4552-8c6f-1bc4dcb5f800 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:37.427466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9a2ee2e4-1a83-4552-8c6f-1bc4dcb5f800 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:37.428596 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9a2ee2e4-1a83-4552-8c6f-1bc4dcb5f800 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084484 May 10 21:28:37.429154 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1433/2209] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:37 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:37.579725 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d3824be5-eb5b-4513-87ca-862fa991d8d0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:37.580574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d3824be5-eb5b-4513-87ca-862fa991d8d0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:37.586380 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d3824be5-eb5b-4513-87ca-862fa991d8d0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:37.586822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d3824be5-eb5b-4513-87ca-862fa991d8d0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:37.587608 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d3824be5-eb5b-4513-87ca-862fa991d8d0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:37.588043 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d3824be5-eb5b-4513-87ca-862fa991d8d0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:37.647833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d3824be5-eb5b-4513-87ca-862fa991d8d0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:37.654935 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d3824be5-eb5b-4513-87ca-862fa991d8d0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078860 May 10 21:28:37.655526 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1434/2210] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:37 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:28:38.445758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-12ac8f71-709e-47cf-89b0-47255c1f43fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:38.446413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-12ac8f71-709e-47cf-89b0-47255c1f43fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:38.452801 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-12ac8f71-709e-47cf-89b0-47255c1f43fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:38.453259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-12ac8f71-709e-47cf-89b0-47255c1f43fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:38.454027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-12ac8f71-709e-47cf-89b0-47255c1f43fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:38.454471 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-12ac8f71-709e-47cf-89b0-47255c1f43fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:38.515560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-12ac8f71-709e-47cf-89b0-47255c1f43fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:38.524314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-12ac8f71-709e-47cf-89b0-47255c1f43fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:38.525849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-12ac8f71-709e-47cf-89b0-47255c1f43fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:38.526990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-12ac8f71-709e-47cf-89b0-47255c1f43fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085194 May 10 21:28:38.527597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1435/2211] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:38 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:28:38.673738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-45d0883f-1451-4670-a6b9-eb4dd2a2f59f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:38.674357 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-45d0883f-1451-4670-a6b9-eb4dd2a2f59f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:38.683069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-45d0883f-1451-4670-a6b9-eb4dd2a2f59f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:38.683548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-45d0883f-1451-4670-a6b9-eb4dd2a2f59f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:38.684310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-45d0883f-1451-4670-a6b9-eb4dd2a2f59f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:38.684744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-45d0883f-1451-4670-a6b9-eb4dd2a2f59f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:38.747238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-45d0883f-1451-4670-a6b9-eb4dd2a2f59f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:38.755191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-45d0883f-1451-4670-a6b9-eb4dd2a2f59f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.085307 May 10 21:28:38.755758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1436/2212] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:38 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:28:39.545673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7782061d-96e9-46a7-b408-e3bf7daaf7ef tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:39.546382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7782061d-96e9-46a7-b408-e3bf7daaf7ef tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:39.553616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7782061d-96e9-46a7-b408-e3bf7daaf7ef tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:39.554066 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7782061d-96e9-46a7-b408-e3bf7daaf7ef tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:39.554834 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7782061d-96e9-46a7-b408-e3bf7daaf7ef tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:39.555307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7782061d-96e9-46a7-b408-e3bf7daaf7ef tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:39.616842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7782061d-96e9-46a7-b408-e3bf7daaf7ef tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:39.625107 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7782061d-96e9-46a7-b408-e3bf7daaf7ef tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:39.626605 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7782061d-96e9-46a7-b408-e3bf7daaf7ef tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:39.627823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7782061d-96e9-46a7-b408-e3bf7daaf7ef tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086118 May 10 21:28:39.628390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1437/2213] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:39 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:39.771811 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7c124864-993c-4f2a-942b-a272da1bd715 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:39.772421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7c124864-993c-4f2a-942b-a272da1bd715 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:39.778180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c124864-993c-4f2a-942b-a272da1bd715 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:39.778622 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c124864-993c-4f2a-942b-a272da1bd715 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:39.779403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c124864-993c-4f2a-942b-a272da1bd715 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:39.779841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c124864-993c-4f2a-942b-a272da1bd715 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:39.840328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7c124864-993c-4f2a-942b-a272da1bd715 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:39.848123 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7c124864-993c-4f2a-942b-a272da1bd715 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080113 May 10 21:28:39.848680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1438/2214] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:39 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:28:40.645969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a3dabd4b-353c-4c9e-be3f-ad9ad13c354a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:40.646596 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a3dabd4b-353c-4c9e-be3f-ad9ad13c354a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:40.653261 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a3dabd4b-353c-4c9e-be3f-ad9ad13c354a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:40.653716 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a3dabd4b-353c-4c9e-be3f-ad9ad13c354a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:40.654485 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a3dabd4b-353c-4c9e-be3f-ad9ad13c354a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:40.654933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a3dabd4b-353c-4c9e-be3f-ad9ad13c354a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:40.717433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a3dabd4b-353c-4c9e-be3f-ad9ad13c354a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:40.727109 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a3dabd4b-353c-4c9e-be3f-ad9ad13c354a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:40.728657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a3dabd4b-353c-4c9e-be3f-ad9ad13c354a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:40.729938 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a3dabd4b-353c-4c9e-be3f-ad9ad13c354a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.088504 May 10 21:28:40.730520 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1439/2215] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:40 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:40.864899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-53bd689b-fba3-4312-8db8-1fafe16a5310 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:40.865433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-53bd689b-fba3-4312-8db8-1fafe16a5310 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:40.871409 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-53bd689b-fba3-4312-8db8-1fafe16a5310 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:40.871860 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-53bd689b-fba3-4312-8db8-1fafe16a5310 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:40.872616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-53bd689b-fba3-4312-8db8-1fafe16a5310 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:40.873052 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-53bd689b-fba3-4312-8db8-1fafe16a5310 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:40.935152 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-53bd689b-fba3-4312-8db8-1fafe16a5310 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:40.942535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-53bd689b-fba3-4312-8db8-1fafe16a5310 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081560 May 10 21:28:40.943101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1440/2216] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:40 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:28:41.748230 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fe2e41e3-40e5-421a-a570-f2e52502e6fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:41.748992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fe2e41e3-40e5-421a-a570-f2e52502e6fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:41.756020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fe2e41e3-40e5-421a-a570-f2e52502e6fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:41.756462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fe2e41e3-40e5-421a-a570-f2e52502e6fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:41.757219 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fe2e41e3-40e5-421a-a570-f2e52502e6fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:41.757653 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fe2e41e3-40e5-421a-a570-f2e52502e6fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:41.817418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fe2e41e3-40e5-421a-a570-f2e52502e6fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:41.825539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fe2e41e3-40e5-421a-a570-f2e52502e6fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:41.827032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fe2e41e3-40e5-421a-a570-f2e52502e6fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:41.828190 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fe2e41e3-40e5-421a-a570-f2e52502e6fc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084114 May 10 21:28:41.828746 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1441/2217] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:41 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:41.960487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6d6843b3-3180-4d0c-9084-c29ce0d2cfd9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:41.961039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6d6843b3-3180-4d0c-9084-c29ce0d2cfd9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:41.966897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6d6843b3-3180-4d0c-9084-c29ce0d2cfd9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:41.967531 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6d6843b3-3180-4d0c-9084-c29ce0d2cfd9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:41.968282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6d6843b3-3180-4d0c-9084-c29ce0d2cfd9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:41.968714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6d6843b3-3180-4d0c-9084-c29ce0d2cfd9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:42.027300 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6d6843b3-3180-4d0c-9084-c29ce0d2cfd9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:42.035008 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6d6843b3-3180-4d0c-9084-c29ce0d2cfd9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078538 May 10 21:28:42.035595 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1442/2218] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:41 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:28:42.846126 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3ee7c39c-2971-4c9b-943c-e6d79128acaf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:42.846780 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3ee7c39c-2971-4c9b-943c-e6d79128acaf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:42.853034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ee7c39c-2971-4c9b-943c-e6d79128acaf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:42.853475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ee7c39c-2971-4c9b-943c-e6d79128acaf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:42.854232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ee7c39c-2971-4c9b-943c-e6d79128acaf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:42.854662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ee7c39c-2971-4c9b-943c-e6d79128acaf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:42.915467 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3ee7c39c-2971-4c9b-943c-e6d79128acaf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:42.923585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3ee7c39c-2971-4c9b-943c-e6d79128acaf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:42.925883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3ee7c39c-2971-4c9b-943c-e6d79128acaf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:42.927006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3ee7c39c-2971-4c9b-943c-e6d79128acaf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084893 May 10 21:28:42.927602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1443/2219] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:42 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:43.052127 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-affebda7-bf2a-477e-9149-c386ed995ce0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:43.052731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-affebda7-bf2a-477e-9149-c386ed995ce0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:43.058473 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-affebda7-bf2a-477e-9149-c386ed995ce0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:43.058916 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-affebda7-bf2a-477e-9149-c386ed995ce0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:43.059708 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-affebda7-bf2a-477e-9149-c386ed995ce0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:43.060139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-affebda7-bf2a-477e-9149-c386ed995ce0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:43.124542 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-affebda7-bf2a-477e-9149-c386ed995ce0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:43.132612 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-affebda7-bf2a-477e-9149-c386ed995ce0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.084631 May 10 21:28:43.133176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1444/2220] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:43 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:28:43.945701 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cb858595-80a6-473a-b95c-3dc6a6d047e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:43.946309 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cb858595-80a6-473a-b95c-3dc6a6d047e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:43.952184 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb858595-80a6-473a-b95c-3dc6a6d047e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:43.952637 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb858595-80a6-473a-b95c-3dc6a6d047e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:43.953407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb858595-80a6-473a-b95c-3dc6a6d047e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:43.953846 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb858595-80a6-473a-b95c-3dc6a6d047e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:44.013853 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cb858595-80a6-473a-b95c-3dc6a6d047e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:44.022564 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cb858595-80a6-473a-b95c-3dc6a6d047e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:44.024118 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cb858595-80a6-473a-b95c-3dc6a6d047e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:44.025265 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cb858595-80a6-473a-b95c-3dc6a6d047e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083776 May 10 21:28:44.025830 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1445/2221] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:43 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:44.149919 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-331f8140-fbe9-430b-88e9-fa59b213b3aa tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:44.150533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-331f8140-fbe9-430b-88e9-fa59b213b3aa tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:44.156624 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-331f8140-fbe9-430b-88e9-fa59b213b3aa tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:44.157070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-331f8140-fbe9-430b-88e9-fa59b213b3aa tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:44.157831 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-331f8140-fbe9-430b-88e9-fa59b213b3aa tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:44.158271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-331f8140-fbe9-430b-88e9-fa59b213b3aa tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:44.217615 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-331f8140-fbe9-430b-88e9-fa59b213b3aa tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:44.224944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-331f8140-fbe9-430b-88e9-fa59b213b3aa tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078753 May 10 21:28:44.225494 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1446/2222] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:44 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:28:45.043787 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e2c1dc42-6fe6-431b-a02b-498e87ef3667 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:45.044415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e2c1dc42-6fe6-431b-a02b-498e87ef3667 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:45.055288 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e2c1dc42-6fe6-431b-a02b-498e87ef3667 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:45.055767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e2c1dc42-6fe6-431b-a02b-498e87ef3667 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:45.057529 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e2c1dc42-6fe6-431b-a02b-498e87ef3667 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:45.057972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e2c1dc42-6fe6-431b-a02b-498e87ef3667 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:45.122159 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e2c1dc42-6fe6-431b-a02b-498e87ef3667 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:45.130637 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e2c1dc42-6fe6-431b-a02b-498e87ef3667 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:45.132177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e2c1dc42-6fe6-431b-a02b-498e87ef3667 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:45.133315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e2c1dc42-6fe6-431b-a02b-498e87ef3667 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.093749 May 10 21:28:45.133875 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1447/2223] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:45 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:45.242518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-af9063c7-166e-4a06-b8d0-3b30f0e480cd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:45.243240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-af9063c7-166e-4a06-b8d0-3b30f0e480cd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:45.249402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af9063c7-166e-4a06-b8d0-3b30f0e480cd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:45.249858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af9063c7-166e-4a06-b8d0-3b30f0e480cd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:45.250632 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af9063c7-166e-4a06-b8d0-3b30f0e480cd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:45.251079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af9063c7-166e-4a06-b8d0-3b30f0e480cd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:45.314422 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-af9063c7-166e-4a06-b8d0-3b30f0e480cd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:45.321793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-af9063c7-166e-4a06-b8d0-3b30f0e480cd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083021 May 10 21:28:45.322358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1448/2224] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:45 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:28:46.152208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-04ac7601-74e5-4305-98e1-cda3d1485411 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:46.152887 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-04ac7601-74e5-4305-98e1-cda3d1485411 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:46.159402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04ac7601-74e5-4305-98e1-cda3d1485411 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:46.159855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04ac7601-74e5-4305-98e1-cda3d1485411 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:46.160618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04ac7601-74e5-4305-98e1-cda3d1485411 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:46.161069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04ac7601-74e5-4305-98e1-cda3d1485411 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:46.221193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-04ac7601-74e5-4305-98e1-cda3d1485411 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:46.229390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-04ac7601-74e5-4305-98e1-cda3d1485411 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:46.231061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-04ac7601-74e5-4305-98e1-cda3d1485411 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:46.232217 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-04ac7601-74e5-4305-98e1-cda3d1485411 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084043 May 10 21:28:46.232767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1449/2225] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:46 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:46.341822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5adc2d74-b248-49ef-aeb3-bdb3cfe26a96 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:46.342431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5adc2d74-b248-49ef-aeb3-bdb3cfe26a96 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:46.349118 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5adc2d74-b248-49ef-aeb3-bdb3cfe26a96 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:46.349571 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5adc2d74-b248-49ef-aeb3-bdb3cfe26a96 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:46.350397 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5adc2d74-b248-49ef-aeb3-bdb3cfe26a96 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:46.351220 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5adc2d74-b248-49ef-aeb3-bdb3cfe26a96 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:46.412989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5adc2d74-b248-49ef-aeb3-bdb3cfe26a96 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:46.420350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5adc2d74-b248-49ef-aeb3-bdb3cfe26a96 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082515 May 10 21:28:46.420913 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1450/2226] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:46 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:28:47.250809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-696c39bf-626c-46a3-a5dd-69081313bef7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:47.251539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-696c39bf-626c-46a3-a5dd-69081313bef7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:47.258600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-696c39bf-626c-46a3-a5dd-69081313bef7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:47.259081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-696c39bf-626c-46a3-a5dd-69081313bef7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:47.259871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-696c39bf-626c-46a3-a5dd-69081313bef7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:47.260309 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-696c39bf-626c-46a3-a5dd-69081313bef7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:47.320880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-696c39bf-626c-46a3-a5dd-69081313bef7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:47.329068 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-696c39bf-626c-46a3-a5dd-69081313bef7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:47.331450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-696c39bf-626c-46a3-a5dd-69081313bef7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:47.332598 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-696c39bf-626c-46a3-a5dd-69081313bef7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085736 May 10 21:28:47.333149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1451/2227] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:47 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:47.437928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bbcaf5da-c4c9-40fa-afc4-95562cd98b17 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:47.438533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bbcaf5da-c4c9-40fa-afc4-95562cd98b17 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:47.444965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bbcaf5da-c4c9-40fa-afc4-95562cd98b17 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:47.445412 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bbcaf5da-c4c9-40fa-afc4-95562cd98b17 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:47.446167 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bbcaf5da-c4c9-40fa-afc4-95562cd98b17 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:47.446600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bbcaf5da-c4c9-40fa-afc4-95562cd98b17 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:47.508257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bbcaf5da-c4c9-40fa-afc4-95562cd98b17 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:47.515662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bbcaf5da-c4c9-40fa-afc4-95562cd98b17 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081254 May 10 21:28:47.516231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1452/2228] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:47 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:28:48.352935 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-508666e2-f83a-4674-81e4-3bf20a17bcf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:48.354029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-508666e2-f83a-4674-81e4-3bf20a17bcf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:48.360464 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-508666e2-f83a-4674-81e4-3bf20a17bcf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:48.360913 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-508666e2-f83a-4674-81e4-3bf20a17bcf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:48.361688 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-508666e2-f83a-4674-81e4-3bf20a17bcf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:48.362133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-508666e2-f83a-4674-81e4-3bf20a17bcf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:48.422084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-508666e2-f83a-4674-81e4-3bf20a17bcf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:48.430301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-508666e2-f83a-4674-81e4-3bf20a17bcf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:48.431864 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-508666e2-f83a-4674-81e4-3bf20a17bcf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:48.433023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-508666e2-f83a-4674-81e4-3bf20a17bcf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085833 May 10 21:28:48.433585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1453/2229] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:48 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:28:48.532208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1d061b00-df77-4b50-b218-f6fa9eedcd8a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:48.532839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1d061b00-df77-4b50-b218-f6fa9eedcd8a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:48.538721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d061b00-df77-4b50-b218-f6fa9eedcd8a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:48.539196 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d061b00-df77-4b50-b218-f6fa9eedcd8a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:48.539964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d061b00-df77-4b50-b218-f6fa9eedcd8a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:48.540402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d061b00-df77-4b50-b218-f6fa9eedcd8a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:48.599012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1d061b00-df77-4b50-b218-f6fa9eedcd8a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:48.606635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1d061b00-df77-4b50-b218-f6fa9eedcd8a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.077989 May 10 21:28:48.607338 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1454/2230] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:48 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:28:49.451343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-353e7793-a530-4bf2-8dd5-1b987524c338 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:49.451949 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-353e7793-a530-4bf2-8dd5-1b987524c338 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:49.458558 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-353e7793-a530-4bf2-8dd5-1b987524c338 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:49.459008 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-353e7793-a530-4bf2-8dd5-1b987524c338 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:49.459792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-353e7793-a530-4bf2-8dd5-1b987524c338 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:49.460226 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-353e7793-a530-4bf2-8dd5-1b987524c338 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:49.519907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-353e7793-a530-4bf2-8dd5-1b987524c338 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:49.528254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-353e7793-a530-4bf2-8dd5-1b987524c338 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:49.529767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-353e7793-a530-4bf2-8dd5-1b987524c338 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:49.530910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-353e7793-a530-4bf2-8dd5-1b987524c338 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083521 May 10 21:28:49.531517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1455/2231] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:49 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:49.623449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3158cd33-5fa8-4431-8016-6b0c12443f35 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:49.624070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3158cd33-5fa8-4431-8016-6b0c12443f35 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:49.630132 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3158cd33-5fa8-4431-8016-6b0c12443f35 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:49.630587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3158cd33-5fa8-4431-8016-6b0c12443f35 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:49.631390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3158cd33-5fa8-4431-8016-6b0c12443f35 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:49.631832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3158cd33-5fa8-4431-8016-6b0c12443f35 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:49.695013 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3158cd33-5fa8-4431-8016-6b0c12443f35 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:49.702444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3158cd33-5fa8-4431-8016-6b0c12443f35 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082790 May 10 21:28:49.703007 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1456/2232] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:49 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:28:50.549759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fa0aa072-66b7-4c1e-b8cb-10c084211998 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:50.550445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fa0aa072-66b7-4c1e-b8cb-10c084211998 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:50.556654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fa0aa072-66b7-4c1e-b8cb-10c084211998 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:50.557109 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fa0aa072-66b7-4c1e-b8cb-10c084211998 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:50.557869 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fa0aa072-66b7-4c1e-b8cb-10c084211998 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:50.558307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fa0aa072-66b7-4c1e-b8cb-10c084211998 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:50.620775 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fa0aa072-66b7-4c1e-b8cb-10c084211998 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:50.629243 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fa0aa072-66b7-4c1e-b8cb-10c084211998 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:50.634379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fa0aa072-66b7-4c1e-b8cb-10c084211998 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:50.634379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fa0aa072-66b7-4c1e-b8cb-10c084211998 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086243 May 10 21:28:50.634379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1457/2233] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:50 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:50.719800 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-75c33828-0b5e-4ad5-9071-b8e63e19faac tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:50.720414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-75c33828-0b5e-4ad5-9071-b8e63e19faac tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:50.726698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-75c33828-0b5e-4ad5-9071-b8e63e19faac tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:50.727164 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-75c33828-0b5e-4ad5-9071-b8e63e19faac tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:50.727931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-75c33828-0b5e-4ad5-9071-b8e63e19faac tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:50.728384 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-75c33828-0b5e-4ad5-9071-b8e63e19faac tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:50.787936 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-75c33828-0b5e-4ad5-9071-b8e63e19faac tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:50.795298 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-75c33828-0b5e-4ad5-9071-b8e63e19faac tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079249 May 10 21:28:50.795857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1458/2234] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:50 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:28:51.649663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c8c7d461-6cbe-446b-b628-07a82e898794 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:51.650268 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c8c7d461-6cbe-446b-b628-07a82e898794 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:51.656658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c8c7d461-6cbe-446b-b628-07a82e898794 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:51.657111 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c8c7d461-6cbe-446b-b628-07a82e898794 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:51.657862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c8c7d461-6cbe-446b-b628-07a82e898794 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:51.658297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c8c7d461-6cbe-446b-b628-07a82e898794 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:51.720441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c8c7d461-6cbe-446b-b628-07a82e898794 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:51.729271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c8c7d461-6cbe-446b-b628-07a82e898794 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:51.730777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c8c7d461-6cbe-446b-b628-07a82e898794 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:51.731949 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c8c7d461-6cbe-446b-b628-07a82e898794 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086282 May 10 21:28:51.732514 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1459/2235] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:51 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:51.811940 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-04653abb-fe40-4a95-9e49-aee717111119 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:51.812553 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-04653abb-fe40-4a95-9e49-aee717111119 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:51.818328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04653abb-fe40-4a95-9e49-aee717111119 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:51.818775 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04653abb-fe40-4a95-9e49-aee717111119 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:51.819573 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04653abb-fe40-4a95-9e49-aee717111119 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:51.820011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04653abb-fe40-4a95-9e49-aee717111119 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:51.883082 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-04653abb-fe40-4a95-9e49-aee717111119 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:51.890381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-04653abb-fe40-4a95-9e49-aee717111119 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082146 May 10 21:28:51.890945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1460/2236] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:51 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:28:52.749892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8346d6b3-54e1-4440-b143-87e126b3247c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:52.750511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8346d6b3-54e1-4440-b143-87e126b3247c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:52.757991 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8346d6b3-54e1-4440-b143-87e126b3247c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:52.758472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8346d6b3-54e1-4440-b143-87e126b3247c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:52.759269 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8346d6b3-54e1-4440-b143-87e126b3247c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:52.759709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8346d6b3-54e1-4440-b143-87e126b3247c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:52.821059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8346d6b3-54e1-4440-b143-87e126b3247c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:52.829183 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8346d6b3-54e1-4440-b143-87e126b3247c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:52.830943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8346d6b3-54e1-4440-b143-87e126b3247c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:52.832117 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8346d6b3-54e1-4440-b143-87e126b3247c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086265 May 10 21:28:52.832675 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1461/2237] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:52 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:52.907496 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6f0ce9cc-2587-434c-a51f-ac026f730c08 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:52.908101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6f0ce9cc-2587-434c-a51f-ac026f730c08 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:52.914112 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6f0ce9cc-2587-434c-a51f-ac026f730c08 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:52.914557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6f0ce9cc-2587-434c-a51f-ac026f730c08 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:52.915347 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6f0ce9cc-2587-434c-a51f-ac026f730c08 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:52.915780 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6f0ce9cc-2587-434c-a51f-ac026f730c08 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:52.975250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6f0ce9cc-2587-434c-a51f-ac026f730c08 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:52.982461 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6f0ce9cc-2587-434c-a51f-ac026f730c08 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078578 May 10 21:28:52.983011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1462/2238] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:52 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:28:53.850414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ff4b4606-ec91-4d1a-b15d-28f1511cf1b8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:53.851820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ff4b4606-ec91-4d1a-b15d-28f1511cf1b8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:53.858263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ff4b4606-ec91-4d1a-b15d-28f1511cf1b8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:53.858655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ff4b4606-ec91-4d1a-b15d-28f1511cf1b8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:53.859458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ff4b4606-ec91-4d1a-b15d-28f1511cf1b8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:53.859892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ff4b4606-ec91-4d1a-b15d-28f1511cf1b8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:53.919466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ff4b4606-ec91-4d1a-b15d-28f1511cf1b8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:53.927645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ff4b4606-ec91-4d1a-b15d-28f1511cf1b8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:53.929864 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ff4b4606-ec91-4d1a-b15d-28f1511cf1b8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:53.930997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ff4b4606-ec91-4d1a-b15d-28f1511cf1b8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084531 May 10 21:28:53.931599 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1463/2239] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:53 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:53.999463 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3daf1318-9308-4374-81de-cb022714fe09 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:54.000067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3daf1318-9308-4374-81de-cb022714fe09 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:54.005856 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3daf1318-9308-4374-81de-cb022714fe09 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:54.006304 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3daf1318-9308-4374-81de-cb022714fe09 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:54.007060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3daf1318-9308-4374-81de-cb022714fe09 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:54.007674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3daf1318-9308-4374-81de-cb022714fe09 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:54.072124 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3daf1318-9308-4374-81de-cb022714fe09 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:54.079622 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3daf1318-9308-4374-81de-cb022714fe09 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083778 May 10 21:28:54.080177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1464/2240] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:53 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:28:54.948841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b9c4a8c8-e01c-4dec-aa0b-0c069d0e27ad tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:54.949489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b9c4a8c8-e01c-4dec-aa0b-0c069d0e27ad tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:54.955973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b9c4a8c8-e01c-4dec-aa0b-0c069d0e27ad tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:54.956417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b9c4a8c8-e01c-4dec-aa0b-0c069d0e27ad tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:54.957175 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b9c4a8c8-e01c-4dec-aa0b-0c069d0e27ad tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:54.957606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b9c4a8c8-e01c-4dec-aa0b-0c069d0e27ad tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:55.018741 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b9c4a8c8-e01c-4dec-aa0b-0c069d0e27ad tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:55.027344 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b9c4a8c8-e01c-4dec-aa0b-0c069d0e27ad tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:55.028839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b9c4a8c8-e01c-4dec-aa0b-0c069d0e27ad tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:55.029965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b9c4a8c8-e01c-4dec-aa0b-0c069d0e27ad tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085856 May 10 21:28:55.030516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1465/2241] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:54 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:55.097295 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6b5960cb-34e2-403d-bb03-8664721ccc81 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:55.097902 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6b5960cb-34e2-403d-bb03-8664721ccc81 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:55.104034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6b5960cb-34e2-403d-bb03-8664721ccc81 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:55.104474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6b5960cb-34e2-403d-bb03-8664721ccc81 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:55.105229 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6b5960cb-34e2-403d-bb03-8664721ccc81 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:55.105678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6b5960cb-34e2-403d-bb03-8664721ccc81 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:55.166039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6b5960cb-34e2-403d-bb03-8664721ccc81 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:55.173304 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6b5960cb-34e2-403d-bb03-8664721ccc81 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079693 May 10 21:28:55.173864 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1466/2242] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:55 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:28:56.048430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-800743dd-3d53-4585-8894-a2414b97be3a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:56.049069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-800743dd-3d53-4585-8894-a2414b97be3a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:56.055725 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-800743dd-3d53-4585-8894-a2414b97be3a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:56.056174 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-800743dd-3d53-4585-8894-a2414b97be3a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:56.056932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-800743dd-3d53-4585-8894-a2414b97be3a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:56.057369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-800743dd-3d53-4585-8894-a2414b97be3a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:56.120915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-800743dd-3d53-4585-8894-a2414b97be3a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:56.129349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-800743dd-3d53-4585-8894-a2414b97be3a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:56.130893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-800743dd-3d53-4585-8894-a2414b97be3a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:56.132573 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-800743dd-3d53-4585-8894-a2414b97be3a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087909 May 10 21:28:56.133757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1467/2243] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:56 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:56.191376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a3619f45-f04f-4da3-acce-22ff2886f0d9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:56.191989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a3619f45-f04f-4da3-acce-22ff2886f0d9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:56.198709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a3619f45-f04f-4da3-acce-22ff2886f0d9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:56.199185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a3619f45-f04f-4da3-acce-22ff2886f0d9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:56.199998 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a3619f45-f04f-4da3-acce-22ff2886f0d9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:56.200436 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a3619f45-f04f-4da3-acce-22ff2886f0d9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:56.263970 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a3619f45-f04f-4da3-acce-22ff2886f0d9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:56.271410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a3619f45-f04f-4da3-acce-22ff2886f0d9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083773 May 10 21:28:56.271967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1468/2244] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:56 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:28:57.151804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-85cfcf58-8f25-4a0e-8aa4-fa174f6959a2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:57.152472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-85cfcf58-8f25-4a0e-8aa4-fa174f6959a2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:57.158729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-85cfcf58-8f25-4a0e-8aa4-fa174f6959a2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:57.159204 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-85cfcf58-8f25-4a0e-8aa4-fa174f6959a2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:57.159966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-85cfcf58-8f25-4a0e-8aa4-fa174f6959a2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:57.160398 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-85cfcf58-8f25-4a0e-8aa4-fa174f6959a2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:57.220890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-85cfcf58-8f25-4a0e-8aa4-fa174f6959a2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:57.229634 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-85cfcf58-8f25-4a0e-8aa4-fa174f6959a2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:57.231147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-85cfcf58-8f25-4a0e-8aa4-fa174f6959a2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:57.232282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-85cfcf58-8f25-4a0e-8aa4-fa174f6959a2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084998 May 10 21:28:57.232842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1469/2245] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:57 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:57.289115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d80ad17b-3371-4044-b90d-bf9b1fed4c43 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:57.289731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d80ad17b-3371-4044-b90d-bf9b1fed4c43 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:57.295704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d80ad17b-3371-4044-b90d-bf9b1fed4c43 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:57.296158 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d80ad17b-3371-4044-b90d-bf9b1fed4c43 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:57.296924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d80ad17b-3371-4044-b90d-bf9b1fed4c43 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:57.297403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d80ad17b-3371-4044-b90d-bf9b1fed4c43 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:57.357662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d80ad17b-3371-4044-b90d-bf9b1fed4c43 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:57.364947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d80ad17b-3371-4044-b90d-bf9b1fed4c43 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080113 May 10 21:28:57.365519 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1470/2246] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:57 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:28:58.249782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8c7bcfd7-dbd2-4734-bcac-17f1232ad1b9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:58.250465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8c7bcfd7-dbd2-4734-bcac-17f1232ad1b9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:58.256738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c7bcfd7-dbd2-4734-bcac-17f1232ad1b9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:58.257338 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c7bcfd7-dbd2-4734-bcac-17f1232ad1b9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:58.258093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c7bcfd7-dbd2-4734-bcac-17f1232ad1b9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:58.258526 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c7bcfd7-dbd2-4734-bcac-17f1232ad1b9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:58.317714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8c7bcfd7-dbd2-4734-bcac-17f1232ad1b9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:58.326019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8c7bcfd7-dbd2-4734-bcac-17f1232ad1b9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:58.327579 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8c7bcfd7-dbd2-4734-bcac-17f1232ad1b9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:58.328705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8c7bcfd7-dbd2-4734-bcac-17f1232ad1b9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.082830 May 10 21:28:58.329263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1471/2247] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:58 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:58.381307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-afc7f513-9ed7-4622-8317-2ac1bd2ebf52 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:58.381978 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-afc7f513-9ed7-4622-8317-2ac1bd2ebf52 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:58.387727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-afc7f513-9ed7-4622-8317-2ac1bd2ebf52 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:58.388174 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-afc7f513-9ed7-4622-8317-2ac1bd2ebf52 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:58.388925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-afc7f513-9ed7-4622-8317-2ac1bd2ebf52 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:58.389359 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-afc7f513-9ed7-4622-8317-2ac1bd2ebf52 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:58.452945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-afc7f513-9ed7-4622-8317-2ac1bd2ebf52 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:58.460663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-afc7f513-9ed7-4622-8317-2ac1bd2ebf52 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082863 May 10 21:28:58.461255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1472/2248] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:58 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:28:59.347025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-12b5db5d-7294-439b-b236-a77950d66d11 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:59.347717 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-12b5db5d-7294-439b-b236-a77950d66d11 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:59.354039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-12b5db5d-7294-439b-b236-a77950d66d11 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:59.354492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-12b5db5d-7294-439b-b236-a77950d66d11 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:59.355281 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-12b5db5d-7294-439b-b236-a77950d66d11 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:59.355730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-12b5db5d-7294-439b-b236-a77950d66d11 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:59.415406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-12b5db5d-7294-439b-b236-a77950d66d11 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:59.423540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-12b5db5d-7294-439b-b236-a77950d66d11 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:59.425040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-12b5db5d-7294-439b-b236-a77950d66d11 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:59.426177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-12b5db5d-7294-439b-b236-a77950d66d11 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083138 May 10 21:28:59.426739 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1473/2249] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:28:59 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:28:59.477329 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cf700cf3-d791-4af2-82f8-7b5359b1cad4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:28:59.477937 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cf700cf3-d791-4af2-82f8-7b5359b1cad4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:28:59.483737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cf700cf3-d791-4af2-82f8-7b5359b1cad4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:59.484186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cf700cf3-d791-4af2-82f8-7b5359b1cad4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:59.484947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cf700cf3-d791-4af2-82f8-7b5359b1cad4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:28:59.485383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cf700cf3-d791-4af2-82f8-7b5359b1cad4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:28:59.553613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cf700cf3-d791-4af2-82f8-7b5359b1cad4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:28:59.562997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cf700cf3-d791-4af2-82f8-7b5359b1cad4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.089519 May 10 21:28:59.563627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1474/2250] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:28:59 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:00.445389 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-507bf538-98a6-4afe-858d-752d8240473a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:00.446060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-507bf538-98a6-4afe-858d-752d8240473a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:00.452265 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-507bf538-98a6-4afe-858d-752d8240473a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:00.456060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-507bf538-98a6-4afe-858d-752d8240473a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:00.456060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-507bf538-98a6-4afe-858d-752d8240473a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:00.456060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-507bf538-98a6-4afe-858d-752d8240473a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:00.514729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-507bf538-98a6-4afe-858d-752d8240473a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:00.523616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-507bf538-98a6-4afe-858d-752d8240473a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:00.525115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-507bf538-98a6-4afe-858d-752d8240473a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:00.526240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-507bf538-98a6-4afe-858d-752d8240473a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085396 May 10 21:29:00.526799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1475/2251] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:00 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:29:00.580952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-24d67989-f03b-480b-a868-08e0b715bd9e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:00.581554 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-24d67989-f03b-480b-a868-08e0b715bd9e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:00.588152 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-24d67989-f03b-480b-a868-08e0b715bd9e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:00.588604 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-24d67989-f03b-480b-a868-08e0b715bd9e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:00.589353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-24d67989-f03b-480b-a868-08e0b715bd9e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:00.589786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-24d67989-f03b-480b-a868-08e0b715bd9e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:00.652433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-24d67989-f03b-480b-a868-08e0b715bd9e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:00.659928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-24d67989-f03b-480b-a868-08e0b715bd9e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082958 May 10 21:29:00.660488 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1476/2252] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:00 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:01.543975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f542d2eb-90bd-4889-8bc0-c981c5bb854b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:01.544648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f542d2eb-90bd-4889-8bc0-c981c5bb854b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:01.550855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f542d2eb-90bd-4889-8bc0-c981c5bb854b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:01.551342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f542d2eb-90bd-4889-8bc0-c981c5bb854b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:01.552098 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f542d2eb-90bd-4889-8bc0-c981c5bb854b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:01.552618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f542d2eb-90bd-4889-8bc0-c981c5bb854b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:01.613166 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f542d2eb-90bd-4889-8bc0-c981c5bb854b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:01.621710 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f542d2eb-90bd-4889-8bc0-c981c5bb854b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:01.623239 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f542d2eb-90bd-4889-8bc0-c981c5bb854b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:01.624366 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f542d2eb-90bd-4889-8bc0-c981c5bb854b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084345 May 10 21:29:01.624916 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1477/2253] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:01 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:01.676849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c5402b5c-68a3-40b9-9d33-9dc841e728c7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:01.677467 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c5402b5c-68a3-40b9-9d33-9dc841e728c7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:01.683724 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5402b5c-68a3-40b9-9d33-9dc841e728c7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:01.684209 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5402b5c-68a3-40b9-9d33-9dc841e728c7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:01.684980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5402b5c-68a3-40b9-9d33-9dc841e728c7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:01.685424 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5402b5c-68a3-40b9-9d33-9dc841e728c7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:01.750909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c5402b5c-68a3-40b9-9d33-9dc841e728c7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:01.758328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c5402b5c-68a3-40b9-9d33-9dc841e728c7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.085358 May 10 21:29:01.758892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1478/2254] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:01 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:02.643026 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5055527b-fdfd-4204-ae72-9acb685afa52 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:02.643656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5055527b-fdfd-4204-ae72-9acb685afa52 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:02.650527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5055527b-fdfd-4204-ae72-9acb685afa52 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:02.650978 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5055527b-fdfd-4204-ae72-9acb685afa52 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:02.651792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5055527b-fdfd-4204-ae72-9acb685afa52 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:02.652234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5055527b-fdfd-4204-ae72-9acb685afa52 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:02.713756 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5055527b-fdfd-4204-ae72-9acb685afa52 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:02.721976 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5055527b-fdfd-4204-ae72-9acb685afa52 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:02.723526 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5055527b-fdfd-4204-ae72-9acb685afa52 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:02.724663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5055527b-fdfd-4204-ae72-9acb685afa52 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085610 May 10 21:29:02.725220 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1479/2255] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:02 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:02.774717 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c3ea3cc7-a8f7-498a-99eb-73a71d4521f9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:02.775370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c3ea3cc7-a8f7-498a-99eb-73a71d4521f9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:02.781803 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c3ea3cc7-a8f7-498a-99eb-73a71d4521f9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:02.782248 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c3ea3cc7-a8f7-498a-99eb-73a71d4521f9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:02.783004 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c3ea3cc7-a8f7-498a-99eb-73a71d4521f9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:02.783483 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c3ea3cc7-a8f7-498a-99eb-73a71d4521f9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:02.846829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c3ea3cc7-a8f7-498a-99eb-73a71d4521f9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:02.854146 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c3ea3cc7-a8f7-498a-99eb-73a71d4521f9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083118 May 10 21:29:02.854730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1480/2256] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:02 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:03.742632 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0b472d83-bac2-40f2-86a4-991177c79a83 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:03.743328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0b472d83-bac2-40f2-86a4-991177c79a83 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:03.749706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0b472d83-bac2-40f2-86a4-991177c79a83 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:03.750168 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0b472d83-bac2-40f2-86a4-991177c79a83 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:03.750940 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0b472d83-bac2-40f2-86a4-991177c79a83 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:03.751484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0b472d83-bac2-40f2-86a4-991177c79a83 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:03.812149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0b472d83-bac2-40f2-86a4-991177c79a83 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:03.821197 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0b472d83-bac2-40f2-86a4-991177c79a83 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:03.822711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0b472d83-bac2-40f2-86a4-991177c79a83 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:03.823933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0b472d83-bac2-40f2-86a4-991177c79a83 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085305 May 10 21:29:03.824507 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1481/2257] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:03 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:03.872283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b00905a4-8ea5-4df4-8b6e-2b497b164c2a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:03.872510 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b00905a4-8ea5-4df4-8b6e-2b497b164c2a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:03.878400 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b00905a4-8ea5-4df4-8b6e-2b497b164c2a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:03.878857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b00905a4-8ea5-4df4-8b6e-2b497b164c2a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:03.879662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b00905a4-8ea5-4df4-8b6e-2b497b164c2a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:03.880108 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b00905a4-8ea5-4df4-8b6e-2b497b164c2a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:03.939433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b00905a4-8ea5-4df4-8b6e-2b497b164c2a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:03.947364 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b00905a4-8ea5-4df4-8b6e-2b497b164c2a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079588 May 10 21:29:03.947935 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1482/2258] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:03 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:04.841793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d1adbe0e-9623-404b-8534-31a06e3d75fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:04.842428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d1adbe0e-9623-404b-8534-31a06e3d75fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:04.848820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d1adbe0e-9623-404b-8534-31a06e3d75fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:04.849266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d1adbe0e-9623-404b-8534-31a06e3d75fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:04.850021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d1adbe0e-9623-404b-8534-31a06e3d75fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:04.850455 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d1adbe0e-9623-404b-8534-31a06e3d75fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:04.912765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d1adbe0e-9623-404b-8534-31a06e3d75fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:04.921540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d1adbe0e-9623-404b-8534-31a06e3d75fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:04.923029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d1adbe0e-9623-404b-8534-31a06e3d75fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:04.924210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d1adbe0e-9623-404b-8534-31a06e3d75fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086314 May 10 21:29:04.924771 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1483/2259] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:04 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:04.964221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-53285028-9fd9-451d-8674-a54b6c42a997 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:04.964862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-53285028-9fd9-451d-8674-a54b6c42a997 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:04.970723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-53285028-9fd9-451d-8674-a54b6c42a997 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:04.971218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-53285028-9fd9-451d-8674-a54b6c42a997 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:04.971994 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-53285028-9fd9-451d-8674-a54b6c42a997 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:04.972434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-53285028-9fd9-451d-8674-a54b6c42a997 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:05.034987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-53285028-9fd9-451d-8674-a54b6c42a997 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:05.042587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-53285028-9fd9-451d-8674-a54b6c42a997 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082684 May 10 21:29:05.043176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1484/2260] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:04 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:05.941839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0babefd9-dab3-47a8-b428-3e8c6c067c01 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:05.942462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0babefd9-dab3-47a8-b428-3e8c6c067c01 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:05.949372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0babefd9-dab3-47a8-b428-3e8c6c067c01 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:05.949834 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0babefd9-dab3-47a8-b428-3e8c6c067c01 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:05.950603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0babefd9-dab3-47a8-b428-3e8c6c067c01 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:05.951045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0babefd9-dab3-47a8-b428-3e8c6c067c01 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:06.010993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0babefd9-dab3-47a8-b428-3e8c6c067c01 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:06.019163 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0babefd9-dab3-47a8-b428-3e8c6c067c01 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:06.020729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0babefd9-dab3-47a8-b428-3e8c6c067c01 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:06.021852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0babefd9-dab3-47a8-b428-3e8c6c067c01 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084013 May 10 21:29:06.022438 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1485/2261] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:05 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:06.059788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-92f500cd-755c-426b-97d3-ab570111bdc7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:06.060428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-92f500cd-755c-426b-97d3-ab570111bdc7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:06.066117 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-92f500cd-755c-426b-97d3-ab570111bdc7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:06.066564 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-92f500cd-755c-426b-97d3-ab570111bdc7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:06.067349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-92f500cd-755c-426b-97d3-ab570111bdc7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:06.067784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-92f500cd-755c-426b-97d3-ab570111bdc7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:06.128333 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-92f500cd-755c-426b-97d3-ab570111bdc7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:06.136768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-92f500cd-755c-426b-97d3-ab570111bdc7 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080498 May 10 21:29:06.137332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1486/2262] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:06 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:07.040597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f7170fd3-f82d-4a3c-afa8-ffaeb487dda0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:07.041240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f7170fd3-f82d-4a3c-afa8-ffaeb487dda0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:07.047683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f7170fd3-f82d-4a3c-afa8-ffaeb487dda0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:07.048133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f7170fd3-f82d-4a3c-afa8-ffaeb487dda0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:07.048901 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f7170fd3-f82d-4a3c-afa8-ffaeb487dda0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:07.049332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f7170fd3-f82d-4a3c-afa8-ffaeb487dda0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:07.109852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f7170fd3-f82d-4a3c-afa8-ffaeb487dda0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:07.118828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f7170fd3-f82d-4a3c-afa8-ffaeb487dda0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:07.120356 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f7170fd3-f82d-4a3c-afa8-ffaeb487dda0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:07.121717 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f7170fd3-f82d-4a3c-afa8-ffaeb487dda0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085058 May 10 21:29:07.122271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1487/2263] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:07 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:29:07.153396 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1bc19f99-902b-4de7-b7cc-fdc649343f36 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:07.154000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1bc19f99-902b-4de7-b7cc-fdc649343f36 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:07.159883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1bc19f99-902b-4de7-b7cc-fdc649343f36 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:07.160330 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1bc19f99-902b-4de7-b7cc-fdc649343f36 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:07.161083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1bc19f99-902b-4de7-b7cc-fdc649343f36 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:07.161517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1bc19f99-902b-4de7-b7cc-fdc649343f36 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:07.225152 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1bc19f99-902b-4de7-b7cc-fdc649343f36 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:07.233133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1bc19f99-902b-4de7-b7cc-fdc649343f36 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083392 May 10 21:29:07.233698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1488/2264] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:07 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:08.140373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-81ef09d3-cb34-442f-8aed-e7a7ec26d5d9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:08.141021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-81ef09d3-cb34-442f-8aed-e7a7ec26d5d9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:08.147368 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-81ef09d3-cb34-442f-8aed-e7a7ec26d5d9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:08.147807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-81ef09d3-cb34-442f-8aed-e7a7ec26d5d9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:08.148558 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-81ef09d3-cb34-442f-8aed-e7a7ec26d5d9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:08.148991 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-81ef09d3-cb34-442f-8aed-e7a7ec26d5d9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:08.208693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-81ef09d3-cb34-442f-8aed-e7a7ec26d5d9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:08.216932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-81ef09d3-cb34-442f-8aed-e7a7ec26d5d9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:08.218434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-81ef09d3-cb34-442f-8aed-e7a7ec26d5d9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:08.219618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-81ef09d3-cb34-442f-8aed-e7a7ec26d5d9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083147 May 10 21:29:08.220191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1489/2265] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:08 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:08.250095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c4098a09-d3c0-47bb-a5bf-e44e077ca119 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:08.250714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c4098a09-d3c0-47bb-a5bf-e44e077ca119 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:08.256391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4098a09-d3c0-47bb-a5bf-e44e077ca119 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:08.256885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4098a09-d3c0-47bb-a5bf-e44e077ca119 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:08.257751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4098a09-d3c0-47bb-a5bf-e44e077ca119 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:08.258203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4098a09-d3c0-47bb-a5bf-e44e077ca119 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:08.316928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c4098a09-d3c0-47bb-a5bf-e44e077ca119 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:08.324251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c4098a09-d3c0-47bb-a5bf-e44e077ca119 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.077639 May 10 21:29:08.324813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1490/2266] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:08 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:09.238223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-79b945c2-1a4f-4c9f-a60e-03383fd45d76 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:09.238911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-79b945c2-1a4f-4c9f-a60e-03383fd45d76 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:09.246052 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-79b945c2-1a4f-4c9f-a60e-03383fd45d76 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:09.246578 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-79b945c2-1a4f-4c9f-a60e-03383fd45d76 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:09.247374 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-79b945c2-1a4f-4c9f-a60e-03383fd45d76 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:09.247822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-79b945c2-1a4f-4c9f-a60e-03383fd45d76 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:09.307997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-79b945c2-1a4f-4c9f-a60e-03383fd45d76 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:09.316145 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-79b945c2-1a4f-4c9f-a60e-03383fd45d76 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:09.317641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-79b945c2-1a4f-4c9f-a60e-03383fd45d76 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:09.318773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-79b945c2-1a4f-4c9f-a60e-03383fd45d76 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084503 May 10 21:29:09.320234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1491/2267] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:09 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:09.340793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-13d1a285-2c52-407b-9fa1-537ca2defcba tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:09.341395 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-13d1a285-2c52-407b-9fa1-537ca2defcba tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:09.346937 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-13d1a285-2c52-407b-9fa1-537ca2defcba tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:09.347411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-13d1a285-2c52-407b-9fa1-537ca2defcba tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:09.348165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-13d1a285-2c52-407b-9fa1-537ca2defcba tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:09.348595 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-13d1a285-2c52-407b-9fa1-537ca2defcba tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:09.409104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-13d1a285-2c52-407b-9fa1-537ca2defcba tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:09.416878 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-13d1a285-2c52-407b-9fa1-537ca2defcba tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079534 May 10 21:29:09.417442 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1492/2268] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:09 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:10.337458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-86872afd-d7f2-4933-8c11-07e8ca092564 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:10.338135 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-86872afd-d7f2-4933-8c11-07e8ca092564 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:10.344376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-86872afd-d7f2-4933-8c11-07e8ca092564 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:10.344824 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-86872afd-d7f2-4933-8c11-07e8ca092564 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:10.345574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-86872afd-d7f2-4933-8c11-07e8ca092564 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:10.346009 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-86872afd-d7f2-4933-8c11-07e8ca092564 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:10.406812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-86872afd-d7f2-4933-8c11-07e8ca092564 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:10.416407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-86872afd-d7f2-4933-8c11-07e8ca092564 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:10.417904 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-86872afd-d7f2-4933-8c11-07e8ca092564 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:10.419044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-86872afd-d7f2-4933-8c11-07e8ca092564 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085504 May 10 21:29:10.419639 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1493/2269] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:10 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:10.434622 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a17ebc6b-b52b-4a10-a363-9419b2227c56 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:10.435868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a17ebc6b-b52b-4a10-a363-9419b2227c56 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:10.442075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a17ebc6b-b52b-4a10-a363-9419b2227c56 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:10.442550 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a17ebc6b-b52b-4a10-a363-9419b2227c56 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:10.443383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a17ebc6b-b52b-4a10-a363-9419b2227c56 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:10.443816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a17ebc6b-b52b-4a10-a363-9419b2227c56 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:10.505650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a17ebc6b-b52b-4a10-a363-9419b2227c56 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:10.514047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a17ebc6b-b52b-4a10-a363-9419b2227c56 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083704 May 10 21:29:10.514625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1494/2270] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:10 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:11.437641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a317dc46-d1c0-4c0f-8e10-eaf8d2e3c875 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:11.438329 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a317dc46-d1c0-4c0f-8e10-eaf8d2e3c875 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:11.445720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a317dc46-d1c0-4c0f-8e10-eaf8d2e3c875 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:11.446174 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a317dc46-d1c0-4c0f-8e10-eaf8d2e3c875 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:11.446947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a317dc46-d1c0-4c0f-8e10-eaf8d2e3c875 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:11.447408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a317dc46-d1c0-4c0f-8e10-eaf8d2e3c875 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:11.508671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a317dc46-d1c0-4c0f-8e10-eaf8d2e3c875 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:11.516835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a317dc46-d1c0-4c0f-8e10-eaf8d2e3c875 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:11.518333 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a317dc46-d1c0-4c0f-8e10-eaf8d2e3c875 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:11.519507 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a317dc46-d1c0-4c0f-8e10-eaf8d2e3c875 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085821 May 10 21:29:11.520071 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1495/2271] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:11 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:11.531115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d3d9556b-b060-4188-a6e0-76b1039c7135 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:11.531755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d3d9556b-b060-4188-a6e0-76b1039c7135 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:11.537591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d3d9556b-b060-4188-a6e0-76b1039c7135 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:11.538050 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d3d9556b-b060-4188-a6e0-76b1039c7135 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:11.538809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d3d9556b-b060-4188-a6e0-76b1039c7135 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:11.539310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d3d9556b-b060-4188-a6e0-76b1039c7135 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:11.608720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d3d9556b-b060-4188-a6e0-76b1039c7135 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:11.618373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d3d9556b-b060-4188-a6e0-76b1039c7135 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.090805 May 10 21:29:11.618941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1496/2272] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:11 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:12.537807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-daaeeb61-65f5-4aa5-871a-8dfecc9a1a7b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:12.539085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-daaeeb61-65f5-4aa5-871a-8dfecc9a1a7b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:12.545499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-daaeeb61-65f5-4aa5-871a-8dfecc9a1a7b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:12.545977 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-daaeeb61-65f5-4aa5-871a-8dfecc9a1a7b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:12.546738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-daaeeb61-65f5-4aa5-871a-8dfecc9a1a7b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:12.547224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-daaeeb61-65f5-4aa5-871a-8dfecc9a1a7b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:12.607889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-daaeeb61-65f5-4aa5-871a-8dfecc9a1a7b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:12.616986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-daaeeb61-65f5-4aa5-871a-8dfecc9a1a7b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:12.618506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-daaeeb61-65f5-4aa5-871a-8dfecc9a1a7b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:12.619694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-daaeeb61-65f5-4aa5-871a-8dfecc9a1a7b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085852 May 10 21:29:12.620252 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1497/2273] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:12 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:12.636526 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-58915094-9b78-48c3-9b49-61ff6817c465 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:12.637134 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-58915094-9b78-48c3-9b49-61ff6817c465 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:12.642835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-58915094-9b78-48c3-9b49-61ff6817c465 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:12.643327 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-58915094-9b78-48c3-9b49-61ff6817c465 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:12.644089 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-58915094-9b78-48c3-9b49-61ff6817c465 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:12.644530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-58915094-9b78-48c3-9b49-61ff6817c465 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:12.703544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-58915094-9b78-48c3-9b49-61ff6817c465 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:12.711749 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-58915094-9b78-48c3-9b49-61ff6817c465 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078678 May 10 21:29:12.712307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1498/2274] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:12 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:13.637308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1955ffc0-fa99-4ccf-9c68-addead4b1235 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:13.637914 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1955ffc0-fa99-4ccf-9c68-addead4b1235 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:13.643912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1955ffc0-fa99-4ccf-9c68-addead4b1235 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:13.644363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1955ffc0-fa99-4ccf-9c68-addead4b1235 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:13.645206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1955ffc0-fa99-4ccf-9c68-addead4b1235 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:13.645645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1955ffc0-fa99-4ccf-9c68-addead4b1235 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:13.707072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1955ffc0-fa99-4ccf-9c68-addead4b1235 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:13.715727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1955ffc0-fa99-4ccf-9c68-addead4b1235 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:13.717250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1955ffc0-fa99-4ccf-9c68-addead4b1235 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:13.718410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1955ffc0-fa99-4ccf-9c68-addead4b1235 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085188 May 10 21:29:13.718974 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1499/2275] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:13 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:29:13.728461 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6f672c90-065a-43e5-a300-aa67c2c553ec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:13.729069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6f672c90-065a-43e5-a300-aa67c2c553ec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:13.735352 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6f672c90-065a-43e5-a300-aa67c2c553ec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:13.735829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6f672c90-065a-43e5-a300-aa67c2c553ec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:13.736657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6f672c90-065a-43e5-a300-aa67c2c553ec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:13.737100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6f672c90-065a-43e5-a300-aa67c2c553ec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:14.030882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6f672c90-065a-43e5-a300-aa67c2c553ec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:14.039365 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6f672c90-065a-43e5-a300-aa67c2c553ec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.313735 May 10 21:29:14.039942 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1500/2276] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:13 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:14.736338 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7b425129-e236-4186-b65d-548ef2e69e8b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:14.737005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7b425129-e236-4186-b65d-548ef2e69e8b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:14.743928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b425129-e236-4186-b65d-548ef2e69e8b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:14.744384 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b425129-e236-4186-b65d-548ef2e69e8b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:14.745149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b425129-e236-4186-b65d-548ef2e69e8b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:14.745589 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b425129-e236-4186-b65d-548ef2e69e8b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:14.805264 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7b425129-e236-4186-b65d-548ef2e69e8b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:14.813466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7b425129-e236-4186-b65d-548ef2e69e8b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:14.814971 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7b425129-e236-4186-b65d-548ef2e69e8b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:14.816140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7b425129-e236-4186-b65d-548ef2e69e8b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083734 May 10 21:29:14.816711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1501/2277] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:14 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:15.057383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-54a0b79c-03bf-4e02-b047-452f9cd1e0e0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:15.058002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-54a0b79c-03bf-4e02-b047-452f9cd1e0e0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:15.064056 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54a0b79c-03bf-4e02-b047-452f9cd1e0e0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:15.064509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54a0b79c-03bf-4e02-b047-452f9cd1e0e0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:15.065279 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54a0b79c-03bf-4e02-b047-452f9cd1e0e0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:15.065719 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54a0b79c-03bf-4e02-b047-452f9cd1e0e0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:15.127321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-54a0b79c-03bf-4e02-b047-452f9cd1e0e0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:15.135365 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-54a0b79c-03bf-4e02-b047-452f9cd1e0e0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082898 May 10 21:29:15.135923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1502/2278] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:15 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:15.834115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b482bdff-b69a-4c90-abb1-5fbd1dd9ea17 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:15.834769 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b482bdff-b69a-4c90-abb1-5fbd1dd9ea17 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:15.841394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b482bdff-b69a-4c90-abb1-5fbd1dd9ea17 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:15.841841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b482bdff-b69a-4c90-abb1-5fbd1dd9ea17 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:15.842601 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b482bdff-b69a-4c90-abb1-5fbd1dd9ea17 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:15.843033 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b482bdff-b69a-4c90-abb1-5fbd1dd9ea17 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:15.903693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b482bdff-b69a-4c90-abb1-5fbd1dd9ea17 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:15.911866 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b482bdff-b69a-4c90-abb1-5fbd1dd9ea17 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:15.913503 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b482bdff-b69a-4c90-abb1-5fbd1dd9ea17 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:15.914635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b482bdff-b69a-4c90-abb1-5fbd1dd9ea17 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084650 May 10 21:29:15.915209 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1503/2279] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:15 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:16.152986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a508f9cc-c9fb-4b02-8e66-fd0ab5f82db5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:16.153517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a508f9cc-c9fb-4b02-8e66-fd0ab5f82db5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:16.159439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a508f9cc-c9fb-4b02-8e66-fd0ab5f82db5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:16.163820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a508f9cc-c9fb-4b02-8e66-fd0ab5f82db5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:16.163820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a508f9cc-c9fb-4b02-8e66-fd0ab5f82db5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:16.163820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a508f9cc-c9fb-4b02-8e66-fd0ab5f82db5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:16.223107 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a508f9cc-c9fb-4b02-8e66-fd0ab5f82db5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:16.231357 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a508f9cc-c9fb-4b02-8e66-fd0ab5f82db5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082326 May 10 21:29:16.231924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1504/2280] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:16 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:16.933288 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-47b82c5f-ea96-49ee-8059-1e79492261ad tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:16.933954 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-47b82c5f-ea96-49ee-8059-1e79492261ad tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:16.940169 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47b82c5f-ea96-49ee-8059-1e79492261ad tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:16.940617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47b82c5f-ea96-49ee-8059-1e79492261ad tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:16.941434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47b82c5f-ea96-49ee-8059-1e79492261ad tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:16.941823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47b82c5f-ea96-49ee-8059-1e79492261ad tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:17.005093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-47b82c5f-ea96-49ee-8059-1e79492261ad tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:17.013601 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-47b82c5f-ea96-49ee-8059-1e79492261ad tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:17.015094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-47b82c5f-ea96-49ee-8059-1e79492261ad tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:17.016246 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-47b82c5f-ea96-49ee-8059-1e79492261ad tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087707 May 10 21:29:17.016899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1505/2281] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:16 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:17.249800 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bc2a7b51-9014-4482-ae60-c5bd5370e9d9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:17.250328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bc2a7b51-9014-4482-ae60-c5bd5370e9d9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:17.256348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bc2a7b51-9014-4482-ae60-c5bd5370e9d9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:17.256794 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bc2a7b51-9014-4482-ae60-c5bd5370e9d9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:17.257553 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bc2a7b51-9014-4482-ae60-c5bd5370e9d9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:17.257986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bc2a7b51-9014-4482-ae60-c5bd5370e9d9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:17.317162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bc2a7b51-9014-4482-ae60-c5bd5370e9d9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:17.324506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bc2a7b51-9014-4482-ae60-c5bd5370e9d9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078568 May 10 21:29:17.325073 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1506/2282] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:17 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:18.034982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bb19cf0f-f655-4f1a-90e5-43456e08ac5d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:18.035676 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bb19cf0f-f655-4f1a-90e5-43456e08ac5d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:18.041906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bb19cf0f-f655-4f1a-90e5-43456e08ac5d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:18.042353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bb19cf0f-f655-4f1a-90e5-43456e08ac5d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:18.043134 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bb19cf0f-f655-4f1a-90e5-43456e08ac5d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:18.043585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bb19cf0f-f655-4f1a-90e5-43456e08ac5d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:18.105066 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bb19cf0f-f655-4f1a-90e5-43456e08ac5d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:18.113223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bb19cf0f-f655-4f1a-90e5-43456e08ac5d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:18.114738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bb19cf0f-f655-4f1a-90e5-43456e08ac5d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:18.115973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bb19cf0f-f655-4f1a-90e5-43456e08ac5d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085028 May 10 21:29:18.116562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1507/2283] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:18 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:18.342145 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fcc57f72-8f27-4f19-93e8-88e88ea1b40e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:18.342762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fcc57f72-8f27-4f19-93e8-88e88ea1b40e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:18.348778 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fcc57f72-8f27-4f19-93e8-88e88ea1b40e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:18.349228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fcc57f72-8f27-4f19-93e8-88e88ea1b40e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:18.349986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fcc57f72-8f27-4f19-93e8-88e88ea1b40e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:18.351023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fcc57f72-8f27-4f19-93e8-88e88ea1b40e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:18.412289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fcc57f72-8f27-4f19-93e8-88e88ea1b40e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:18.420225 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fcc57f72-8f27-4f19-93e8-88e88ea1b40e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081819 May 10 21:29:18.420785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1508/2284] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:18 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:19.135094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ef52ee87-bbfa-49c3-9f10-75b6dfb139ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:19.135795 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ef52ee87-bbfa-49c3-9f10-75b6dfb139ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:19.142211 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ef52ee87-bbfa-49c3-9f10-75b6dfb139ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:19.142693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ef52ee87-bbfa-49c3-9f10-75b6dfb139ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:19.143503 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ef52ee87-bbfa-49c3-9f10-75b6dfb139ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:19.143946 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ef52ee87-bbfa-49c3-9f10-75b6dfb139ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:19.204258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ef52ee87-bbfa-49c3-9f10-75b6dfb139ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:19.213143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ef52ee87-bbfa-49c3-9f10-75b6dfb139ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:19.214647 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ef52ee87-bbfa-49c3-9f10-75b6dfb139ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:19.215818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ef52ee87-bbfa-49c3-9f10-75b6dfb139ab tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085375 May 10 21:29:19.216382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1509/2285] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:19 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:19.437771 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-702b3db1-2836-4a7f-93b0-c733baed2a81 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:19.438314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-702b3db1-2836-4a7f-93b0-c733baed2a81 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:19.444300 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-702b3db1-2836-4a7f-93b0-c733baed2a81 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:19.444758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-702b3db1-2836-4a7f-93b0-c733baed2a81 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:19.445525 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-702b3db1-2836-4a7f-93b0-c733baed2a81 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:19.445970 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-702b3db1-2836-4a7f-93b0-c733baed2a81 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:19.505022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-702b3db1-2836-4a7f-93b0-c733baed2a81 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:19.512400 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-702b3db1-2836-4a7f-93b0-c733baed2a81 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078556 May 10 21:29:19.512965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1510/2286] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:19 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:20.233771 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e6d99030-9a43-4439-a1d4-ce78520b6bb5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:20.234460 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e6d99030-9a43-4439-a1d4-ce78520b6bb5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:20.240785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e6d99030-9a43-4439-a1d4-ce78520b6bb5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:20.241872 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e6d99030-9a43-4439-a1d4-ce78520b6bb5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:20.242640 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e6d99030-9a43-4439-a1d4-ce78520b6bb5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:20.243085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e6d99030-9a43-4439-a1d4-ce78520b6bb5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:20.303862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e6d99030-9a43-4439-a1d4-ce78520b6bb5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:20.312371 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e6d99030-9a43-4439-a1d4-ce78520b6bb5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:20.313902 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e6d99030-9a43-4439-a1d4-ce78520b6bb5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:20.315040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e6d99030-9a43-4439-a1d4-ce78520b6bb5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085168 May 10 21:29:20.315640 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1511/2287] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:20 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:20.529408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9ae6fd31-caab-4993-98d8-516f23e6e176 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:20.529966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9ae6fd31-caab-4993-98d8-516f23e6e176 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:20.536074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ae6fd31-caab-4993-98d8-516f23e6e176 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:20.536544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ae6fd31-caab-4993-98d8-516f23e6e176 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:20.537311 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ae6fd31-caab-4993-98d8-516f23e6e176 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:20.537779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ae6fd31-caab-4993-98d8-516f23e6e176 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:20.600406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9ae6fd31-caab-4993-98d8-516f23e6e176 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:20.608127 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9ae6fd31-caab-4993-98d8-516f23e6e176 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082682 May 10 21:29:20.608700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1512/2288] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:20 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:21.334087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3ab49379-619e-427d-a45b-396bdcb80ee8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:21.335264 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3ab49379-619e-427d-a45b-396bdcb80ee8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:21.341815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ab49379-619e-427d-a45b-396bdcb80ee8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:21.342261 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ab49379-619e-427d-a45b-396bdcb80ee8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:21.343017 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ab49379-619e-427d-a45b-396bdcb80ee8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:21.343481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ab49379-619e-427d-a45b-396bdcb80ee8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:21.404855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3ab49379-619e-427d-a45b-396bdcb80ee8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:21.413550 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3ab49379-619e-427d-a45b-396bdcb80ee8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:21.415046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3ab49379-619e-427d-a45b-396bdcb80ee8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:21.416197 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3ab49379-619e-427d-a45b-396bdcb80ee8 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086270 May 10 21:29:21.416752 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1513/2289] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:21 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:21.625263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-73673cea-aab7-4826-a39e-3421e2b4022f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:21.625874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-73673cea-aab7-4826-a39e-3421e2b4022f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:21.632264 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-73673cea-aab7-4826-a39e-3421e2b4022f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:21.632715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-73673cea-aab7-4826-a39e-3421e2b4022f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:21.633472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-73673cea-aab7-4826-a39e-3421e2b4022f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:21.633910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-73673cea-aab7-4826-a39e-3421e2b4022f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:21.693177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-73673cea-aab7-4826-a39e-3421e2b4022f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:21.701199 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-73673cea-aab7-4826-a39e-3421e2b4022f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079773 May 10 21:29:21.701784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1514/2290] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:21 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:22.434024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9769c2eb-ca8f-4ef8-b8e5-15df8d3be19e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:22.434718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9769c2eb-ca8f-4ef8-b8e5-15df8d3be19e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:22.441985 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9769c2eb-ca8f-4ef8-b8e5-15df8d3be19e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:22.442427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9769c2eb-ca8f-4ef8-b8e5-15df8d3be19e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:22.443239 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9769c2eb-ca8f-4ef8-b8e5-15df8d3be19e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:22.443678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9769c2eb-ca8f-4ef8-b8e5-15df8d3be19e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:22.514719 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9769c2eb-ca8f-4ef8-b8e5-15df8d3be19e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:22.525797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9769c2eb-ca8f-4ef8-b8e5-15df8d3be19e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:22.527350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9769c2eb-ca8f-4ef8-b8e5-15df8d3be19e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:22.528539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9769c2eb-ca8f-4ef8-b8e5-15df8d3be19e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.098451 May 10 21:29:22.529111 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1515/2291] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:22 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:22.719615 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-af900919-2070-49a3-8aa0-fa7f5559f0bf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:22.720228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-af900919-2070-49a3-8aa0-fa7f5559f0bf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:22.727506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af900919-2070-49a3-8aa0-fa7f5559f0bf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:22.727960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af900919-2070-49a3-8aa0-fa7f5559f0bf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:22.728730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af900919-2070-49a3-8aa0-fa7f5559f0bf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:22.729169 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af900919-2070-49a3-8aa0-fa7f5559f0bf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:22.794577 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-af900919-2070-49a3-8aa0-fa7f5559f0bf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:22.802773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-af900919-2070-49a3-8aa0-fa7f5559f0bf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.087164 May 10 21:29:22.804214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1516/2292] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:22 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:23.548179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-09282827-9ae6-47fd-861f-c9c184b986ba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:23.548865 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-09282827-9ae6-47fd-861f-c9c184b986ba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:23.555586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-09282827-9ae6-47fd-861f-c9c184b986ba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:23.556037 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-09282827-9ae6-47fd-861f-c9c184b986ba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:23.556796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-09282827-9ae6-47fd-861f-c9c184b986ba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:23.557233 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-09282827-9ae6-47fd-861f-c9c184b986ba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:23.617959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-09282827-9ae6-47fd-861f-c9c184b986ba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:23.626355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-09282827-9ae6-47fd-861f-c9c184b986ba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:23.627905 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-09282827-9ae6-47fd-861f-c9c184b986ba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:23.629043 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-09282827-9ae6-47fd-861f-c9c184b986ba tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084789 May 10 21:29:23.629610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1517/2293] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:23 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:23.820427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d0f2c71b-fa23-4900-af70-fdb694f52ae5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:23.820961 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d0f2c71b-fa23-4900-af70-fdb694f52ae5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:23.826816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0f2c71b-fa23-4900-af70-fdb694f52ae5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:23.827300 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0f2c71b-fa23-4900-af70-fdb694f52ae5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:23.828090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0f2c71b-fa23-4900-af70-fdb694f52ae5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:23.828550 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0f2c71b-fa23-4900-af70-fdb694f52ae5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:23.888087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d0f2c71b-fa23-4900-af70-fdb694f52ae5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:23.895265 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d0f2c71b-fa23-4900-af70-fdb694f52ae5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078732 May 10 21:29:23.895821 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1518/2294] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:23 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:24.648412 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e0ddd765-c90d-4186-8df4-4b171a1d76a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:24.649219 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e0ddd765-c90d-4186-8df4-4b171a1d76a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:24.655720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e0ddd765-c90d-4186-8df4-4b171a1d76a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:24.656167 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e0ddd765-c90d-4186-8df4-4b171a1d76a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:24.657016 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e0ddd765-c90d-4186-8df4-4b171a1d76a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:24.657459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e0ddd765-c90d-4186-8df4-4b171a1d76a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:24.720638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e0ddd765-c90d-4186-8df4-4b171a1d76a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:24.730005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e0ddd765-c90d-4186-8df4-4b171a1d76a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:24.731539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e0ddd765-c90d-4186-8df4-4b171a1d76a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:24.732687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e0ddd765-c90d-4186-8df4-4b171a1d76a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.089254 May 10 21:29:24.733275 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1519/2295] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:24 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:24.911886 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-692e2fc2-8e4b-4061-9f0c-9992573f6413 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:24.912421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-692e2fc2-8e4b-4061-9f0c-9992573f6413 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:24.919326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-692e2fc2-8e4b-4061-9f0c-9992573f6413 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:24.919784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-692e2fc2-8e4b-4061-9f0c-9992573f6413 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:24.920561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-692e2fc2-8e4b-4061-9f0c-9992573f6413 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:24.921003 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-692e2fc2-8e4b-4061-9f0c-9992573f6413 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:24.984344 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-692e2fc2-8e4b-4061-9f0c-9992573f6413 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:24.991829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-692e2fc2-8e4b-4061-9f0c-9992573f6413 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083868 May 10 21:29:24.992403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1520/2296] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:24 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:25.751314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8a84ce51-6d53-450c-a2db-517e923b8958 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:25.751922 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8a84ce51-6d53-450c-a2db-517e923b8958 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:25.758967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8a84ce51-6d53-450c-a2db-517e923b8958 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:25.759590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8a84ce51-6d53-450c-a2db-517e923b8958 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:25.760259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8a84ce51-6d53-450c-a2db-517e923b8958 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:25.760702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8a84ce51-6d53-450c-a2db-517e923b8958 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:25.832961 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8a84ce51-6d53-450c-a2db-517e923b8958 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:25.843509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8a84ce51-6d53-450c-a2db-517e923b8958 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:25.845118 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8a84ce51-6d53-450c-a2db-517e923b8958 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:25.846604 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8a84ce51-6d53-450c-a2db-517e923b8958 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.099239 May 10 21:29:25.847202 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1521/2297] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:25 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:26.009193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5f15aed2-d7c0-489d-868a-5e8b608a8d4d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:26.009859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5f15aed2-d7c0-489d-868a-5e8b608a8d4d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:26.015912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f15aed2-d7c0-489d-868a-5e8b608a8d4d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:26.016366 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f15aed2-d7c0-489d-868a-5e8b608a8d4d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:26.017130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f15aed2-d7c0-489d-868a-5e8b608a8d4d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:26.017568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f15aed2-d7c0-489d-868a-5e8b608a8d4d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:26.077603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5f15aed2-d7c0-489d-868a-5e8b608a8d4d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:26.085416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5f15aed2-d7c0-489d-868a-5e8b608a8d4d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080351 May 10 21:29:26.089170 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1522/2298] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:26 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:26.866878 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-06c41537-28ea-4a75-9960-798bc509623d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:26.867602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-06c41537-28ea-4a75-9960-798bc509623d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:26.874642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-06c41537-28ea-4a75-9960-798bc509623d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:26.875094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-06c41537-28ea-4a75-9960-798bc509623d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:26.875884 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-06c41537-28ea-4a75-9960-798bc509623d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:26.876324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-06c41537-28ea-4a75-9960-798bc509623d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:26.939703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-06c41537-28ea-4a75-9960-798bc509623d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:26.948175 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-06c41537-28ea-4a75-9960-798bc509623d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:26.949668 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-06c41537-28ea-4a75-9960-798bc509623d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:26.950802 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-06c41537-28ea-4a75-9960-798bc509623d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.088779 May 10 21:29:26.951399 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1523/2299] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:26 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:27.104882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-689a715d-3248-4b46-891d-2ea1e44db2e0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:27.105496 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-689a715d-3248-4b46-891d-2ea1e44db2e0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:27.111492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-689a715d-3248-4b46-891d-2ea1e44db2e0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:27.111942 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-689a715d-3248-4b46-891d-2ea1e44db2e0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:27.112710 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-689a715d-3248-4b46-891d-2ea1e44db2e0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:27.113151 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-689a715d-3248-4b46-891d-2ea1e44db2e0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:27.177214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-689a715d-3248-4b46-891d-2ea1e44db2e0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:27.184862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-689a715d-3248-4b46-891d-2ea1e44db2e0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.084540 May 10 21:29:27.185427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1524/2300] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:27 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:27.969045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9b8a0543-ea69-424c-afe8-d4e94083f3ff tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:27.969744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9b8a0543-ea69-424c-afe8-d4e94083f3ff tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:27.977275 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9b8a0543-ea69-424c-afe8-d4e94083f3ff tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:27.977725 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9b8a0543-ea69-424c-afe8-d4e94083f3ff tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:27.978492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9b8a0543-ea69-424c-afe8-d4e94083f3ff tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:27.978929 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9b8a0543-ea69-424c-afe8-d4e94083f3ff tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:28.040578 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9b8a0543-ea69-424c-afe8-d4e94083f3ff tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:28.048727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9b8a0543-ea69-424c-afe8-d4e94083f3ff tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:28.050234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9b8a0543-ea69-424c-afe8-d4e94083f3ff tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:28.051406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9b8a0543-ea69-424c-afe8-d4e94083f3ff tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086293 May 10 21:29:28.051974 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1525/2301] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:27 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:28.201580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-60068e33-a377-4a34-9981-b00e5edb4ad2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:28.202194 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-60068e33-a377-4a34-9981-b00e5edb4ad2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:28.208413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-60068e33-a377-4a34-9981-b00e5edb4ad2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:28.208865 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-60068e33-a377-4a34-9981-b00e5edb4ad2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:28.209624 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-60068e33-a377-4a34-9981-b00e5edb4ad2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:28.210757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-60068e33-a377-4a34-9981-b00e5edb4ad2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:28.269317 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-60068e33-a377-4a34-9981-b00e5edb4ad2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:28.277454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-60068e33-a377-4a34-9981-b00e5edb4ad2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079597 May 10 21:29:28.278022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1526/2302] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:28 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:29.069254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6f5b2efb-3d65-48fc-b24c-9042d306b73b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:29.070198 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6f5b2efb-3d65-48fc-b24c-9042d306b73b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:29.076268 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6f5b2efb-3d65-48fc-b24c-9042d306b73b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:29.076717 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6f5b2efb-3d65-48fc-b24c-9042d306b73b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:29.077476 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6f5b2efb-3d65-48fc-b24c-9042d306b73b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:29.077944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6f5b2efb-3d65-48fc-b24c-9042d306b73b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:29.140237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6f5b2efb-3d65-48fc-b24c-9042d306b73b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:29.148858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6f5b2efb-3d65-48fc-b24c-9042d306b73b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:29.150375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6f5b2efb-3d65-48fc-b24c-9042d306b73b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:29.151541 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6f5b2efb-3d65-48fc-b24c-9042d306b73b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086267 May 10 21:29:29.152103 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1527/2303] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:29 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:29.294852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-48d2fcc4-4f28-4e73-a86a-fdfb61d1dfb9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:29.295504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-48d2fcc4-4f28-4e73-a86a-fdfb61d1dfb9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:29.301370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-48d2fcc4-4f28-4e73-a86a-fdfb61d1dfb9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:29.301824 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-48d2fcc4-4f28-4e73-a86a-fdfb61d1dfb9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:29.302590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-48d2fcc4-4f28-4e73-a86a-fdfb61d1dfb9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:29.303034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-48d2fcc4-4f28-4e73-a86a-fdfb61d1dfb9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:29.367725 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-48d2fcc4-4f28-4e73-a86a-fdfb61d1dfb9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:29.375112 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-48d2fcc4-4f28-4e73-a86a-fdfb61d1dfb9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.084002 May 10 21:29:29.375699 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1528/2304] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:29 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:30.170026 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b1db825a-c0e5-4dba-9872-d71d95c087e2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:30.170684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b1db825a-c0e5-4dba-9872-d71d95c087e2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:30.177115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b1db825a-c0e5-4dba-9872-d71d95c087e2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:30.177569 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b1db825a-c0e5-4dba-9872-d71d95c087e2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:30.178340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b1db825a-c0e5-4dba-9872-d71d95c087e2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:30.179108 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b1db825a-c0e5-4dba-9872-d71d95c087e2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:30.244536 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b1db825a-c0e5-4dba-9872-d71d95c087e2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:30.252950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b1db825a-c0e5-4dba-9872-d71d95c087e2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:30.254492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b1db825a-c0e5-4dba-9872-d71d95c087e2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:30.255698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b1db825a-c0e5-4dba-9872-d71d95c087e2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.089561 May 10 21:29:30.256307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1529/2305] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:30 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:30.392016 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-840e3e29-3fc6-4632-bf7e-22910ff364e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:30.392624 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-840e3e29-3fc6-4632-bf7e-22910ff364e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:30.398992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-840e3e29-3fc6-4632-bf7e-22910ff364e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:30.399450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-840e3e29-3fc6-4632-bf7e-22910ff364e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:30.400205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-840e3e29-3fc6-4632-bf7e-22910ff364e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:30.400640 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-840e3e29-3fc6-4632-bf7e-22910ff364e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:30.460798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-840e3e29-3fc6-4632-bf7e-22910ff364e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:30.468559 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-840e3e29-3fc6-4632-bf7e-22910ff364e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080370 May 10 21:29:30.469118 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1530/2306] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:30 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:31.274812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9f88683b-55d7-4336-b95a-53f298443c3b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:31.275511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9f88683b-55d7-4336-b95a-53f298443c3b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:31.281792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9f88683b-55d7-4336-b95a-53f298443c3b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:31.282233 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9f88683b-55d7-4336-b95a-53f298443c3b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:31.282995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9f88683b-55d7-4336-b95a-53f298443c3b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:31.283456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9f88683b-55d7-4336-b95a-53f298443c3b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:31.344372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9f88683b-55d7-4336-b95a-53f298443c3b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:31.352897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9f88683b-55d7-4336-b95a-53f298443c3b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:31.354390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9f88683b-55d7-4336-b95a-53f298443c3b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:31.355561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9f88683b-55d7-4336-b95a-53f298443c3b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085270 May 10 21:29:31.356115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1531/2307] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:31 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:31.485434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-743ea47e-de1d-4eed-b104-5a01ba75a7d4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:31.486077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-743ea47e-de1d-4eed-b104-5a01ba75a7d4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:31.492026 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-743ea47e-de1d-4eed-b104-5a01ba75a7d4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:31.492472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-743ea47e-de1d-4eed-b104-5a01ba75a7d4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:31.493226 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-743ea47e-de1d-4eed-b104-5a01ba75a7d4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:31.493664 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-743ea47e-de1d-4eed-b104-5a01ba75a7d4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:31.556006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-743ea47e-de1d-4eed-b104-5a01ba75a7d4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:31.563288 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-743ea47e-de1d-4eed-b104-5a01ba75a7d4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081518 May 10 21:29:31.563848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1532/2308] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:31 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:32.373781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-114df063-7ebb-49a0-aef3-5b50731490f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:32.374463 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-114df063-7ebb-49a0-aef3-5b50731490f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:32.380854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-114df063-7ebb-49a0-aef3-5b50731490f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:32.381316 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-114df063-7ebb-49a0-aef3-5b50731490f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:32.382834 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-114df063-7ebb-49a0-aef3-5b50731490f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:32.383307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-114df063-7ebb-49a0-aef3-5b50731490f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:32.443202 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-114df063-7ebb-49a0-aef3-5b50731490f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:32.452242 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-114df063-7ebb-49a0-aef3-5b50731490f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:32.453755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-114df063-7ebb-49a0-aef3-5b50731490f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:32.454898 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-114df063-7ebb-49a0-aef3-5b50731490f5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085157 May 10 21:29:32.455502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1533/2309] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:32 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:32.580450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5c719a0d-be09-4139-82bb-a7dbda7ad1c9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:32.581317 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5c719a0d-be09-4139-82bb-a7dbda7ad1c9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:32.587228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5c719a0d-be09-4139-82bb-a7dbda7ad1c9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:32.587685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5c719a0d-be09-4139-82bb-a7dbda7ad1c9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:32.588454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5c719a0d-be09-4139-82bb-a7dbda7ad1c9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:32.588896 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5c719a0d-be09-4139-82bb-a7dbda7ad1c9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:32.650076 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5c719a0d-be09-4139-82bb-a7dbda7ad1c9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:32.657414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5c719a0d-be09-4139-82bb-a7dbda7ad1c9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080605 May 10 21:29:32.657978 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1534/2310] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:32 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:33.473490 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ae4b9cd6-79ba-49a9-a5f8-7eb978886503 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:33.474184 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ae4b9cd6-79ba-49a9-a5f8-7eb978886503 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:33.481417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae4b9cd6-79ba-49a9-a5f8-7eb978886503 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:33.481867 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae4b9cd6-79ba-49a9-a5f8-7eb978886503 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:33.482633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae4b9cd6-79ba-49a9-a5f8-7eb978886503 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:33.483070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae4b9cd6-79ba-49a9-a5f8-7eb978886503 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:33.544386 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ae4b9cd6-79ba-49a9-a5f8-7eb978886503 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:33.552577 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ae4b9cd6-79ba-49a9-a5f8-7eb978886503 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:33.555310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ae4b9cd6-79ba-49a9-a5f8-7eb978886503 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:33.556483 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ae4b9cd6-79ba-49a9-a5f8-7eb978886503 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086906 May 10 21:29:33.557040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1535/2311] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:33 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:33.674816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-01c1c68f-bcc2-415b-a3dc-e3ad5af35429 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:33.675466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-01c1c68f-bcc2-415b-a3dc-e3ad5af35429 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:33.682090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01c1c68f-bcc2-415b-a3dc-e3ad5af35429 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:33.682540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01c1c68f-bcc2-415b-a3dc-e3ad5af35429 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:33.683336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01c1c68f-bcc2-415b-a3dc-e3ad5af35429 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:33.683777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01c1c68f-bcc2-415b-a3dc-e3ad5af35429 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:33.746247 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-01c1c68f-bcc2-415b-a3dc-e3ad5af35429 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:33.753587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-01c1c68f-bcc2-415b-a3dc-e3ad5af35429 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082544 May 10 21:29:33.754150 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1536/2312] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:33 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:34.574186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-05c88887-e255-4400-9b5b-37b827da7f1d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:34.574907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-05c88887-e255-4400-9b5b-37b827da7f1d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:34.581538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-05c88887-e255-4400-9b5b-37b827da7f1d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:34.581985 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-05c88887-e255-4400-9b5b-37b827da7f1d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:34.582745 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-05c88887-e255-4400-9b5b-37b827da7f1d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:34.583309 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-05c88887-e255-4400-9b5b-37b827da7f1d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:34.648891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-05c88887-e255-4400-9b5b-37b827da7f1d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:34.663705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-05c88887-e255-4400-9b5b-37b827da7f1d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:34.666803 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-05c88887-e255-4400-9b5b-37b827da7f1d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:34.668966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-05c88887-e255-4400-9b5b-37b827da7f1d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.098834 May 10 21:29:34.669539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1537/2313] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:34 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:34.770391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-079cac00-8faf-45f2-800b-70a0f5199b4d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:34.771027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-079cac00-8faf-45f2-800b-70a0f5199b4d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:34.777122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-079cac00-8faf-45f2-800b-70a0f5199b4d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:34.777576 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-079cac00-8faf-45f2-800b-70a0f5199b4d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:34.778346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-079cac00-8faf-45f2-800b-70a0f5199b4d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:34.778787 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-079cac00-8faf-45f2-800b-70a0f5199b4d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:34.838465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-079cac00-8faf-45f2-800b-70a0f5199b4d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:34.845795 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-079cac00-8faf-45f2-800b-70a0f5199b4d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079283 May 10 21:29:34.846366 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1538/2314] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:34 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:35.688231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-99ffb6b4-afe5-42dc-a992-2ba3717c9fe6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:35.688842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-99ffb6b4-afe5-42dc-a992-2ba3717c9fe6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:35.696062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-99ffb6b4-afe5-42dc-a992-2ba3717c9fe6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:35.696513 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-99ffb6b4-afe5-42dc-a992-2ba3717c9fe6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:35.697276 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-99ffb6b4-afe5-42dc-a992-2ba3717c9fe6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:35.697709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-99ffb6b4-afe5-42dc-a992-2ba3717c9fe6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:35.758587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-99ffb6b4-afe5-42dc-a992-2ba3717c9fe6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:35.766761 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-99ffb6b4-afe5-42dc-a992-2ba3717c9fe6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:35.768292 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-99ffb6b4-afe5-42dc-a992-2ba3717c9fe6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:35.769425 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-99ffb6b4-afe5-42dc-a992-2ba3717c9fe6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085193 May 10 21:29:35.769978 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1539/2315] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:35 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:35.862587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-06e27588-131a-4802-b9ce-b1121844bd6e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:35.863160 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-06e27588-131a-4802-b9ce-b1121844bd6e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:35.869172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-06e27588-131a-4802-b9ce-b1121844bd6e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:35.869627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-06e27588-131a-4802-b9ce-b1121844bd6e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:35.870397 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-06e27588-131a-4802-b9ce-b1121844bd6e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:35.870842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-06e27588-131a-4802-b9ce-b1121844bd6e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:35.933075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-06e27588-131a-4802-b9ce-b1121844bd6e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:35.940442 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-06e27588-131a-4802-b9ce-b1121844bd6e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081580 May 10 21:29:35.941017 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1540/2316] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:35 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:36.787870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c1e6fc32-87b9-4e2f-bff8-00db9b67cd6d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:36.789613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c1e6fc32-87b9-4e2f-bff8-00db9b67cd6d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:36.795579 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c1e6fc32-87b9-4e2f-bff8-00db9b67cd6d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:36.796033 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c1e6fc32-87b9-4e2f-bff8-00db9b67cd6d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:36.796796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c1e6fc32-87b9-4e2f-bff8-00db9b67cd6d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:36.797234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c1e6fc32-87b9-4e2f-bff8-00db9b67cd6d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:36.858546 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c1e6fc32-87b9-4e2f-bff8-00db9b67cd6d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:36.867100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c1e6fc32-87b9-4e2f-bff8-00db9b67cd6d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:36.868654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c1e6fc32-87b9-4e2f-bff8-00db9b67cd6d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:36.869783 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c1e6fc32-87b9-4e2f-bff8-00db9b67cd6d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085816 May 10 21:29:36.870338 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1541/2317] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:36 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:36.957777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-241ff867-b3fd-4814-8960-8ff9c1ac91df tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:36.965053 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-241ff867-b3fd-4814-8960-8ff9c1ac91df tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:36.965053 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-241ff867-b3fd-4814-8960-8ff9c1ac91df tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:36.965441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-241ff867-b3fd-4814-8960-8ff9c1ac91df tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:36.966216 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-241ff867-b3fd-4814-8960-8ff9c1ac91df tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:36.966664 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-241ff867-b3fd-4814-8960-8ff9c1ac91df tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:37.026155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-241ff867-b3fd-4814-8960-8ff9c1ac91df tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:37.033670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-241ff867-b3fd-4814-8960-8ff9c1ac91df tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079793 May 10 21:29:37.034231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1542/2318] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:36 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:37.888413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bfe4bbad-de55-419a-8f87-2828a21c6e42 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:37.889058 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bfe4bbad-de55-419a-8f87-2828a21c6e42 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:37.895337 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfe4bbad-de55-419a-8f87-2828a21c6e42 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:37.895785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfe4bbad-de55-419a-8f87-2828a21c6e42 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:37.896543 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfe4bbad-de55-419a-8f87-2828a21c6e42 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:37.896982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfe4bbad-de55-419a-8f87-2828a21c6e42 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:37.957537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bfe4bbad-de55-419a-8f87-2828a21c6e42 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:37.966668 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bfe4bbad-de55-419a-8f87-2828a21c6e42 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:37.968260 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bfe4bbad-de55-419a-8f87-2828a21c6e42 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:37.969415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bfe4bbad-de55-419a-8f87-2828a21c6e42 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085037 May 10 21:29:37.969991 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1543/2319] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:37 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:38.051182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-19f8fc8d-c7a1-47c8-b116-5a97a2a9c493 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:38.051806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-19f8fc8d-c7a1-47c8-b116-5a97a2a9c493 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:38.057832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-19f8fc8d-c7a1-47c8-b116-5a97a2a9c493 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:38.058298 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-19f8fc8d-c7a1-47c8-b116-5a97a2a9c493 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:38.059048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-19f8fc8d-c7a1-47c8-b116-5a97a2a9c493 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:38.059519 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-19f8fc8d-c7a1-47c8-b116-5a97a2a9c493 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:38.123242 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-19f8fc8d-c7a1-47c8-b116-5a97a2a9c493 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:38.130828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-19f8fc8d-c7a1-47c8-b116-5a97a2a9c493 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083497 May 10 21:29:38.131616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1544/2320] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:38 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:38.987648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7c3a3b8d-4a4e-4bc2-99b0-a0813127239e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:38.988402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7c3a3b8d-4a4e-4bc2-99b0-a0813127239e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:38.994550 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c3a3b8d-4a4e-4bc2-99b0-a0813127239e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:38.994992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c3a3b8d-4a4e-4bc2-99b0-a0813127239e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:38.995770 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c3a3b8d-4a4e-4bc2-99b0-a0813127239e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:38.996199 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c3a3b8d-4a4e-4bc2-99b0-a0813127239e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:39.058565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7c3a3b8d-4a4e-4bc2-99b0-a0813127239e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:39.066699 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7c3a3b8d-4a4e-4bc2-99b0-a0813127239e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:39.068223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7c3a3b8d-4a4e-4bc2-99b0-a0813127239e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:39.069393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7c3a3b8d-4a4e-4bc2-99b0-a0813127239e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085740 May 10 21:29:39.069941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1545/2321] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:38 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:39.148282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3bf7bd7e-b120-47e4-80d2-3d9785f66908 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:39.148888 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3bf7bd7e-b120-47e4-80d2-3d9785f66908 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:39.154939 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3bf7bd7e-b120-47e4-80d2-3d9785f66908 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:39.155420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3bf7bd7e-b120-47e4-80d2-3d9785f66908 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:39.156180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3bf7bd7e-b120-47e4-80d2-3d9785f66908 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:39.156611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3bf7bd7e-b120-47e4-80d2-3d9785f66908 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:39.218273 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3bf7bd7e-b120-47e4-80d2-3d9785f66908 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:39.225499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3bf7bd7e-b120-47e4-80d2-3d9785f66908 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081058 May 10 21:29:39.226053 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1546/2322] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:39 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:40.090546 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d174fdfc-ce31-47fe-8f3f-6e7eb11adbb6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:40.091210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d174fdfc-ce31-47fe-8f3f-6e7eb11adbb6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:40.097487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d174fdfc-ce31-47fe-8f3f-6e7eb11adbb6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:40.097943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d174fdfc-ce31-47fe-8f3f-6e7eb11adbb6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:40.098697 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d174fdfc-ce31-47fe-8f3f-6e7eb11adbb6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:40.099252 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d174fdfc-ce31-47fe-8f3f-6e7eb11adbb6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:40.159086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d174fdfc-ce31-47fe-8f3f-6e7eb11adbb6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:40.167423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d174fdfc-ce31-47fe-8f3f-6e7eb11adbb6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:40.168919 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d174fdfc-ce31-47fe-8f3f-6e7eb11adbb6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:40.170046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d174fdfc-ce31-47fe-8f3f-6e7eb11adbb6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083990 May 10 21:29:40.170604 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1547/2323] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:40 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:40.241959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bb892c27-4ddc-41b7-b55c-85575590d392 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:40.242562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bb892c27-4ddc-41b7-b55c-85575590d392 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:40.248441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bb892c27-4ddc-41b7-b55c-85575590d392 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:40.248889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bb892c27-4ddc-41b7-b55c-85575590d392 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:40.249636 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bb892c27-4ddc-41b7-b55c-85575590d392 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:40.250068 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bb892c27-4ddc-41b7-b55c-85575590d392 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:40.312200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bb892c27-4ddc-41b7-b55c-85575590d392 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:40.319467 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bb892c27-4ddc-41b7-b55c-85575590d392 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081070 May 10 21:29:40.320039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1548/2324] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:40 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:41.188032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b80fddfb-0e7f-46b7-85f5-8a27a11dd4c6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:41.188696 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b80fddfb-0e7f-46b7-85f5-8a27a11dd4c6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:41.195014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b80fddfb-0e7f-46b7-85f5-8a27a11dd4c6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:41.195491 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b80fddfb-0e7f-46b7-85f5-8a27a11dd4c6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:41.196253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b80fddfb-0e7f-46b7-85f5-8a27a11dd4c6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:41.196688 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b80fddfb-0e7f-46b7-85f5-8a27a11dd4c6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:41.258949 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b80fddfb-0e7f-46b7-85f5-8a27a11dd4c6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:41.267257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b80fddfb-0e7f-46b7-85f5-8a27a11dd4c6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:41.268759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b80fddfb-0e7f-46b7-85f5-8a27a11dd4c6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:41.269892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b80fddfb-0e7f-46b7-85f5-8a27a11dd4c6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085788 May 10 21:29:41.270447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1549/2325] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:41 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:41.336202 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-95ef671c-89d4-4a2c-82f3-639b59ee763c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:41.336807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-95ef671c-89d4-4a2c-82f3-639b59ee763c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:41.342542 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-95ef671c-89d4-4a2c-82f3-639b59ee763c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:41.343000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-95ef671c-89d4-4a2c-82f3-639b59ee763c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:41.343771 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-95ef671c-89d4-4a2c-82f3-639b59ee763c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:41.344205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-95ef671c-89d4-4a2c-82f3-639b59ee763c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:41.402863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-95ef671c-89d4-4a2c-82f3-639b59ee763c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:41.410143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-95ef671c-89d4-4a2c-82f3-639b59ee763c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.077518 May 10 21:29:41.410696 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1550/2326] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:41 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:42.288349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-989c99d9-53c3-484b-ba9e-c6369d385999 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:42.289032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-989c99d9-53c3-484b-ba9e-c6369d385999 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:42.295440 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-989c99d9-53c3-484b-ba9e-c6369d385999 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:42.295913 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-989c99d9-53c3-484b-ba9e-c6369d385999 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:42.296670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-989c99d9-53c3-484b-ba9e-c6369d385999 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:42.297102 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-989c99d9-53c3-484b-ba9e-c6369d385999 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:42.357537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-989c99d9-53c3-484b-ba9e-c6369d385999 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:42.365582 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-989c99d9-53c3-484b-ba9e-c6369d385999 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:42.367070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-989c99d9-53c3-484b-ba9e-c6369d385999 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:42.368227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-989c99d9-53c3-484b-ba9e-c6369d385999 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083794 May 10 21:29:42.368787 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1551/2327] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:42 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:42.427430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b85cc789-6b1f-41a7-a9c3-4e6c285fd345 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:42.428042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b85cc789-6b1f-41a7-a9c3-4e6c285fd345 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:42.434760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b85cc789-6b1f-41a7-a9c3-4e6c285fd345 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:42.435237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b85cc789-6b1f-41a7-a9c3-4e6c285fd345 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:42.436005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b85cc789-6b1f-41a7-a9c3-4e6c285fd345 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:42.436439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b85cc789-6b1f-41a7-a9c3-4e6c285fd345 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:42.499593 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b85cc789-6b1f-41a7-a9c3-4e6c285fd345 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:42.506943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b85cc789-6b1f-41a7-a9c3-4e6c285fd345 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083239 May 10 21:29:42.507533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1552/2328] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:42 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:43.386559 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b154ba6b-8b61-47c0-af8b-8f7a25adf66f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:43.387271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b154ba6b-8b61-47c0-af8b-8f7a25adf66f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:43.393460 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b154ba6b-8b61-47c0-af8b-8f7a25adf66f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:43.393907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b154ba6b-8b61-47c0-af8b-8f7a25adf66f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:43.394659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b154ba6b-8b61-47c0-af8b-8f7a25adf66f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:43.395135 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b154ba6b-8b61-47c0-af8b-8f7a25adf66f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:43.458059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b154ba6b-8b61-47c0-af8b-8f7a25adf66f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:43.466365 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b154ba6b-8b61-47c0-af8b-8f7a25adf66f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:43.467909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b154ba6b-8b61-47c0-af8b-8f7a25adf66f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:43.469042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b154ba6b-8b61-47c0-af8b-8f7a25adf66f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087127 May 10 21:29:43.469601 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1553/2329] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:43 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:43.523077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f33a24ba-7807-44d9-8d3d-3ce061d72336 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:43.523699 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f33a24ba-7807-44d9-8d3d-3ce061d72336 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:43.529553 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f33a24ba-7807-44d9-8d3d-3ce061d72336 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:43.529998 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f33a24ba-7807-44d9-8d3d-3ce061d72336 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:43.530746 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f33a24ba-7807-44d9-8d3d-3ce061d72336 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:43.531207 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f33a24ba-7807-44d9-8d3d-3ce061d72336 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:43.590943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f33a24ba-7807-44d9-8d3d-3ce061d72336 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:43.598244 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f33a24ba-7807-44d9-8d3d-3ce061d72336 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078592 May 10 21:29:43.598797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1554/2330] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:43 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:44.487051 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e9d23341-d70e-47b3-9f9b-b48adb348a5f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:44.487792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e9d23341-d70e-47b3-9f9b-b48adb348a5f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:44.493541 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e9d23341-d70e-47b3-9f9b-b48adb348a5f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:44.494022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e9d23341-d70e-47b3-9f9b-b48adb348a5f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:44.495592 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e9d23341-d70e-47b3-9f9b-b48adb348a5f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:44.495592 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e9d23341-d70e-47b3-9f9b-b48adb348a5f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:44.782073 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e9d23341-d70e-47b3-9f9b-b48adb348a5f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:44.782073 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e9d23341-d70e-47b3-9f9b-b48adb348a5f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:44.783907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e9d23341-d70e-47b3-9f9b-b48adb348a5f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:44.783907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e9d23341-d70e-47b3-9f9b-b48adb348a5f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084134 May 10 21:29:44.783907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1555/2331] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:44 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:44.783907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c71f307c-9b79-487c-93c4-b6f1d5572a07 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:44.784310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c71f307c-9b79-487c-93c4-b6f1d5572a07 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:44.784310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c71f307c-9b79-487c-93c4-b6f1d5572a07 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:44.784310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c71f307c-9b79-487c-93c4-b6f1d5572a07 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:44.784310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c71f307c-9b79-487c-93c4-b6f1d5572a07 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:44.784661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c71f307c-9b79-487c-93c4-b6f1d5572a07 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:44.784661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c71f307c-9b79-487c-93c4-b6f1d5572a07 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:44.784661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c71f307c-9b79-487c-93c4-b6f1d5572a07 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083539 May 10 21:29:44.784661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1556/2332] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:44 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:45.586859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d6e1d7c2-e145-4ee0-8036-2d1b3adc3c8c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:45.587604 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d6e1d7c2-e145-4ee0-8036-2d1b3adc3c8c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:45.594086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6e1d7c2-e145-4ee0-8036-2d1b3adc3c8c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:45.594548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6e1d7c2-e145-4ee0-8036-2d1b3adc3c8c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:45.595336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6e1d7c2-e145-4ee0-8036-2d1b3adc3c8c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:45.595800 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6e1d7c2-e145-4ee0-8036-2d1b3adc3c8c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:45.657533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d6e1d7c2-e145-4ee0-8036-2d1b3adc3c8c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:45.665660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d6e1d7c2-e145-4ee0-8036-2d1b3adc3c8c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:45.667677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d6e1d7c2-e145-4ee0-8036-2d1b3adc3c8c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:45.668802 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d6e1d7c2-e145-4ee0-8036-2d1b3adc3c8c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085915 May 10 21:29:45.669359 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1557/2333] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:45 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:29:45.713261 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-635c4b83-6b74-4bf7-b6d1-f38a6e168847 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:45.713865 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-635c4b83-6b74-4bf7-b6d1-f38a6e168847 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:45.719531 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-635c4b83-6b74-4bf7-b6d1-f38a6e168847 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:45.719975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-635c4b83-6b74-4bf7-b6d1-f38a6e168847 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:45.720723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-635c4b83-6b74-4bf7-b6d1-f38a6e168847 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:45.721157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-635c4b83-6b74-4bf7-b6d1-f38a6e168847 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:45.779878 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-635c4b83-6b74-4bf7-b6d1-f38a6e168847 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:45.787115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-635c4b83-6b74-4bf7-b6d1-f38a6e168847 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.077892 May 10 21:29:45.787694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1558/2334] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:45 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:46.686412 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5ab7b582-d0e0-4ad1-b5e4-88fcdbe23581 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:46.687028 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5ab7b582-d0e0-4ad1-b5e4-88fcdbe23581 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:46.693411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ab7b582-d0e0-4ad1-b5e4-88fcdbe23581 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:46.693861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ab7b582-d0e0-4ad1-b5e4-88fcdbe23581 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:46.694620 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ab7b582-d0e0-4ad1-b5e4-88fcdbe23581 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:46.695058 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ab7b582-d0e0-4ad1-b5e4-88fcdbe23581 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:46.759262 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5ab7b582-d0e0-4ad1-b5e4-88fcdbe23581 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:46.770950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5ab7b582-d0e0-4ad1-b5e4-88fcdbe23581 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:46.772483 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5ab7b582-d0e0-4ad1-b5e4-88fcdbe23581 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:46.774382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5ab7b582-d0e0-4ad1-b5e4-88fcdbe23581 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.091551 May 10 21:29:46.775441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1559/2335] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:46 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:46.804253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-44b2efb9-f758-4ee4-bdf9-73a8832bbd47 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:46.804866 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-44b2efb9-f758-4ee4-bdf9-73a8832bbd47 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:46.811446 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44b2efb9-f758-4ee4-bdf9-73a8832bbd47 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:46.811898 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44b2efb9-f758-4ee4-bdf9-73a8832bbd47 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:46.812660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44b2efb9-f758-4ee4-bdf9-73a8832bbd47 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:46.813099 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44b2efb9-f758-4ee4-bdf9-73a8832bbd47 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:46.876939 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-44b2efb9-f758-4ee4-bdf9-73a8832bbd47 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:46.884296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-44b2efb9-f758-4ee4-bdf9-73a8832bbd47 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083681 May 10 21:29:46.885084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1560/2336] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:46 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:47.792021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5a2005a7-7a4f-4014-bafb-8849761a8191 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:47.792664 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5a2005a7-7a4f-4014-bafb-8849761a8191 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:47.798964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5a2005a7-7a4f-4014-bafb-8849761a8191 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:47.799448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5a2005a7-7a4f-4014-bafb-8849761a8191 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:47.800204 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5a2005a7-7a4f-4014-bafb-8849761a8191 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:47.800637 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5a2005a7-7a4f-4014-bafb-8849761a8191 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:47.861300 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5a2005a7-7a4f-4014-bafb-8849761a8191 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:47.869552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5a2005a7-7a4f-4014-bafb-8849761a8191 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:47.871044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5a2005a7-7a4f-4014-bafb-8849761a8191 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:47.872203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5a2005a7-7a4f-4014-bafb-8849761a8191 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084311 May 10 21:29:47.872761 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1561/2337] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:47 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:47.901207 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1187650b-5443-4dec-a842-55c2d0f5ebf4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:47.901808 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1187650b-5443-4dec-a842-55c2d0f5ebf4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:47.907548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1187650b-5443-4dec-a842-55c2d0f5ebf4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:47.907994 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1187650b-5443-4dec-a842-55c2d0f5ebf4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:47.908754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1187650b-5443-4dec-a842-55c2d0f5ebf4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:47.909190 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1187650b-5443-4dec-a842-55c2d0f5ebf4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:47.969696 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1187650b-5443-4dec-a842-55c2d0f5ebf4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:47.981363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1187650b-5443-4dec-a842-55c2d0f5ebf4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.084259 May 10 21:29:47.981918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1562/2338] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:47 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:48.889943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a44a08dd-9c55-40e8-93e7-562892fdc3d4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:48.890585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a44a08dd-9c55-40e8-93e7-562892fdc3d4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:48.896921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a44a08dd-9c55-40e8-93e7-562892fdc3d4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:48.897375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a44a08dd-9c55-40e8-93e7-562892fdc3d4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:48.898142 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a44a08dd-9c55-40e8-93e7-562892fdc3d4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:48.898585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a44a08dd-9c55-40e8-93e7-562892fdc3d4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:48.959565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a44a08dd-9c55-40e8-93e7-562892fdc3d4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:48.968178 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a44a08dd-9c55-40e8-93e7-562892fdc3d4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:48.969687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a44a08dd-9c55-40e8-93e7-562892fdc3d4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:48.970828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a44a08dd-9c55-40e8-93e7-562892fdc3d4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084896 May 10 21:29:48.971427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1563/2339] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:48 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:48.997317 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ad39ebde-5ee5-435b-b6b7-3efe58ac8c26 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:48.997923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ad39ebde-5ee5-435b-b6b7-3efe58ac8c26 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:49.003578 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ad39ebde-5ee5-435b-b6b7-3efe58ac8c26 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:49.004023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ad39ebde-5ee5-435b-b6b7-3efe58ac8c26 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:49.004781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ad39ebde-5ee5-435b-b6b7-3efe58ac8c26 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:49.005217 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ad39ebde-5ee5-435b-b6b7-3efe58ac8c26 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:49.068186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ad39ebde-5ee5-435b-b6b7-3efe58ac8c26 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:49.076133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ad39ebde-5ee5-435b-b6b7-3efe58ac8c26 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082489 May 10 21:29:49.076696 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1564/2340] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:48 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:49.989359 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-10fda5a9-5757-4f20-8743-fb72cb109c38 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:49.990039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-10fda5a9-5757-4f20-8743-fb72cb109c38 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:49.996982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-10fda5a9-5757-4f20-8743-fb72cb109c38 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:49.997437 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-10fda5a9-5757-4f20-8743-fb72cb109c38 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:49.998192 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-10fda5a9-5757-4f20-8743-fb72cb109c38 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:49.998627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-10fda5a9-5757-4f20-8743-fb72cb109c38 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:50.061395 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-10fda5a9-5757-4f20-8743-fb72cb109c38 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:50.069597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-10fda5a9-5757-4f20-8743-fb72cb109c38 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:50.071100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-10fda5a9-5757-4f20-8743-fb72cb109c38 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:50.072744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-10fda5a9-5757-4f20-8743-fb72cb109c38 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086868 May 10 21:29:50.073312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1565/2341] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:49 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:50.093272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-62b68f6c-f815-40fa-a555-42a73e1fd7a2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:50.093880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-62b68f6c-f815-40fa-a555-42a73e1fd7a2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:50.099720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-62b68f6c-f815-40fa-a555-42a73e1fd7a2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:50.100172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-62b68f6c-f815-40fa-a555-42a73e1fd7a2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:50.100934 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-62b68f6c-f815-40fa-a555-42a73e1fd7a2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:50.101368 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-62b68f6c-f815-40fa-a555-42a73e1fd7a2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:50.162369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-62b68f6c-f815-40fa-a555-42a73e1fd7a2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:50.170669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-62b68f6c-f815-40fa-a555-42a73e1fd7a2 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080955 May 10 21:29:50.171262 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1566/2342] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:50 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:51.091281 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1f78f2a4-55fb-4488-90ea-74d0c271cf6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:51.091945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1f78f2a4-55fb-4488-90ea-74d0c271cf6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:51.098553 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1f78f2a4-55fb-4488-90ea-74d0c271cf6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:51.098993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1f78f2a4-55fb-4488-90ea-74d0c271cf6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:51.099777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1f78f2a4-55fb-4488-90ea-74d0c271cf6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:51.100214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1f78f2a4-55fb-4488-90ea-74d0c271cf6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:51.167772 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1f78f2a4-55fb-4488-90ea-74d0c271cf6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:51.175911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1f78f2a4-55fb-4488-90ea-74d0c271cf6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:51.177424 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1f78f2a4-55fb-4488-90ea-74d0c271cf6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:51.178536 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1f78f2a4-55fb-4488-90ea-74d0c271cf6f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.091368 May 10 21:29:51.179093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1567/2343] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:51 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:51.187664 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9f3d15ff-ec0e-4018-b5fc-e4e22f7819e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:51.188266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9f3d15ff-ec0e-4018-b5fc-e4e22f7819e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:51.193873 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9f3d15ff-ec0e-4018-b5fc-e4e22f7819e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:51.194318 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9f3d15ff-ec0e-4018-b5fc-e4e22f7819e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:51.195068 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9f3d15ff-ec0e-4018-b5fc-e4e22f7819e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:51.195529 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9f3d15ff-ec0e-4018-b5fc-e4e22f7819e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:51.257712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9f3d15ff-ec0e-4018-b5fc-e4e22f7819e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:51.265638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9f3d15ff-ec0e-4018-b5fc-e4e22f7819e8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081415 May 10 21:29:51.266193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1568/2344] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:51 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:29:52.197523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c7b72371-fb53-44f8-b531-e20ad78937cf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:52.198155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c7b72371-fb53-44f8-b531-e20ad78937cf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:52.204493 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c7b72371-fb53-44f8-b531-e20ad78937cf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:52.204937 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c7b72371-fb53-44f8-b531-e20ad78937cf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:52.205688 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c7b72371-fb53-44f8-b531-e20ad78937cf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:52.206363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c7b72371-fb53-44f8-b531-e20ad78937cf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:52.266721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c7b72371-fb53-44f8-b531-e20ad78937cf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:52.274810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c7b72371-fb53-44f8-b531-e20ad78937cf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:52.277367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c7b72371-fb53-44f8-b531-e20ad78937cf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:52.278511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c7b72371-fb53-44f8-b531-e20ad78937cf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085436 May 10 21:29:52.279101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1569/2345] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:52 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:52.283500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f8f4c248-d302-4842-9b25-b454049c160d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:52.284099 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f8f4c248-d302-4842-9b25-b454049c160d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:52.289892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f8f4c248-d302-4842-9b25-b454049c160d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:52.290343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f8f4c248-d302-4842-9b25-b454049c160d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:52.291197 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f8f4c248-d302-4842-9b25-b454049c160d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:52.291641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f8f4c248-d302-4842-9b25-b454049c160d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:52.353251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f8f4c248-d302-4842-9b25-b454049c160d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:52.360593 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f8f4c248-d302-4842-9b25-b454049c160d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080554 May 10 21:29:52.361164 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1570/2346] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:52 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:53.296905 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-43741424-00db-488d-83aa-57d848d0daea tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:53.297619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-43741424-00db-488d-83aa-57d848d0daea tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:53.303880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-43741424-00db-488d-83aa-57d848d0daea tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:53.304328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-43741424-00db-488d-83aa-57d848d0daea tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:53.305092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-43741424-00db-488d-83aa-57d848d0daea tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:53.305541 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-43741424-00db-488d-83aa-57d848d0daea tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:53.365978 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-43741424-00db-488d-83aa-57d848d0daea tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:53.376578 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-43741424-00db-488d-83aa-57d848d0daea tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:53.378074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-43741424-00db-488d-83aa-57d848d0daea tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:53.379240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-43741424-00db-488d-83aa-57d848d0daea tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086321 May 10 21:29:53.379791 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1571/2347] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:53 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:53.384076 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5e4714a5-c62b-4a7e-81d2-3fd0d82a1a88 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:53.385369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5e4714a5-c62b-4a7e-81d2-3fd0d82a1a88 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:53.391274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5e4714a5-c62b-4a7e-81d2-3fd0d82a1a88 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:53.391724 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5e4714a5-c62b-4a7e-81d2-3fd0d82a1a88 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:53.392494 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5e4714a5-c62b-4a7e-81d2-3fd0d82a1a88 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:53.392935 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5e4714a5-c62b-4a7e-81d2-3fd0d82a1a88 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:53.455487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5e4714a5-c62b-4a7e-81d2-3fd0d82a1a88 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:53.463026 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5e4714a5-c62b-4a7e-81d2-3fd0d82a1a88 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082311 May 10 21:29:53.463698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1572/2348] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:53 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:54.397867 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-58ebba9a-5d0f-4dab-bb89-a48e7c1018d2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:54.398547 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-58ebba9a-5d0f-4dab-bb89-a48e7c1018d2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:54.405997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-58ebba9a-5d0f-4dab-bb89-a48e7c1018d2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:54.406449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-58ebba9a-5d0f-4dab-bb89-a48e7c1018d2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:54.407249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-58ebba9a-5d0f-4dab-bb89-a48e7c1018d2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:54.407683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-58ebba9a-5d0f-4dab-bb89-a48e7c1018d2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:54.469254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-58ebba9a-5d0f-4dab-bb89-a48e7c1018d2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:54.477650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-58ebba9a-5d0f-4dab-bb89-a48e7c1018d2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:54.479781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-58ebba9a-5d0f-4dab-bb89-a48e7c1018d2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:54.480941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-58ebba9a-5d0f-4dab-bb89-a48e7c1018d2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086999 May 10 21:29:54.481506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1573/2349] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:54 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:54.485825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e60cf03c-2e7d-4210-965e-83f77f37776a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:54.490778 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e60cf03c-2e7d-4210-965e-83f77f37776a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:54.492207 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e60cf03c-2e7d-4210-965e-83f77f37776a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:54.492660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e60cf03c-2e7d-4210-965e-83f77f37776a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:54.493419 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e60cf03c-2e7d-4210-965e-83f77f37776a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:54.493908 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e60cf03c-2e7d-4210-965e-83f77f37776a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:54.555189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e60cf03c-2e7d-4210-965e-83f77f37776a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:54.563044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e60cf03c-2e7d-4210-965e-83f77f37776a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080606 May 10 21:29:54.563734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1574/2350] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:54 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:55.499551 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e430bf65-d5d3-4f51-ba04-55272573bf73 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:55.500254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e430bf65-d5d3-4f51-ba04-55272573bf73 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:55.506475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e430bf65-d5d3-4f51-ba04-55272573bf73 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:55.506927 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e430bf65-d5d3-4f51-ba04-55272573bf73 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:55.507712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e430bf65-d5d3-4f51-ba04-55272573bf73 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:55.508151 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e430bf65-d5d3-4f51-ba04-55272573bf73 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:55.569075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e430bf65-d5d3-4f51-ba04-55272573bf73 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:55.577456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e430bf65-d5d3-4f51-ba04-55272573bf73 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:55.578964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e430bf65-d5d3-4f51-ba04-55272573bf73 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:55.580145 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e430bf65-d5d3-4f51-ba04-55272573bf73 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084685 May 10 21:29:55.580695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1575/2351] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:55 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:55.585241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5983c80a-4922-42d1-848a-0805bc42979d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:55.585841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5983c80a-4922-42d1-848a-0805bc42979d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:55.592482 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5983c80a-4922-42d1-848a-0805bc42979d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:55.592938 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5983c80a-4922-42d1-848a-0805bc42979d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:55.593711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5983c80a-4922-42d1-848a-0805bc42979d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:55.594185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5983c80a-4922-42d1-848a-0805bc42979d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:55.657798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5983c80a-4922-42d1-848a-0805bc42979d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:55.665082 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5983c80a-4922-42d1-848a-0805bc42979d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083214 May 10 21:29:55.665800 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1576/2352] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:55 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:56.598341 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ae12f4ce-eed4-4dfc-9252-6ed625f6caf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:56.598975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ae12f4ce-eed4-4dfc-9252-6ed625f6caf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:56.605912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae12f4ce-eed4-4dfc-9252-6ed625f6caf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:56.606363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae12f4ce-eed4-4dfc-9252-6ed625f6caf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:56.607159 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae12f4ce-eed4-4dfc-9252-6ed625f6caf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:56.607594 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae12f4ce-eed4-4dfc-9252-6ed625f6caf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:56.668613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ae12f4ce-eed4-4dfc-9252-6ed625f6caf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:56.677026 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ae12f4ce-eed4-4dfc-9252-6ed625f6caf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:56.678550 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ae12f4ce-eed4-4dfc-9252-6ed625f6caf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:56.679729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ae12f4ce-eed4-4dfc-9252-6ed625f6caf1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085267 May 10 21:29:56.680291 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1577/2353] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:56 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:56.684727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-293bb13e-2f5f-4b57-91ea-5f11a8b7aee6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:56.685371 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-293bb13e-2f5f-4b57-91ea-5f11a8b7aee6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:56.691009 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-293bb13e-2f5f-4b57-91ea-5f11a8b7aee6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:56.691499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-293bb13e-2f5f-4b57-91ea-5f11a8b7aee6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:56.692267 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-293bb13e-2f5f-4b57-91ea-5f11a8b7aee6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:56.692708 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-293bb13e-2f5f-4b57-91ea-5f11a8b7aee6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:56.755421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-293bb13e-2f5f-4b57-91ea-5f11a8b7aee6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:56.763341 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-293bb13e-2f5f-4b57-91ea-5f11a8b7aee6 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082079 May 10 21:29:56.763912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1578/2354] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:56 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:57.698125 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1c27a2ba-cb59-476e-a960-bb33acba44ef tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:57.698722 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1c27a2ba-cb59-476e-a960-bb33acba44ef tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:57.705150 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1c27a2ba-cb59-476e-a960-bb33acba44ef tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:57.705604 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1c27a2ba-cb59-476e-a960-bb33acba44ef tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:57.706625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1c27a2ba-cb59-476e-a960-bb33acba44ef tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:57.707062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1c27a2ba-cb59-476e-a960-bb33acba44ef tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:57.768257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1c27a2ba-cb59-476e-a960-bb33acba44ef tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:57.776458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1c27a2ba-cb59-476e-a960-bb33acba44ef tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:57.777956 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1c27a2ba-cb59-476e-a960-bb33acba44ef tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:57.779093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1c27a2ba-cb59-476e-a960-bb33acba44ef tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085459 May 10 21:29:57.779673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1579/2355] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:57 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:57.783952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f7c14f1c-7ee2-4400-be81-c2c57ca42560 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:57.784554 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f7c14f1c-7ee2-4400-be81-c2c57ca42560 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:57.790383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f7c14f1c-7ee2-4400-be81-c2c57ca42560 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:57.791214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f7c14f1c-7ee2-4400-be81-c2c57ca42560 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:57.791889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f7c14f1c-7ee2-4400-be81-c2c57ca42560 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:57.792325 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f7c14f1c-7ee2-4400-be81-c2c57ca42560 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:57.855738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f7c14f1c-7ee2-4400-be81-c2c57ca42560 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:57.863839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f7c14f1c-7ee2-4400-be81-c2c57ca42560 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083200 May 10 21:29:57.864419 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1580/2356] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:57 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:58.797789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cddbbd16-65ce-4612-b89f-28a41f704f92 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:58.798420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cddbbd16-65ce-4612-b89f-28a41f704f92 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:58.804818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cddbbd16-65ce-4612-b89f-28a41f704f92 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:58.805272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cddbbd16-65ce-4612-b89f-28a41f704f92 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:58.806040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cddbbd16-65ce-4612-b89f-28a41f704f92 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:58.807006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cddbbd16-65ce-4612-b89f-28a41f704f92 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:58.871980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cddbbd16-65ce-4612-b89f-28a41f704f92 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:58.880508 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cddbbd16-65ce-4612-b89f-28a41f704f92 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:58.882599 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cddbbd16-65ce-4612-b89f-28a41f704f92 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:58.883205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cddbbd16-65ce-4612-b89f-28a41f704f92 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.089368 May 10 21:29:58.883760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1581/2357] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:58 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:58.888257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4bbfb820-a9ae-4a43-af7e-3d0869d1e5e3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:58.888859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4bbfb820-a9ae-4a43-af7e-3d0869d1e5e3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:58.894962 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4bbfb820-a9ae-4a43-af7e-3d0869d1e5e3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:58.895458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4bbfb820-a9ae-4a43-af7e-3d0869d1e5e3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:58.896230 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4bbfb820-a9ae-4a43-af7e-3d0869d1e5e3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:58.896673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4bbfb820-a9ae-4a43-af7e-3d0869d1e5e3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:58.957949 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4bbfb820-a9ae-4a43-af7e-3d0869d1e5e3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:58.965410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4bbfb820-a9ae-4a43-af7e-3d0869d1e5e3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080699 May 10 21:29:58.965984 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1582/2358] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:58 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:29:59.900949 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8c272c14-08a6-4d72-b037-fdbaaf775aaa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:59.901583 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8c272c14-08a6-4d72-b037-fdbaaf775aaa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:59.907883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c272c14-08a6-4d72-b037-fdbaaf775aaa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:59.908328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c272c14-08a6-4d72-b037-fdbaaf775aaa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:59.909089 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c272c14-08a6-4d72-b037-fdbaaf775aaa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:59.909520 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c272c14-08a6-4d72-b037-fdbaaf775aaa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:59.970819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8c272c14-08a6-4d72-b037-fdbaaf775aaa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:59.980086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8c272c14-08a6-4d72-b037-fdbaaf775aaa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:59.981629 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8c272c14-08a6-4d72-b037-fdbaaf775aaa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:29:59.982757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8c272c14-08a6-4d72-b037-fdbaaf775aaa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085906 May 10 21:29:59.983352 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1583/2359] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:29:59 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:29:59.987638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-69d60585-df9a-4b0e-8e61-65a16c52e1ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:29:59.988237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-69d60585-df9a-4b0e-8e61-65a16c52e1ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:29:59.994427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-69d60585-df9a-4b0e-8e61-65a16c52e1ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:59.994890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-69d60585-df9a-4b0e-8e61-65a16c52e1ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:29:59.995702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-69d60585-df9a-4b0e-8e61-65a16c52e1ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:29:59.996146 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-69d60585-df9a-4b0e-8e61-65a16c52e1ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:00.058988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-69d60585-df9a-4b0e-8e61-65a16c52e1ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:00.066368 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-69d60585-df9a-4b0e-8e61-65a16c52e1ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082090 May 10 21:30:00.066925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1584/2360] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:29:59 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:01.001158 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-db91db94-d98c-46e3-84c0-20b292b6e25d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:01.001888 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-db91db94-d98c-46e3-84c0-20b292b6e25d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:01.008077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-db91db94-d98c-46e3-84c0-20b292b6e25d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:01.008529 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-db91db94-d98c-46e3-84c0-20b292b6e25d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:01.009289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-db91db94-d98c-46e3-84c0-20b292b6e25d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:01.010621 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-db91db94-d98c-46e3-84c0-20b292b6e25d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:01.070332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-db91db94-d98c-46e3-84c0-20b292b6e25d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:01.079407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-db91db94-d98c-46e3-84c0-20b292b6e25d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:01.080914 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-db91db94-d98c-46e3-84c0-20b292b6e25d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:01.082314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-db91db94-d98c-46e3-84c0-20b292b6e25d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085281 May 10 21:30:01.082872 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1585/2361] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:00 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:01.087164 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-264c8c21-5ffc-4786-b2e1-8abbbe39e194 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:01.090075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-264c8c21-5ffc-4786-b2e1-8abbbe39e194 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:01.093974 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-264c8c21-5ffc-4786-b2e1-8abbbe39e194 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:01.094431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-264c8c21-5ffc-4786-b2e1-8abbbe39e194 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:01.095226 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-264c8c21-5ffc-4786-b2e1-8abbbe39e194 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:01.095669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-264c8c21-5ffc-4786-b2e1-8abbbe39e194 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:01.156512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-264c8c21-5ffc-4786-b2e1-8abbbe39e194 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:01.163753 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-264c8c21-5ffc-4786-b2e1-8abbbe39e194 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079927 May 10 21:30:01.164334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1586/2362] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:01 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:02.099623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d69a4bc1-0d07-4cdb-a607-6b37cdb0730c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:02.100290 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d69a4bc1-0d07-4cdb-a607-6b37cdb0730c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:02.106590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d69a4bc1-0d07-4cdb-a607-6b37cdb0730c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:02.107035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d69a4bc1-0d07-4cdb-a607-6b37cdb0730c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:02.107819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d69a4bc1-0d07-4cdb-a607-6b37cdb0730c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:02.108252 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d69a4bc1-0d07-4cdb-a607-6b37cdb0730c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:02.169514 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d69a4bc1-0d07-4cdb-a607-6b37cdb0730c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:02.179707 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d69a4bc1-0d07-4cdb-a607-6b37cdb0730c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:02.181955 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d69a4bc1-0d07-4cdb-a607-6b37cdb0730c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:02.183073 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d69a4bc1-0d07-4cdb-a607-6b37cdb0730c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087395 May 10 21:30:02.183658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1587/2363] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:02 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:02.188696 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-50b442fd-53c7-4ffa-8579-3f559a4c4804 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:02.189801 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-50b442fd-53c7-4ffa-8579-3f559a4c4804 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:02.196692 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50b442fd-53c7-4ffa-8579-3f559a4c4804 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:02.198265 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50b442fd-53c7-4ffa-8579-3f559a4c4804 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:02.199040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50b442fd-53c7-4ffa-8579-3f559a4c4804 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:02.199504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50b442fd-53c7-4ffa-8579-3f559a4c4804 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:02.262330 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-50b442fd-53c7-4ffa-8579-3f559a4c4804 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:02.269738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-50b442fd-53c7-4ffa-8579-3f559a4c4804 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.085157 May 10 21:30:02.270295 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1588/2364] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:02 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:03.200323 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f8608239-ebe3-4a4b-97c9-0f434ec3bd5e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:03.201002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f8608239-ebe3-4a4b-97c9-0f434ec3bd5e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:03.207674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f8608239-ebe3-4a4b-97c9-0f434ec3bd5e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:03.208131 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f8608239-ebe3-4a4b-97c9-0f434ec3bd5e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:03.208897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f8608239-ebe3-4a4b-97c9-0f434ec3bd5e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:03.209341 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f8608239-ebe3-4a4b-97c9-0f434ec3bd5e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:03.269689 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f8608239-ebe3-4a4b-97c9-0f434ec3bd5e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:03.278580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f8608239-ebe3-4a4b-97c9-0f434ec3bd5e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:03.280132 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f8608239-ebe3-4a4b-97c9-0f434ec3bd5e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:03.281304 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f8608239-ebe3-4a4b-97c9-0f434ec3bd5e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085025 May 10 21:30:03.281853 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1589/2365] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:03 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:03.286195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c06f9c0c-f167-42e9-8e45-d6a163679796 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:03.286805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c06f9c0c-f167-42e9-8e45-d6a163679796 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:03.293639 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c06f9c0c-f167-42e9-8e45-d6a163679796 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:03.294091 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c06f9c0c-f167-42e9-8e45-d6a163679796 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:03.294857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c06f9c0c-f167-42e9-8e45-d6a163679796 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:03.295356 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c06f9c0c-f167-42e9-8e45-d6a163679796 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:03.354812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c06f9c0c-f167-42e9-8e45-d6a163679796 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:03.362317 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c06f9c0c-f167-42e9-8e45-d6a163679796 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079524 May 10 21:30:03.362885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1590/2366] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:03 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:04.299840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8c8255ea-f27c-4763-90e1-4b116de78ccc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:04.300509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8c8255ea-f27c-4763-90e1-4b116de78ccc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:04.306957 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c8255ea-f27c-4763-90e1-4b116de78ccc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:04.307452 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c8255ea-f27c-4763-90e1-4b116de78ccc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:04.308213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c8255ea-f27c-4763-90e1-4b116de78ccc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:04.308650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c8255ea-f27c-4763-90e1-4b116de78ccc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:04.370020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8c8255ea-f27c-4763-90e1-4b116de78ccc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:04.378381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8c8255ea-f27c-4763-90e1-4b116de78ccc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:04.379920 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8c8255ea-f27c-4763-90e1-4b116de78ccc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:04.381118 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8c8255ea-f27c-4763-90e1-4b116de78ccc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085294 May 10 21:30:04.381689 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1591/2367] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:04 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:04.387002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5ea89d68-7516-48ef-93fa-967109bbc9b4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:04.387639 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5ea89d68-7516-48ef-93fa-967109bbc9b4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:04.393332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ea89d68-7516-48ef-93fa-967109bbc9b4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:04.393782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ea89d68-7516-48ef-93fa-967109bbc9b4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:04.394541 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ea89d68-7516-48ef-93fa-967109bbc9b4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:04.394978 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ea89d68-7516-48ef-93fa-967109bbc9b4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:04.458447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5ea89d68-7516-48ef-93fa-967109bbc9b4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:04.467819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5ea89d68-7516-48ef-93fa-967109bbc9b4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.085185 May 10 21:30:04.468395 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1592/2368] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:04 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:05.399645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-80a08353-81d9-47b9-affe-e21dc3f85bf0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:05.400879 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-80a08353-81d9-47b9-affe-e21dc3f85bf0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:05.407264 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-80a08353-81d9-47b9-affe-e21dc3f85bf0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:05.407720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-80a08353-81d9-47b9-affe-e21dc3f85bf0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:05.408480 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-80a08353-81d9-47b9-affe-e21dc3f85bf0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:05.408917 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-80a08353-81d9-47b9-affe-e21dc3f85bf0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:05.469525 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-80a08353-81d9-47b9-affe-e21dc3f85bf0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:05.477783 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-80a08353-81d9-47b9-affe-e21dc3f85bf0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:05.480084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-80a08353-81d9-47b9-affe-e21dc3f85bf0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:05.481237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-80a08353-81d9-47b9-affe-e21dc3f85bf0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085473 May 10 21:30:05.481799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1593/2369] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:05 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:05.487872 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5e42df08-54ec-478a-8dfe-5954464ffb86 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:05.488476 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5e42df08-54ec-478a-8dfe-5954464ffb86 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:05.494463 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5e42df08-54ec-478a-8dfe-5954464ffb86 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:05.494906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5e42df08-54ec-478a-8dfe-5954464ffb86 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:05.495694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5e42df08-54ec-478a-8dfe-5954464ffb86 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:05.496125 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5e42df08-54ec-478a-8dfe-5954464ffb86 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:05.563040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5e42df08-54ec-478a-8dfe-5954464ffb86 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:05.570428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5e42df08-54ec-478a-8dfe-5954464ffb86 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.087708 May 10 21:30:05.570992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1594/2370] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:05 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:06.500554 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9db6e5b7-77ca-4276-88fd-3fb2e2b7d1b1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:06.501660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9db6e5b7-77ca-4276-88fd-3fb2e2b7d1b1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:06.510250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9db6e5b7-77ca-4276-88fd-3fb2e2b7d1b1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:06.510749 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9db6e5b7-77ca-4276-88fd-3fb2e2b7d1b1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:06.511519 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9db6e5b7-77ca-4276-88fd-3fb2e2b7d1b1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:06.511962 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9db6e5b7-77ca-4276-88fd-3fb2e2b7d1b1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:06.576956 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9db6e5b7-77ca-4276-88fd-3fb2e2b7d1b1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:06.585467 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9db6e5b7-77ca-4276-88fd-3fb2e2b7d1b1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:06.586967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9db6e5b7-77ca-4276-88fd-3fb2e2b7d1b1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:06.588605 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9db6e5b7-77ca-4276-88fd-3fb2e2b7d1b1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.092562 May 10 21:30:06.589166 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1595/2371] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:06 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:06.593461 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0896779d-a8fc-4670-9dc0-9ed9b04932ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:06.594062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0896779d-a8fc-4670-9dc0-9ed9b04932ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:06.600226 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0896779d-a8fc-4670-9dc0-9ed9b04932ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:06.600680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0896779d-a8fc-4670-9dc0-9ed9b04932ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:06.601476 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0896779d-a8fc-4670-9dc0-9ed9b04932ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:06.601919 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0896779d-a8fc-4670-9dc0-9ed9b04932ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:06.667036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0896779d-a8fc-4670-9dc0-9ed9b04932ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:06.674389 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0896779d-a8fc-4670-9dc0-9ed9b04932ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.084295 May 10 21:30:06.674959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1596/2372] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:06 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:07.605712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b1f8644b-b325-47ee-accf-2eb9b774a106 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:07.606394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b1f8644b-b325-47ee-accf-2eb9b774a106 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:07.612788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b1f8644b-b325-47ee-accf-2eb9b774a106 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:07.613250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b1f8644b-b325-47ee-accf-2eb9b774a106 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:07.614024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b1f8644b-b325-47ee-accf-2eb9b774a106 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:07.614466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b1f8644b-b325-47ee-accf-2eb9b774a106 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:07.674436 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b1f8644b-b325-47ee-accf-2eb9b774a106 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:07.683507 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b1f8644b-b325-47ee-accf-2eb9b774a106 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:07.685067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b1f8644b-b325-47ee-accf-2eb9b774a106 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:07.686217 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b1f8644b-b325-47ee-accf-2eb9b774a106 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084512 May 10 21:30:07.686884 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1597/2373] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:07 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:07.691357 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2dea4e4c-3afd-4bb4-9b01-83cdcf8af8a5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:07.691969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2dea4e4c-3afd-4bb4-9b01-83cdcf8af8a5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:07.698487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2dea4e4c-3afd-4bb4-9b01-83cdcf8af8a5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:07.698943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2dea4e4c-3afd-4bb4-9b01-83cdcf8af8a5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:07.699789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2dea4e4c-3afd-4bb4-9b01-83cdcf8af8a5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:07.700234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2dea4e4c-3afd-4bb4-9b01-83cdcf8af8a5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:07.760838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2dea4e4c-3afd-4bb4-9b01-83cdcf8af8a5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:07.768045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2dea4e4c-3afd-4bb4-9b01-83cdcf8af8a5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080178 May 10 21:30:07.768612 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1598/2374] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:07 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:30:08.704693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-542960fb-43bc-4339-82c3-f1186f4c531a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:08.705304 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-542960fb-43bc-4339-82c3-f1186f4c531a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:08.711969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-542960fb-43bc-4339-82c3-f1186f4c531a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:08.712417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-542960fb-43bc-4339-82c3-f1186f4c531a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:08.713171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-542960fb-43bc-4339-82c3-f1186f4c531a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:08.713610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-542960fb-43bc-4339-82c3-f1186f4c531a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:08.775546 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-542960fb-43bc-4339-82c3-f1186f4c531a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:08.784801 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-542960fb-43bc-4339-82c3-f1186f4c531a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:08.786291 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-542960fb-43bc-4339-82c3-f1186f4c531a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:08.787451 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-542960fb-43bc-4339-82c3-f1186f4c531a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086600 May 10 21:30:08.788001 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1599/2375] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:08 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:08.792863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3f81fe7b-b1a0-43cf-a6c1-cd633a030725 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:08.793023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3f81fe7b-b1a0-43cf-a6c1-cd633a030725 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:08.798783 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3f81fe7b-b1a0-43cf-a6c1-cd633a030725 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:08.799278 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3f81fe7b-b1a0-43cf-a6c1-cd633a030725 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:08.800104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3f81fe7b-b1a0-43cf-a6c1-cd633a030725 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:08.800546 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3f81fe7b-b1a0-43cf-a6c1-cd633a030725 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:08.862943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3f81fe7b-b1a0-43cf-a6c1-cd633a030725 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:08.870219 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3f81fe7b-b1a0-43cf-a6c1-cd633a030725 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081301 May 10 21:30:08.870934 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1600/2376] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:08 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:09.805589 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-65cdb598-c487-4db6-a15e-5ecdad52681e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:09.806229 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-65cdb598-c487-4db6-a15e-5ecdad52681e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:09.812639 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65cdb598-c487-4db6-a15e-5ecdad52681e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:09.813086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65cdb598-c487-4db6-a15e-5ecdad52681e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:09.813836 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65cdb598-c487-4db6-a15e-5ecdad52681e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:09.814270 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65cdb598-c487-4db6-a15e-5ecdad52681e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:09.882486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-65cdb598-c487-4db6-a15e-5ecdad52681e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:09.891258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-65cdb598-c487-4db6-a15e-5ecdad52681e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:09.892788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-65cdb598-c487-4db6-a15e-5ecdad52681e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:09.894214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-65cdb598-c487-4db6-a15e-5ecdad52681e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.092396 May 10 21:30:09.894983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1601/2377] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:09 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:09.899573 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-522b4532-3ad8-4f52-bba8-869766ffffe8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:09.900173 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-522b4532-3ad8-4f52-bba8-869766ffffe8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:09.907664 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-522b4532-3ad8-4f52-bba8-869766ffffe8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:09.908945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-522b4532-3ad8-4f52-bba8-869766ffffe8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:09.909949 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-522b4532-3ad8-4f52-bba8-869766ffffe8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:09.910708 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-522b4532-3ad8-4f52-bba8-869766ffffe8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:09.984581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-522b4532-3ad8-4f52-bba8-869766ffffe8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:09.992208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-522b4532-3ad8-4f52-bba8-869766ffffe8 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.096114 May 10 21:30:09.993038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1602/2378] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:09 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:10.913856 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-173dc60e-c24b-4a80-89c1-92a006b7982f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:10.914494 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-173dc60e-c24b-4a80-89c1-92a006b7982f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:10.922819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-173dc60e-c24b-4a80-89c1-92a006b7982f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:10.923306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-173dc60e-c24b-4a80-89c1-92a006b7982f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:10.924076 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-173dc60e-c24b-4a80-89c1-92a006b7982f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:10.924516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-173dc60e-c24b-4a80-89c1-92a006b7982f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:10.986556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-173dc60e-c24b-4a80-89c1-92a006b7982f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:10.994791 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-173dc60e-c24b-4a80-89c1-92a006b7982f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:10.998397 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-173dc60e-c24b-4a80-89c1-92a006b7982f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:10.999611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-173dc60e-c24b-4a80-89c1-92a006b7982f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.089818 May 10 21:30:11.000173 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1603/2379] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:10 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:11.015748 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e2cd927a-e9dc-4e39-b220-4000b3c91216 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:11.016355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e2cd927a-e9dc-4e39-b220-4000b3c91216 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:11.022028 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e2cd927a-e9dc-4e39-b220-4000b3c91216 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:11.022487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e2cd927a-e9dc-4e39-b220-4000b3c91216 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:11.023279 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e2cd927a-e9dc-4e39-b220-4000b3c91216 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:11.023717 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e2cd927a-e9dc-4e39-b220-4000b3c91216 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:11.087614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e2cd927a-e9dc-4e39-b220-4000b3c91216 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:11.095024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e2cd927a-e9dc-4e39-b220-4000b3c91216 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082828 May 10 21:30:11.095623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1604/2380] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:11 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:30:12.018271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8dd0bbd6-9948-42c2-9bf4-31d267877cc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:12.018912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8dd0bbd6-9948-42c2-9bf4-31d267877cc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:12.025186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8dd0bbd6-9948-42c2-9bf4-31d267877cc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:12.025634 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8dd0bbd6-9948-42c2-9bf4-31d267877cc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:12.026394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8dd0bbd6-9948-42c2-9bf4-31d267877cc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:12.027032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8dd0bbd6-9948-42c2-9bf4-31d267877cc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:12.087475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8dd0bbd6-9948-42c2-9bf4-31d267877cc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:12.130377 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8dd0bbd6-9948-42c2-9bf4-31d267877cc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:12.130377 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8dd0bbd6-9948-42c2-9bf4-31d267877cc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:12.130377 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8dd0bbd6-9948-42c2-9bf4-31d267877cc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085793 May 10 21:30:12.131272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1605/2381] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:12 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:12.131272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-99172529-9fab-4d40-87a1-83010a667f31 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:12.131272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-99172529-9fab-4d40-87a1-83010a667f31 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:12.131272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-99172529-9fab-4d40-87a1-83010a667f31 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:12.131272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-99172529-9fab-4d40-87a1-83010a667f31 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:12.131683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-99172529-9fab-4d40-87a1-83010a667f31 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:12.131683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-99172529-9fab-4d40-87a1-83010a667f31 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:12.186051 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-99172529-9fab-4d40-87a1-83010a667f31 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:12.194086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-99172529-9fab-4d40-87a1-83010a667f31 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.085225 May 10 21:30:12.194658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1606/2382] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:12 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:13.126585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9fddaa8a-09f0-474b-ad45-3f48061216f0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:13.127247 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9fddaa8a-09f0-474b-ad45-3f48061216f0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:13.133524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9fddaa8a-09f0-474b-ad45-3f48061216f0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:13.133968 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9fddaa8a-09f0-474b-ad45-3f48061216f0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:13.134723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9fddaa8a-09f0-474b-ad45-3f48061216f0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:13.135180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9fddaa8a-09f0-474b-ad45-3f48061216f0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:13.195087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9fddaa8a-09f0-474b-ad45-3f48061216f0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:13.203631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9fddaa8a-09f0-474b-ad45-3f48061216f0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:13.205133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9fddaa8a-09f0-474b-ad45-3f48061216f0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:13.206364 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9fddaa8a-09f0-474b-ad45-3f48061216f0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083680 May 10 21:30:13.207230 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1607/2383] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:13 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:13.211676 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c9a598fc-1cd0-4dcc-ad80-9eb50b98448e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:13.212275 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c9a598fc-1cd0-4dcc-ad80-9eb50b98448e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:13.218262 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9a598fc-1cd0-4dcc-ad80-9eb50b98448e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:13.218720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9a598fc-1cd0-4dcc-ad80-9eb50b98448e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:13.219524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9a598fc-1cd0-4dcc-ad80-9eb50b98448e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:13.219967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9a598fc-1cd0-4dcc-ad80-9eb50b98448e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:13.281997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c9a598fc-1cd0-4dcc-ad80-9eb50b98448e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:13.289285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c9a598fc-1cd0-4dcc-ad80-9eb50b98448e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081078 May 10 21:30:13.289852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1608/2384] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:13 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:14.224792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1bc89f41-93aa-48dd-b118-852aecbddc25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:14.225464 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1bc89f41-93aa-48dd-b118-852aecbddc25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:14.231900 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1bc89f41-93aa-48dd-b118-852aecbddc25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:14.232356 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1bc89f41-93aa-48dd-b118-852aecbddc25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:14.233123 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1bc89f41-93aa-48dd-b118-852aecbddc25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:14.233564 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1bc89f41-93aa-48dd-b118-852aecbddc25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:14.318019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1bc89f41-93aa-48dd-b118-852aecbddc25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:14.326801 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1bc89f41-93aa-48dd-b118-852aecbddc25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:14.328327 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1bc89f41-93aa-48dd-b118-852aecbddc25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:14.329468 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1bc89f41-93aa-48dd-b118-852aecbddc25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.108740 May 10 21:30:14.330031 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1609/2385] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:14 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:14.334593 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c3757919-3791-4f37-9839-2ba7f5e803a4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:14.335223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c3757919-3791-4f37-9839-2ba7f5e803a4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:14.340916 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c3757919-3791-4f37-9839-2ba7f5e803a4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:14.341364 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c3757919-3791-4f37-9839-2ba7f5e803a4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:14.342129 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c3757919-3791-4f37-9839-2ba7f5e803a4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:14.342562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c3757919-3791-4f37-9839-2ba7f5e803a4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:14.405417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c3757919-3791-4f37-9839-2ba7f5e803a4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:14.412656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c3757919-3791-4f37-9839-2ba7f5e803a4 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081698 May 10 21:30:14.413218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1610/2386] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:14 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:15.348039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9d0280b2-3838-49e3-9505-a5266fd66f4a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:15.348683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9d0280b2-3838-49e3-9505-a5266fd66f4a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:15.355752 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9d0280b2-3838-49e3-9505-a5266fd66f4a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:15.356210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9d0280b2-3838-49e3-9505-a5266fd66f4a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:15.356982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9d0280b2-3838-49e3-9505-a5266fd66f4a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:15.357453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9d0280b2-3838-49e3-9505-a5266fd66f4a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:15.420129 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9d0280b2-3838-49e3-9505-a5266fd66f4a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:15.428356 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9d0280b2-3838-49e3-9505-a5266fd66f4a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:15.429865 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9d0280b2-3838-49e3-9505-a5266fd66f4a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:15.431001 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9d0280b2-3838-49e3-9505-a5266fd66f4a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086909 May 10 21:30:15.431589 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1611/2387] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:15 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:15.436614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-aa442011-e530-42de-bf72-60df3d4e1bca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:15.437218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-aa442011-e530-42de-bf72-60df3d4e1bca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:15.442759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aa442011-e530-42de-bf72-60df3d4e1bca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:15.443245 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aa442011-e530-42de-bf72-60df3d4e1bca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:15.444016 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aa442011-e530-42de-bf72-60df3d4e1bca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:15.444456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aa442011-e530-42de-bf72-60df3d4e1bca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:15.507387 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-aa442011-e530-42de-bf72-60df3d4e1bca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:15.515868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-aa442011-e530-42de-bf72-60df3d4e1bca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083350 May 10 21:30:15.516432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1612/2388] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:15 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:16.449643 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-950f9a58-eb94-4772-b401-918f3d00513c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:16.450335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-950f9a58-eb94-4772-b401-918f3d00513c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:16.457016 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-950f9a58-eb94-4772-b401-918f3d00513c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:16.457466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-950f9a58-eb94-4772-b401-918f3d00513c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:16.458225 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-950f9a58-eb94-4772-b401-918f3d00513c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:16.458668 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-950f9a58-eb94-4772-b401-918f3d00513c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:16.518990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-950f9a58-eb94-4772-b401-918f3d00513c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:16.527481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-950f9a58-eb94-4772-b401-918f3d00513c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:16.529014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-950f9a58-eb94-4772-b401-918f3d00513c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:16.530144 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-950f9a58-eb94-4772-b401-918f3d00513c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085192 May 10 21:30:16.530695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1613/2389] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:16 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:16.534933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-807fbbf9-f2c8-4d5d-b478-bf7b954fb162 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:16.535550 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-807fbbf9-f2c8-4d5d-b478-bf7b954fb162 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:16.541009 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-807fbbf9-f2c8-4d5d-b478-bf7b954fb162 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:16.541466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-807fbbf9-f2c8-4d5d-b478-bf7b954fb162 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:16.542202 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-807fbbf9-f2c8-4d5d-b478-bf7b954fb162 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:16.542865 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-807fbbf9-f2c8-4d5d-b478-bf7b954fb162 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:16.601793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-807fbbf9-f2c8-4d5d-b478-bf7b954fb162 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:16.609379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-807fbbf9-f2c8-4d5d-b478-bf7b954fb162 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.077723 May 10 21:30:16.609946 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1614/2390] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:16 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:17.549657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-389801f6-350e-427f-b060-23d34d0ce421 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:17.550287 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-389801f6-350e-427f-b060-23d34d0ce421 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:17.556879 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-389801f6-350e-427f-b060-23d34d0ce421 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:17.557329 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-389801f6-350e-427f-b060-23d34d0ce421 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:17.558790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-389801f6-350e-427f-b060-23d34d0ce421 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:17.559342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-389801f6-350e-427f-b060-23d34d0ce421 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:17.624454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-389801f6-350e-427f-b060-23d34d0ce421 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:17.632980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-389801f6-350e-427f-b060-23d34d0ce421 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:17.634481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-389801f6-350e-427f-b060-23d34d0ce421 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:17.635646 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-389801f6-350e-427f-b060-23d34d0ce421 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.090340 May 10 21:30:17.637343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1615/2391] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:17 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:17.641592 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ed89020a-fe44-4e60-b8c5-a6562e124097 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:17.642197 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ed89020a-fe44-4e60-b8c5-a6562e124097 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:17.647758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed89020a-fe44-4e60-b8c5-a6562e124097 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:17.648209 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed89020a-fe44-4e60-b8c5-a6562e124097 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:17.648967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed89020a-fe44-4e60-b8c5-a6562e124097 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:17.649437 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed89020a-fe44-4e60-b8c5-a6562e124097 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:17.716067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ed89020a-fe44-4e60-b8c5-a6562e124097 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:17.723444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ed89020a-fe44-4e60-b8c5-a6562e124097 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.085225 May 10 21:30:17.724009 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1616/2392] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:17 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:18.654647 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f201e3ec-ca13-4c37-b98c-1dd57b93bdcc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:18.655295 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f201e3ec-ca13-4c37-b98c-1dd57b93bdcc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:18.661599 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f201e3ec-ca13-4c37-b98c-1dd57b93bdcc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:18.662044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f201e3ec-ca13-4c37-b98c-1dd57b93bdcc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:18.662796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f201e3ec-ca13-4c37-b98c-1dd57b93bdcc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:18.663267 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f201e3ec-ca13-4c37-b98c-1dd57b93bdcc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:18.724316 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f201e3ec-ca13-4c37-b98c-1dd57b93bdcc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:18.733760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f201e3ec-ca13-4c37-b98c-1dd57b93bdcc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:18.735329 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f201e3ec-ca13-4c37-b98c-1dd57b93bdcc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:18.736488 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f201e3ec-ca13-4c37-b98c-1dd57b93bdcc tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086533 May 10 21:30:18.737058 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1617/2393] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:18 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:18.741442 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-144d9432-cb97-4cbb-9aef-e07b56bcd578 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:18.742044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-144d9432-cb97-4cbb-9aef-e07b56bcd578 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:18.747919 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-144d9432-cb97-4cbb-9aef-e07b56bcd578 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:18.748371 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-144d9432-cb97-4cbb-9aef-e07b56bcd578 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:18.749132 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-144d9432-cb97-4cbb-9aef-e07b56bcd578 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:18.749570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-144d9432-cb97-4cbb-9aef-e07b56bcd578 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:18.809215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-144d9432-cb97-4cbb-9aef-e07b56bcd578 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:18.816410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-144d9432-cb97-4cbb-9aef-e07b56bcd578 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078434 May 10 21:30:18.816971 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1618/2394] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:18 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:19.754403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d60859a2-8eca-432b-b190-78a68622ecf0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:19.755046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d60859a2-8eca-432b-b190-78a68622ecf0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:19.762269 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d60859a2-8eca-432b-b190-78a68622ecf0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:19.762720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d60859a2-8eca-432b-b190-78a68622ecf0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:19.763523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d60859a2-8eca-432b-b190-78a68622ecf0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:19.763960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d60859a2-8eca-432b-b190-78a68622ecf0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:19.826163 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d60859a2-8eca-432b-b190-78a68622ecf0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:19.834768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d60859a2-8eca-432b-b190-78a68622ecf0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:19.836296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d60859a2-8eca-432b-b190-78a68622ecf0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:19.837434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d60859a2-8eca-432b-b190-78a68622ecf0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087009 May 10 21:30:19.837992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1619/2395] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:19 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:19.842375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a0151f79-ba41-4172-a0af-8620afb052d5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:19.842973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a0151f79-ba41-4172-a0af-8620afb052d5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:19.848961 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0151f79-ba41-4172-a0af-8620afb052d5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:19.849405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0151f79-ba41-4172-a0af-8620afb052d5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:19.850161 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0151f79-ba41-4172-a0af-8620afb052d5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:19.850597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0151f79-ba41-4172-a0af-8620afb052d5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:19.913626 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a0151f79-ba41-4172-a0af-8620afb052d5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:19.921608 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a0151f79-ba41-4172-a0af-8620afb052d5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082692 May 10 21:30:19.922171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1620/2396] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:19 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:20.856158 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1df3c591-6371-46c6-a099-9e9767c0bc8d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:20.856848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1df3c591-6371-46c6-a099-9e9767c0bc8d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:20.863400 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1df3c591-6371-46c6-a099-9e9767c0bc8d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:20.863797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1df3c591-6371-46c6-a099-9e9767c0bc8d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:20.864560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1df3c591-6371-46c6-a099-9e9767c0bc8d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:20.864991 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1df3c591-6371-46c6-a099-9e9767c0bc8d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:20.927164 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1df3c591-6371-46c6-a099-9e9767c0bc8d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:20.936750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1df3c591-6371-46c6-a099-9e9767c0bc8d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:20.938254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1df3c591-6371-46c6-a099-9e9767c0bc8d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:20.939420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1df3c591-6371-46c6-a099-9e9767c0bc8d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.088047 May 10 21:30:20.939973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1621/2397] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:20 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:20.944299 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-809a60e2-7f05-46c6-80c7-59dc31e30a83 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:20.944899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-809a60e2-7f05-46c6-80c7-59dc31e30a83 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:20.950910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-809a60e2-7f05-46c6-80c7-59dc31e30a83 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:20.951405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-809a60e2-7f05-46c6-80c7-59dc31e30a83 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:20.952185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-809a60e2-7f05-46c6-80c7-59dc31e30a83 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:20.952630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-809a60e2-7f05-46c6-80c7-59dc31e30a83 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:21.012685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-809a60e2-7f05-46c6-80c7-59dc31e30a83 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:21.020038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-809a60e2-7f05-46c6-80c7-59dc31e30a83 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079110 May 10 21:30:21.020602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1622/2398] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:20 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:21.957754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-81f9e87c-a8be-44f1-9ae6-33c224bad81f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:21.958367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-81f9e87c-a8be-44f1-9ae6-33c224bad81f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:21.964986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-81f9e87c-a8be-44f1-9ae6-33c224bad81f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:21.965478 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-81f9e87c-a8be-44f1-9ae6-33c224bad81f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:21.966242 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-81f9e87c-a8be-44f1-9ae6-33c224bad81f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:21.966679 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-81f9e87c-a8be-44f1-9ae6-33c224bad81f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:22.026966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-81f9e87c-a8be-44f1-9ae6-33c224bad81f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:22.035410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-81f9e87c-a8be-44f1-9ae6-33c224bad81f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:22.036919 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-81f9e87c-a8be-44f1-9ae6-33c224bad81f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:22.038048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-81f9e87c-a8be-44f1-9ae6-33c224bad81f tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084599 May 10 21:30:22.038606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1623/2399] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:21 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:22.043502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a3da6009-a323-41fb-b207-5f7d7f46ffe0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:22.044105 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a3da6009-a323-41fb-b207-5f7d7f46ffe0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:22.049673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a3da6009-a323-41fb-b207-5f7d7f46ffe0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:22.050120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a3da6009-a323-41fb-b207-5f7d7f46ffe0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:22.050880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a3da6009-a323-41fb-b207-5f7d7f46ffe0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:22.051347 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a3da6009-a323-41fb-b207-5f7d7f46ffe0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:22.113517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a3da6009-a323-41fb-b207-5f7d7f46ffe0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:22.121529 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a3da6009-a323-41fb-b207-5f7d7f46ffe0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081988 May 10 21:30:22.122093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1624/2400] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:22 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:23.056462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8ddf9f3a-a7e6-44a2-8f79-d998c4cf883a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:23.057083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8ddf9f3a-a7e6-44a2-8f79-d998c4cf883a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:23.064298 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ddf9f3a-a7e6-44a2-8f79-d998c4cf883a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:23.064819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ddf9f3a-a7e6-44a2-8f79-d998c4cf883a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:23.065583 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ddf9f3a-a7e6-44a2-8f79-d998c4cf883a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:23.066021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ddf9f3a-a7e6-44a2-8f79-d998c4cf883a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:23.127602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8ddf9f3a-a7e6-44a2-8f79-d998c4cf883a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:23.136558 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8ddf9f3a-a7e6-44a2-8f79-d998c4cf883a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:23.138090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8ddf9f3a-a7e6-44a2-8f79-d998c4cf883a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:23.139261 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8ddf9f3a-a7e6-44a2-8f79-d998c4cf883a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086771 May 10 21:30:23.139832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1625/2401] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:23 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:23.144193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-17e52ff3-666b-4bc1-9be1-8127c4322903 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:23.144796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-17e52ff3-666b-4bc1-9be1-8127c4322903 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:23.150430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17e52ff3-666b-4bc1-9be1-8127c4322903 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:23.150910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17e52ff3-666b-4bc1-9be1-8127c4322903 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:23.152292 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17e52ff3-666b-4bc1-9be1-8127c4322903 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:23.152866 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17e52ff3-666b-4bc1-9be1-8127c4322903 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:23.216590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-17e52ff3-666b-4bc1-9be1-8127c4322903 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:23.228258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-17e52ff3-666b-4bc1-9be1-8127c4322903 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.087262 May 10 21:30:23.229290 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1626/2402] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:23 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:24.157216 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a022d4a4-e412-4f7d-9a51-ec060d798c24 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:24.157863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a022d4a4-e412-4f7d-9a51-ec060d798c24 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:24.164302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a022d4a4-e412-4f7d-9a51-ec060d798c24 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:24.164748 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a022d4a4-e412-4f7d-9a51-ec060d798c24 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:24.165507 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a022d4a4-e412-4f7d-9a51-ec060d798c24 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:24.165945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a022d4a4-e412-4f7d-9a51-ec060d798c24 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:24.227523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a022d4a4-e412-4f7d-9a51-ec060d798c24 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:24.235906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a022d4a4-e412-4f7d-9a51-ec060d798c24 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:24.237414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a022d4a4-e412-4f7d-9a51-ec060d798c24 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:24.238552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a022d4a4-e412-4f7d-9a51-ec060d798c24 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085260 May 10 21:30:24.239115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1627/2403] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:24 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:24.245652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ff359c7d-1ede-4bf4-bf3f-b535e7e050fd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:24.246449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ff359c7d-1ede-4bf4-bf3f-b535e7e050fd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:24.252276 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ff359c7d-1ede-4bf4-bf3f-b535e7e050fd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:24.252756 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ff359c7d-1ede-4bf4-bf3f-b535e7e050fd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:24.253523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ff359c7d-1ede-4bf4-bf3f-b535e7e050fd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:24.253958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ff359c7d-1ede-4bf4-bf3f-b535e7e050fd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:24.317616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ff359c7d-1ede-4bf4-bf3f-b535e7e050fd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:24.325082 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ff359c7d-1ede-4bf4-bf3f-b535e7e050fd tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083361 May 10 21:30:24.325693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1628/2404] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:24 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:30:25.257483 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-aae75004-4c9d-45f7-a8d8-18165f172602 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:25.258121 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-aae75004-4c9d-45f7-a8d8-18165f172602 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:25.265074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aae75004-4c9d-45f7-a8d8-18165f172602 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:25.265525 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aae75004-4c9d-45f7-a8d8-18165f172602 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:25.266289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aae75004-4c9d-45f7-a8d8-18165f172602 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:25.266728 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aae75004-4c9d-45f7-a8d8-18165f172602 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:25.327305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-aae75004-4c9d-45f7-a8d8-18165f172602 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:25.335906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-aae75004-4c9d-45f7-a8d8-18165f172602 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:25.337426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-aae75004-4c9d-45f7-a8d8-18165f172602 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:25.338596 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-aae75004-4c9d-45f7-a8d8-18165f172602 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085002 May 10 21:30:25.339907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1629/2405] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:25 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:25.344268 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-184f465e-f36a-483f-b600-de2c04fc36d0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:25.344874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-184f465e-f36a-483f-b600-de2c04fc36d0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:25.351133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-184f465e-f36a-483f-b600-de2c04fc36d0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:25.351595 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-184f465e-f36a-483f-b600-de2c04fc36d0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:25.352349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-184f465e-f36a-483f-b600-de2c04fc36d0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:25.352779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-184f465e-f36a-483f-b600-de2c04fc36d0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:25.411450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-184f465e-f36a-483f-b600-de2c04fc36d0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:25.419085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-184f465e-f36a-483f-b600-de2c04fc36d0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078248 May 10 21:30:25.419680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1630/2406] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:25 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:26.358914 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6512610e-443e-4976-a4b6-cd4db2e400fd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:26.359546 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6512610e-443e-4976-a4b6-cd4db2e400fd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:26.366171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6512610e-443e-4976-a4b6-cd4db2e400fd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:26.366624 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6512610e-443e-4976-a4b6-cd4db2e400fd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:26.367456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6512610e-443e-4976-a4b6-cd4db2e400fd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:26.367899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6512610e-443e-4976-a4b6-cd4db2e400fd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:26.429023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6512610e-443e-4976-a4b6-cd4db2e400fd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:26.437654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6512610e-443e-4976-a4b6-cd4db2e400fd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:26.439180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6512610e-443e-4976-a4b6-cd4db2e400fd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:26.440314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6512610e-443e-4976-a4b6-cd4db2e400fd tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086736 May 10 21:30:26.441208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1631/2407] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:26 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:26.445897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-894bdf20-3f5f-4e7f-a0d0-7f6cd69d9285 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:26.446496 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-894bdf20-3f5f-4e7f-a0d0-7f6cd69d9285 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:26.452667 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-894bdf20-3f5f-4e7f-a0d0-7f6cd69d9285 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:26.453119 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-894bdf20-3f5f-4e7f-a0d0-7f6cd69d9285 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:26.453937 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-894bdf20-3f5f-4e7f-a0d0-7f6cd69d9285 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:26.454380 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-894bdf20-3f5f-4e7f-a0d0-7f6cd69d9285 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:26.518447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-894bdf20-3f5f-4e7f-a0d0-7f6cd69d9285 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:26.526214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-894bdf20-3f5f-4e7f-a0d0-7f6cd69d9285 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083338 May 10 21:30:26.527968 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1632/2408] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:26 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:27.458844 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c09a02e6-1a20-4cf1-b070-b96af85ecf9c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:27.459486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c09a02e6-1a20-4cf1-b070-b96af85ecf9c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:27.467353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c09a02e6-1a20-4cf1-b070-b96af85ecf9c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:27.467796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c09a02e6-1a20-4cf1-b070-b96af85ecf9c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:27.468565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c09a02e6-1a20-4cf1-b070-b96af85ecf9c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:27.468996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c09a02e6-1a20-4cf1-b070-b96af85ecf9c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:27.530404 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c09a02e6-1a20-4cf1-b070-b96af85ecf9c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:27.538674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c09a02e6-1a20-4cf1-b070-b96af85ecf9c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:27.540306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c09a02e6-1a20-4cf1-b070-b96af85ecf9c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:27.541428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c09a02e6-1a20-4cf1-b070-b96af85ecf9c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086815 May 10 21:30:27.542067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1633/2409] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:27 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:27.546618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6f18056d-bb3d-474d-a685-33bbaeb9933e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:27.547288 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6f18056d-bb3d-474d-a685-33bbaeb9933e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:27.552824 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6f18056d-bb3d-474d-a685-33bbaeb9933e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:27.553286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6f18056d-bb3d-474d-a685-33bbaeb9933e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:27.554027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6f18056d-bb3d-474d-a685-33bbaeb9933e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:27.554491 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6f18056d-bb3d-474d-a685-33bbaeb9933e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:27.616439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6f18056d-bb3d-474d-a685-33bbaeb9933e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:27.623873 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6f18056d-bb3d-474d-a685-33bbaeb9933e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080685 May 10 21:30:27.624443 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1634/2410] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:27 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:28.560837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c0469020-6ae2-4db3-be68-786ea7fdcbe9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:28.561522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c0469020-6ae2-4db3-be68-786ea7fdcbe9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:28.567976 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c0469020-6ae2-4db3-be68-786ea7fdcbe9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:28.568430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c0469020-6ae2-4db3-be68-786ea7fdcbe9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:28.569212 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c0469020-6ae2-4db3-be68-786ea7fdcbe9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:28.569657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c0469020-6ae2-4db3-be68-786ea7fdcbe9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:28.640288 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c0469020-6ae2-4db3-be68-786ea7fdcbe9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:28.648959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c0469020-6ae2-4db3-be68-786ea7fdcbe9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:28.650456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c0469020-6ae2-4db3-be68-786ea7fdcbe9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:28.651739 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c0469020-6ae2-4db3-be68-786ea7fdcbe9 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.095559 May 10 21:30:28.652303 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1635/2411] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:28 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:28.656876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-27b0cf77-44b2-48d1-9e0c-17956f980a27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:28.657475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-27b0cf77-44b2-48d1-9e0c-17956f980a27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:28.663610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27b0cf77-44b2-48d1-9e0c-17956f980a27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:28.664056 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27b0cf77-44b2-48d1-9e0c-17956f980a27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:28.664817 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27b0cf77-44b2-48d1-9e0c-17956f980a27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:28.665316 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27b0cf77-44b2-48d1-9e0c-17956f980a27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:28.737060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-27b0cf77-44b2-48d1-9e0c-17956f980a27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:28.745654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-27b0cf77-44b2-48d1-9e0c-17956f980a27 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.091583 May 10 21:30:28.746854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1636/2412] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:28 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:29.670839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b7401431-7d8f-4fcb-a3cf-e28087e4d3a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:29.671504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b7401431-7d8f-4fcb-a3cf-e28087e4d3a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:29.677954 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b7401431-7d8f-4fcb-a3cf-e28087e4d3a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:29.678402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b7401431-7d8f-4fcb-a3cf-e28087e4d3a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:29.679242 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b7401431-7d8f-4fcb-a3cf-e28087e4d3a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:29.679685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b7401431-7d8f-4fcb-a3cf-e28087e4d3a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:29.743435 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b7401431-7d8f-4fcb-a3cf-e28087e4d3a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:29.752283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b7401431-7d8f-4fcb-a3cf-e28087e4d3a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:29.753795 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b7401431-7d8f-4fcb-a3cf-e28087e4d3a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:29.754932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b7401431-7d8f-4fcb-a3cf-e28087e4d3a0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.088036 May 10 21:30:29.755529 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1637/2413] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:29 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:29.765549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dd455ea2-e507-4d2b-ad85-9ec6010c3d16 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:29.766184 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dd455ea2-e507-4d2b-ad85-9ec6010c3d16 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:29.771804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dd455ea2-e507-4d2b-ad85-9ec6010c3d16 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:29.772252 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dd455ea2-e507-4d2b-ad85-9ec6010c3d16 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:29.773011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dd455ea2-e507-4d2b-ad85-9ec6010c3d16 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:29.773453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dd455ea2-e507-4d2b-ad85-9ec6010c3d16 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:29.833891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dd455ea2-e507-4d2b-ad85-9ec6010c3d16 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:29.841914 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dd455ea2-e507-4d2b-ad85-9ec6010c3d16 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080881 May 10 21:30:29.842480 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1638/2414] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:29 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:30:30.773193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e44e630d-07a6-4b0f-80b7-c9b508f188a7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:30.773812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e44e630d-07a6-4b0f-80b7-c9b508f188a7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:30.780189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e44e630d-07a6-4b0f-80b7-c9b508f188a7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:30.780647 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e44e630d-07a6-4b0f-80b7-c9b508f188a7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:30.781420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e44e630d-07a6-4b0f-80b7-c9b508f188a7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:30.781892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e44e630d-07a6-4b0f-80b7-c9b508f188a7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:30.842217 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e44e630d-07a6-4b0f-80b7-c9b508f188a7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:30.850337 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e44e630d-07a6-4b0f-80b7-c9b508f188a7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:30.851863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e44e630d-07a6-4b0f-80b7-c9b508f188a7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:30.853000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e44e630d-07a6-4b0f-80b7-c9b508f188a7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083803 May 10 21:30:30.853558 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1639/2415] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:30 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:30:30.859378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b804d5d3-cd29-426c-b4cb-6c536caab2eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:30.859926 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b804d5d3-cd29-426c-b4cb-6c536caab2eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:30.865828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b804d5d3-cd29-426c-b4cb-6c536caab2eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:30.866305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b804d5d3-cd29-426c-b4cb-6c536caab2eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:30.867074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b804d5d3-cd29-426c-b4cb-6c536caab2eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:30.867544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b804d5d3-cd29-426c-b4cb-6c536caab2eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:30.930472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b804d5d3-cd29-426c-b4cb-6c536caab2eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:30.938707 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b804d5d3-cd29-426c-b4cb-6c536caab2eb tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083863 May 10 21:30:30.939312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1640/2416] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:30 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:30:31.871718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0c2ab071-91be-4ee0-bc5a-ac2fbb735462 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:31.872438 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0c2ab071-91be-4ee0-bc5a-ac2fbb735462 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:31.878574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c2ab071-91be-4ee0-bc5a-ac2fbb735462 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:31.879019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c2ab071-91be-4ee0-bc5a-ac2fbb735462 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:31.879814 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c2ab071-91be-4ee0-bc5a-ac2fbb735462 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:31.880246 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c2ab071-91be-4ee0-bc5a-ac2fbb735462 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:31.941017 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0c2ab071-91be-4ee0-bc5a-ac2fbb735462 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:31.949513 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0c2ab071-91be-4ee0-bc5a-ac2fbb735462 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:31.951010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0c2ab071-91be-4ee0-bc5a-ac2fbb735462 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:31.952242 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0c2ab071-91be-4ee0-bc5a-ac2fbb735462 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085253 May 10 21:30:31.952797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1641/2417] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:31 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:31.957331 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5edd2856-7507-4498-8058-40d4978084b0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:31.957927 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5edd2856-7507-4498-8058-40d4978084b0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:31.963694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5edd2856-7507-4498-8058-40d4978084b0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:31.964497 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5edd2856-7507-4498-8058-40d4978084b0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:31.965021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5edd2856-7507-4498-8058-40d4978084b0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:31.965454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5edd2856-7507-4498-8058-40d4978084b0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:32.024899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5edd2856-7507-4498-8058-40d4978084b0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:32.032373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5edd2856-7507-4498-8058-40d4978084b0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078639 May 10 21:30:32.032929 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1642/2418] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:31 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:32.970415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d27d7172-0f78-4770-9c69-e19045572e46 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:32.971051 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d27d7172-0f78-4770-9c69-e19045572e46 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:32.977238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d27d7172-0f78-4770-9c69-e19045572e46 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:32.977684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d27d7172-0f78-4770-9c69-e19045572e46 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:32.978431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d27d7172-0f78-4770-9c69-e19045572e46 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:32.978861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d27d7172-0f78-4770-9c69-e19045572e46 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:33.040431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d27d7172-0f78-4770-9c69-e19045572e46 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:33.049553 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d27d7172-0f78-4770-9c69-e19045572e46 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:33.051065 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d27d7172-0f78-4770-9c69-e19045572e46 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:33.052263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d27d7172-0f78-4770-9c69-e19045572e46 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085816 May 10 21:30:33.052827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1643/2419] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:32 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:33.057266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-15389abc-d7e4-4ae5-85b2-c20b3c781a57 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:33.059162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-15389abc-d7e4-4ae5-85b2-c20b3c781a57 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:33.064781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-15389abc-d7e4-4ae5-85b2-c20b3c781a57 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:33.065227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-15389abc-d7e4-4ae5-85b2-c20b3c781a57 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:33.065990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-15389abc-d7e4-4ae5-85b2-c20b3c781a57 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:33.066430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-15389abc-d7e4-4ae5-85b2-c20b3c781a57 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:33.130620 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-15389abc-d7e4-4ae5-85b2-c20b3c781a57 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:33.138526 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-15389abc-d7e4-4ae5-85b2-c20b3c781a57 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.084715 May 10 21:30:33.139087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1644/2420] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:33 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:34.186111 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e6417187-1831-488e-b2e4-f8728e5a82b7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:34.186821 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e6417187-1831-488e-b2e4-f8728e5a82b7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:34.192670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e6417187-1831-488e-b2e4-f8728e5a82b7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:34.193116 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e6417187-1831-488e-b2e4-f8728e5a82b7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:34.193875 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e6417187-1831-488e-b2e4-f8728e5a82b7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:34.194296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e6417187-1831-488e-b2e4-f8728e5a82b7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:34.302208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e6417187-1831-488e-b2e4-f8728e5a82b7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:34.311190 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e6417187-1831-488e-b2e4-f8728e5a82b7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:34.312702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e6417187-1831-488e-b2e4-f8728e5a82b7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:34.313841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e6417187-1831-488e-b2e4-f8728e5a82b7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.247738 May 10 21:30:34.314396 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1645/2421] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:34 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:30:34.318705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f8930f3d-8009-408e-abdb-5e1e40665d0f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:34.319338 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f8930f3d-8009-408e-abdb-5e1e40665d0f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:34.325072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f8930f3d-8009-408e-abdb-5e1e40665d0f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:34.325461 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f8930f3d-8009-408e-abdb-5e1e40665d0f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:34.326221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f8930f3d-8009-408e-abdb-5e1e40665d0f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:34.326662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f8930f3d-8009-408e-abdb-5e1e40665d0f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:34.386066 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f8930f3d-8009-408e-abdb-5e1e40665d0f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:34.393482 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f8930f3d-8009-408e-abdb-5e1e40665d0f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078164 May 10 21:30:34.394051 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1646/2422] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:34 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:35.332780 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c8dea8fb-6cef-4c60-9d72-68829b8c731c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:35.333440 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c8dea8fb-6cef-4c60-9d72-68829b8c731c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:35.340559 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c8dea8fb-6cef-4c60-9d72-68829b8c731c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:35.341013 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c8dea8fb-6cef-4c60-9d72-68829b8c731c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:35.341776 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c8dea8fb-6cef-4c60-9d72-68829b8c731c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:35.342214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c8dea8fb-6cef-4c60-9d72-68829b8c731c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:35.403374 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c8dea8fb-6cef-4c60-9d72-68829b8c731c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:35.411710 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c8dea8fb-6cef-4c60-9d72-68829b8c731c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:35.413211 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c8dea8fb-6cef-4c60-9d72-68829b8c731c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:35.414341 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c8dea8fb-6cef-4c60-9d72-68829b8c731c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085758 May 10 21:30:35.414901 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1647/2423] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:35 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:35.419323 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f50c80c5-b22e-4384-b79c-d4301d034754 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:35.419920 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f50c80c5-b22e-4384-b79c-d4301d034754 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:35.425624 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f50c80c5-b22e-4384-b79c-d4301d034754 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:35.426113 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f50c80c5-b22e-4384-b79c-d4301d034754 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:35.426886 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f50c80c5-b22e-4384-b79c-d4301d034754 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:35.427363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f50c80c5-b22e-4384-b79c-d4301d034754 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:35.490159 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f50c80c5-b22e-4384-b79c-d4301d034754 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:35.498029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f50c80c5-b22e-4384-b79c-d4301d034754 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082128 May 10 21:30:35.498591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1648/2424] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:35 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:36.433879 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5b0a350d-b422-4c93-9b2a-96458a214478 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:36.434541 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5b0a350d-b422-4c93-9b2a-96458a214478 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:36.440911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b0a350d-b422-4c93-9b2a-96458a214478 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:36.441363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b0a350d-b422-4c93-9b2a-96458a214478 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:36.442129 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b0a350d-b422-4c93-9b2a-96458a214478 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:36.442563 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b0a350d-b422-4c93-9b2a-96458a214478 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:36.503683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5b0a350d-b422-4c93-9b2a-96458a214478 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:36.512130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5b0a350d-b422-4c93-9b2a-96458a214478 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:36.513639 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5b0a350d-b422-4c93-9b2a-96458a214478 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:36.514780 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5b0a350d-b422-4c93-9b2a-96458a214478 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085959 May 10 21:30:36.515383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1649/2425] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:36 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:36.519670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cd3da855-2c4a-4692-9195-c66042437a84 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:36.520278 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cd3da855-2c4a-4692-9195-c66042437a84 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:36.525837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd3da855-2c4a-4692-9195-c66042437a84 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:36.526376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd3da855-2c4a-4692-9195-c66042437a84 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:36.527263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd3da855-2c4a-4692-9195-c66042437a84 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:36.527703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd3da855-2c4a-4692-9195-c66042437a84 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:36.586695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cd3da855-2c4a-4692-9195-c66042437a84 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:36.593904 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cd3da855-2c4a-4692-9195-c66042437a84 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.077604 May 10 21:30:36.594466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1650/2426] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:36 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:37.532780 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0e7c93df-4f4d-4637-a363-af630ae36c8e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:37.533439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0e7c93df-4f4d-4637-a363-af630ae36c8e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:37.539734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0e7c93df-4f4d-4637-a363-af630ae36c8e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:37.540178 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0e7c93df-4f4d-4637-a363-af630ae36c8e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:37.540934 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0e7c93df-4f4d-4637-a363-af630ae36c8e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:37.541365 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0e7c93df-4f4d-4637-a363-af630ae36c8e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:37.607429 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0e7c93df-4f4d-4637-a363-af630ae36c8e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:37.619481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0e7c93df-4f4d-4637-a363-af630ae36c8e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:37.621773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0e7c93df-4f4d-4637-a363-af630ae36c8e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:37.625502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0e7c93df-4f4d-4637-a363-af630ae36c8e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.094337 May 10 21:30:37.625502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1651/2427] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:37 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:37.628970 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bd8f7d27-19d8-423e-9985-e41a0138dee9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:37.629571 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bd8f7d27-19d8-423e-9985-e41a0138dee9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:37.636472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bd8f7d27-19d8-423e-9985-e41a0138dee9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:37.636972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bd8f7d27-19d8-423e-9985-e41a0138dee9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:37.637788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bd8f7d27-19d8-423e-9985-e41a0138dee9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:37.638223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bd8f7d27-19d8-423e-9985-e41a0138dee9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:37.701773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bd8f7d27-19d8-423e-9985-e41a0138dee9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:37.709776 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bd8f7d27-19d8-423e-9985-e41a0138dee9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.084744 May 10 21:30:37.710658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1652/2428] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:37 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:38.640811 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-af81793a-9087-4f72-92e3-cf73c765026a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:38.641419 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-af81793a-9087-4f72-92e3-cf73c765026a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:38.647722 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af81793a-9087-4f72-92e3-cf73c765026a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:38.648170 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af81793a-9087-4f72-92e3-cf73c765026a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:38.648920 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af81793a-9087-4f72-92e3-cf73c765026a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:38.649356 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af81793a-9087-4f72-92e3-cf73c765026a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:38.712040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-af81793a-9087-4f72-92e3-cf73c765026a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:38.721947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-af81793a-9087-4f72-92e3-cf73c765026a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:38.722844 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-af81793a-9087-4f72-92e3-cf73c765026a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:38.724035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-af81793a-9087-4f72-92e3-cf73c765026a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087286 May 10 21:30:38.724657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1653/2429] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:38 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:38.729830 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-715f6374-7ef0-4e39-8234-1497f806e4df tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:38.730438 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-715f6374-7ef0-4e39-8234-1497f806e4df tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:38.736846 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-715f6374-7ef0-4e39-8234-1497f806e4df tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:38.737330 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-715f6374-7ef0-4e39-8234-1497f806e4df tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:38.738171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-715f6374-7ef0-4e39-8234-1497f806e4df tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:38.738610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-715f6374-7ef0-4e39-8234-1497f806e4df tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:38.800789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-715f6374-7ef0-4e39-8234-1497f806e4df tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:38.808090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-715f6374-7ef0-4e39-8234-1497f806e4df tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081806 May 10 21:30:38.808653 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1654/2430] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:38 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:39.741974 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-940e8391-3cd2-477d-8656-83dfba75f65d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:39.742606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-940e8391-3cd2-477d-8656-83dfba75f65d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:39.749695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-940e8391-3cd2-477d-8656-83dfba75f65d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:39.750156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-940e8391-3cd2-477d-8656-83dfba75f65d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:39.750922 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-940e8391-3cd2-477d-8656-83dfba75f65d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:39.751398 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-940e8391-3cd2-477d-8656-83dfba75f65d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:39.814285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-940e8391-3cd2-477d-8656-83dfba75f65d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:39.823188 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-940e8391-3cd2-477d-8656-83dfba75f65d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:39.824825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-940e8391-3cd2-477d-8656-83dfba75f65d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:39.825974 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-940e8391-3cd2-477d-8656-83dfba75f65d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.088039 May 10 21:30:39.826532 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1655/2431] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:39 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:39.831016 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2deb8c52-c7bb-43eb-a293-96d4a66d9681 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:39.831659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2deb8c52-c7bb-43eb-a293-96d4a66d9681 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:39.837753 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2deb8c52-c7bb-43eb-a293-96d4a66d9681 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:39.838210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2deb8c52-c7bb-43eb-a293-96d4a66d9681 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:39.840307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2deb8c52-c7bb-43eb-a293-96d4a66d9681 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:39.840712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2deb8c52-c7bb-43eb-a293-96d4a66d9681 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:39.906257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2deb8c52-c7bb-43eb-a293-96d4a66d9681 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:39.913923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2deb8c52-c7bb-43eb-a293-96d4a66d9681 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.086424 May 10 21:30:39.914492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1656/2432] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:39 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:40.844440 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8f9f1406-625a-429c-b8f6-b95ed9ecc0ed tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:40.845085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8f9f1406-625a-429c-b8f6-b95ed9ecc0ed tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:40.851573 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8f9f1406-625a-429c-b8f6-b95ed9ecc0ed tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:40.852024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8f9f1406-625a-429c-b8f6-b95ed9ecc0ed tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:40.852785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8f9f1406-625a-429c-b8f6-b95ed9ecc0ed tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:40.853223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8f9f1406-625a-429c-b8f6-b95ed9ecc0ed tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:40.917896 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8f9f1406-625a-429c-b8f6-b95ed9ecc0ed tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:40.926615 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8f9f1406-625a-429c-b8f6-b95ed9ecc0ed tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:40.928141 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8f9f1406-625a-429c-b8f6-b95ed9ecc0ed tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:40.929295 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8f9f1406-625a-429c-b8f6-b95ed9ecc0ed tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.088787 May 10 21:30:40.929882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1657/2433] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:40 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:30:40.935401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ae6645cf-17e6-4c59-9cd6-88dc183f9044 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:40.936011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ae6645cf-17e6-4c59-9cd6-88dc183f9044 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:40.942181 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae6645cf-17e6-4c59-9cd6-88dc183f9044 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:40.942630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae6645cf-17e6-4c59-9cd6-88dc183f9044 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:40.943423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae6645cf-17e6-4c59-9cd6-88dc183f9044 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:40.943863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ae6645cf-17e6-4c59-9cd6-88dc183f9044 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:41.008355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ae6645cf-17e6-4c59-9cd6-88dc183f9044 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:41.019049 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ae6645cf-17e6-4c59-9cd6-88dc183f9044 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.087949 May 10 21:30:41.019671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1658/2434] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:40 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:41.947979 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f72f8442-0119-44fb-8324-0b246aae6aa5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:41.949072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f72f8442-0119-44fb-8324-0b246aae6aa5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:41.955725 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f72f8442-0119-44fb-8324-0b246aae6aa5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:41.956183 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f72f8442-0119-44fb-8324-0b246aae6aa5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:41.957312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f72f8442-0119-44fb-8324-0b246aae6aa5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:41.957813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f72f8442-0119-44fb-8324-0b246aae6aa5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:42.021429 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f72f8442-0119-44fb-8324-0b246aae6aa5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:42.031718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f72f8442-0119-44fb-8324-0b246aae6aa5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:42.033249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f72f8442-0119-44fb-8324-0b246aae6aa5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:42.034412 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f72f8442-0119-44fb-8324-0b246aae6aa5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.090398 May 10 21:30:42.035012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1659/2435] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:41 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:42.039604 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c0617d6b-cec5-4e76-914b-d29c4f1764c0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:42.040273 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c0617d6b-cec5-4e76-914b-d29c4f1764c0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:42.047407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c0617d6b-cec5-4e76-914b-d29c4f1764c0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:42.047864 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c0617d6b-cec5-4e76-914b-d29c4f1764c0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:42.048631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c0617d6b-cec5-4e76-914b-d29c4f1764c0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:42.049072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c0617d6b-cec5-4e76-914b-d29c4f1764c0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:42.288287 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c0617d6b-cec5-4e76-914b-d29c4f1764c0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:42.296489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c0617d6b-cec5-4e76-914b-d29c4f1764c0 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.260454 May 10 21:30:42.297046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1660/2436] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:42 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:43.053231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fbf5273a-050e-4601-9619-ce26b61b442b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:43.053870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fbf5273a-050e-4601-9619-ce26b61b442b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:43.061150 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fbf5273a-050e-4601-9619-ce26b61b442b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:43.061693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fbf5273a-050e-4601-9619-ce26b61b442b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:43.062512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fbf5273a-050e-4601-9619-ce26b61b442b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:43.062957 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fbf5273a-050e-4601-9619-ce26b61b442b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:43.126914 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fbf5273a-050e-4601-9619-ce26b61b442b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:43.135523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fbf5273a-050e-4601-9619-ce26b61b442b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:43.137557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fbf5273a-050e-4601-9619-ce26b61b442b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:43.139024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fbf5273a-050e-4601-9619-ce26b61b442b tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.089746 May 10 21:30:43.139639 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1661/2437] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:43 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:43.314528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e6b7c34e-9136-4248-8beb-cf74339b873e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:43.315059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e6b7c34e-9136-4248-8beb-cf74339b873e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:43.321133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e6b7c34e-9136-4248-8beb-cf74339b873e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:43.321580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e6b7c34e-9136-4248-8beb-cf74339b873e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:43.322374 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e6b7c34e-9136-4248-8beb-cf74339b873e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:43.322809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e6b7c34e-9136-4248-8beb-cf74339b873e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:43.386404 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e6b7c34e-9136-4248-8beb-cf74339b873e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:43.394208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e6b7c34e-9136-4248-8beb-cf74339b873e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083798 May 10 21:30:43.394857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1662/2438] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:43 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:30:44.157145 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-52ae5361-87d3-443e-94bb-c91bef860736 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:44.157775 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-52ae5361-87d3-443e-94bb-c91bef860736 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:44.163993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52ae5361-87d3-443e-94bb-c91bef860736 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:44.164444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52ae5361-87d3-443e-94bb-c91bef860736 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:44.165212 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52ae5361-87d3-443e-94bb-c91bef860736 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:44.165645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52ae5361-87d3-443e-94bb-c91bef860736 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:44.228278 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-52ae5361-87d3-443e-94bb-c91bef860736 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:44.236917 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-52ae5361-87d3-443e-94bb-c91bef860736 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:44.238410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-52ae5361-87d3-443e-94bb-c91bef860736 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:44.239626 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-52ae5361-87d3-443e-94bb-c91bef860736 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086723 May 10 21:30:44.240172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1663/2439] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:44 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:44.413018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f4c546b4-55f0-41a1-a9bb-a4207927d638 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:44.413561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f4c546b4-55f0-41a1-a9bb-a4207927d638 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:44.420264 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4c546b4-55f0-41a1-a9bb-a4207927d638 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:44.420719 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4c546b4-55f0-41a1-a9bb-a4207927d638 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:44.421489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4c546b4-55f0-41a1-a9bb-a4207927d638 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:44.421928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4c546b4-55f0-41a1-a9bb-a4207927d638 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:44.494028 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f4c546b4-55f0-41a1-a9bb-a4207927d638 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:44.495324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f4c546b4-55f0-41a1-a9bb-a4207927d638 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.086215 May 10 21:30:44.495889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1664/2440] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:44 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:30:45.257820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-726efad0-5b1f-4123-8778-9a2fe367efc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:45.258568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-726efad0-5b1f-4123-8778-9a2fe367efc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:45.265856 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-726efad0-5b1f-4123-8778-9a2fe367efc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:45.266344 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-726efad0-5b1f-4123-8778-9a2fe367efc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:45.267106 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-726efad0-5b1f-4123-8778-9a2fe367efc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:45.267567 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-726efad0-5b1f-4123-8778-9a2fe367efc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:45.328625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-726efad0-5b1f-4123-8778-9a2fe367efc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:45.338228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-726efad0-5b1f-4123-8778-9a2fe367efc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:45.339785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-726efad0-5b1f-4123-8778-9a2fe367efc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:45.340991 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-726efad0-5b1f-4123-8778-9a2fe367efc2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087101 May 10 21:30:45.341548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1665/2441] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:45 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:45.512841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c6e6d4aa-61c0-4283-9eb7-e294192e4d03 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:45.513389 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c6e6d4aa-61c0-4283-9eb7-e294192e4d03 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:45.519720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c6e6d4aa-61c0-4283-9eb7-e294192e4d03 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:45.520189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c6e6d4aa-61c0-4283-9eb7-e294192e4d03 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:45.520965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c6e6d4aa-61c0-4283-9eb7-e294192e4d03 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:45.521407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c6e6d4aa-61c0-4283-9eb7-e294192e4d03 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:45.583779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c6e6d4aa-61c0-4283-9eb7-e294192e4d03 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:45.591286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c6e6d4aa-61c0-4283-9eb7-e294192e4d03 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082437 May 10 21:30:45.591846 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1666/2442] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:45 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:30:46.358148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-461403d7-dbd2-46b2-82e7-f67387d085d3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:46.358813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-461403d7-dbd2-46b2-82e7-f67387d085d3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:46.365129 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-461403d7-dbd2-46b2-82e7-f67387d085d3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:46.365610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-461403d7-dbd2-46b2-82e7-f67387d085d3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:46.366367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-461403d7-dbd2-46b2-82e7-f67387d085d3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:46.366802 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-461403d7-dbd2-46b2-82e7-f67387d085d3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:46.426356 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-461403d7-dbd2-46b2-82e7-f67387d085d3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:46.434925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-461403d7-dbd2-46b2-82e7-f67387d085d3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:46.436446 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-461403d7-dbd2-46b2-82e7-f67387d085d3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:46.437578 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-461403d7-dbd2-46b2-82e7-f67387d085d3 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083365 May 10 21:30:46.438130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1667/2443] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:46 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:46.608495 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6a2efef2-12c0-43a4-916c-d32ed614175b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:46.609059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6a2efef2-12c0-43a4-916c-d32ed614175b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:46.614967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a2efef2-12c0-43a4-916c-d32ed614175b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:46.615459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a2efef2-12c0-43a4-916c-d32ed614175b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:46.616224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a2efef2-12c0-43a4-916c-d32ed614175b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:46.616664 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a2efef2-12c0-43a4-916c-d32ed614175b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:46.654802 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:30:46.655000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Tue May 10 21:30:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f (ip 10.222.0.49) !!! May 10 21:30:46.680908 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6a2efef2-12c0-43a4-916c-d32ed614175b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:46.689148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6a2efef2-12c0-43a4-916c-d32ed614175b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.084954 May 10 21:30:46.689721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1668/2444] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:46 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:30:47.455877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6069cece-2ff7-42e4-9014-c6c141865e20 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:47.456544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6069cece-2ff7-42e4-9014-c6c141865e20 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:47.463297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6069cece-2ff7-42e4-9014-c6c141865e20 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:47.463778 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6069cece-2ff7-42e4-9014-c6c141865e20 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:47.464539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6069cece-2ff7-42e4-9014-c6c141865e20 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:47.464980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6069cece-2ff7-42e4-9014-c6c141865e20 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:47.526954 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6069cece-2ff7-42e4-9014-c6c141865e20 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:47.535881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6069cece-2ff7-42e4-9014-c6c141865e20 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:47.537395 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6069cece-2ff7-42e4-9014-c6c141865e20 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:47.538542 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6069cece-2ff7-42e4-9014-c6c141865e20 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086627 May 10 21:30:47.539106 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1669/2445] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:47 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:47.706611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-71007aeb-4db2-4b2a-bef5-9306c62e181b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:47.707444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-71007aeb-4db2-4b2a-bef5-9306c62e181b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:47.713464 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71007aeb-4db2-4b2a-bef5-9306c62e181b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:47.713923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71007aeb-4db2-4b2a-bef5-9306c62e181b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:47.714697 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71007aeb-4db2-4b2a-bef5-9306c62e181b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:47.715815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71007aeb-4db2-4b2a-bef5-9306c62e181b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:47.774634 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-71007aeb-4db2-4b2a-bef5-9306c62e181b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:47.782535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-71007aeb-4db2-4b2a-bef5-9306c62e181b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079840 May 10 21:30:47.783094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1670/2446] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:47 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:30:48.556724 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ad053a1f-3300-4104-a1f6-ce65ed928adf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:48.557407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ad053a1f-3300-4104-a1f6-ce65ed928adf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:48.564506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ad053a1f-3300-4104-a1f6-ce65ed928adf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:48.564957 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ad053a1f-3300-4104-a1f6-ce65ed928adf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:48.565738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ad053a1f-3300-4104-a1f6-ce65ed928adf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:48.566160 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ad053a1f-3300-4104-a1f6-ce65ed928adf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:48.626673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ad053a1f-3300-4104-a1f6-ce65ed928adf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:48.634936 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ad053a1f-3300-4104-a1f6-ce65ed928adf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:48.636482 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ad053a1f-3300-4104-a1f6-ce65ed928adf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:48.637772 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ad053a1f-3300-4104-a1f6-ce65ed928adf tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084824 May 10 21:30:48.638327 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1671/2447] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:48 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:48.799317 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-38821cb3-d3ed-4bde-9af7-f7bd51945241 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:48.799927 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-38821cb3-d3ed-4bde-9af7-f7bd51945241 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:48.805808 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38821cb3-d3ed-4bde-9af7-f7bd51945241 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:48.806252 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38821cb3-d3ed-4bde-9af7-f7bd51945241 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:48.807066 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38821cb3-d3ed-4bde-9af7-f7bd51945241 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:48.807472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38821cb3-d3ed-4bde-9af7-f7bd51945241 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:48.869302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-38821cb3-d3ed-4bde-9af7-f7bd51945241 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:48.876630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-38821cb3-d3ed-4bde-9af7-f7bd51945241 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081175 May 10 21:30:48.877186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1672/2448] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:48 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:30:49.655790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7e800f8d-0b2b-4a49-9be4-84259493c7fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:49.656411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7e800f8d-0b2b-4a49-9be4-84259493c7fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:49.662709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7e800f8d-0b2b-4a49-9be4-84259493c7fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:49.663185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7e800f8d-0b2b-4a49-9be4-84259493c7fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:49.663958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7e800f8d-0b2b-4a49-9be4-84259493c7fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:49.664385 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7e800f8d-0b2b-4a49-9be4-84259493c7fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:49.725527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7e800f8d-0b2b-4a49-9be4-84259493c7fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:49.734436 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7e800f8d-0b2b-4a49-9be4-84259493c7fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:49.735969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7e800f8d-0b2b-4a49-9be4-84259493c7fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:49.737109 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7e800f8d-0b2b-4a49-9be4-84259493c7fe tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085470 May 10 21:30:49.737666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1673/2449] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:49 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:49.893805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-93a3caad-5489-4615-88f8-d37215db775d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:49.894447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-93a3caad-5489-4615-88f8-d37215db775d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:49.900399 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-93a3caad-5489-4615-88f8-d37215db775d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:49.900853 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-93a3caad-5489-4615-88f8-d37215db775d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:49.901615 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-93a3caad-5489-4615-88f8-d37215db775d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:49.902056 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-93a3caad-5489-4615-88f8-d37215db775d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:49.965102 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-93a3caad-5489-4615-88f8-d37215db775d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:49.972649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-93a3caad-5489-4615-88f8-d37215db775d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082770 May 10 21:30:49.973273 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1674/2450] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:49 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:30:50.755728 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ad5963a0-89ce-44bc-b238-91d9283c7359 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:50.756340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ad5963a0-89ce-44bc-b238-91d9283c7359 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:50.763705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ad5963a0-89ce-44bc-b238-91d9283c7359 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:50.764169 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ad5963a0-89ce-44bc-b238-91d9283c7359 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:50.764937 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ad5963a0-89ce-44bc-b238-91d9283c7359 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:50.765375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ad5963a0-89ce-44bc-b238-91d9283c7359 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:50.826748 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ad5963a0-89ce-44bc-b238-91d9283c7359 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:50.835351 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ad5963a0-89ce-44bc-b238-91d9283c7359 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:50.836862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ad5963a0-89ce-44bc-b238-91d9283c7359 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:50.838002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ad5963a0-89ce-44bc-b238-91d9283c7359 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086354 May 10 21:30:50.838567 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1675/2451] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:50 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:50.989805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fe8bd344-d97c-48c6-8056-56b082539a85 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:50.990333 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fe8bd344-d97c-48c6-8056-56b082539a85 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:50.996801 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fe8bd344-d97c-48c6-8056-56b082539a85 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:50.997262 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fe8bd344-d97c-48c6-8056-56b082539a85 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:50.998047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fe8bd344-d97c-48c6-8056-56b082539a85 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:50.998484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fe8bd344-d97c-48c6-8056-56b082539a85 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:51.060699 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fe8bd344-d97c-48c6-8056-56b082539a85 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:51.068011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fe8bd344-d97c-48c6-8056-56b082539a85 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082122 May 10 21:30:51.068561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1676/2452] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:50 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:30:51.857579 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f3f7d56e-8c31-4b5b-b3cd-8ef723f945e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:51.858320 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f3f7d56e-8c31-4b5b-b3cd-8ef723f945e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:51.864566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f3f7d56e-8c31-4b5b-b3cd-8ef723f945e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:51.865015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f3f7d56e-8c31-4b5b-b3cd-8ef723f945e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:51.865771 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f3f7d56e-8c31-4b5b-b3cd-8ef723f945e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:51.866207 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f3f7d56e-8c31-4b5b-b3cd-8ef723f945e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:52.165733 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f3f7d56e-8c31-4b5b-b3cd-8ef723f945e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:52.174240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f3f7d56e-8c31-4b5b-b3cd-8ef723f945e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:52.175796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f3f7d56e-8c31-4b5b-b3cd-8ef723f945e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:52.177522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f3f7d56e-8c31-4b5b-b3cd-8ef723f945e6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.324044 May 10 21:30:52.177522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1677/2453] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:51 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:52.181798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cab415a0-f3b5-4bb5-ae57-f7d592d8ba5f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:52.182404 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cab415a0-f3b5-4bb5-ae57-f7d592d8ba5f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:52.188445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cab415a0-f3b5-4bb5-ae57-f7d592d8ba5f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:52.188895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cab415a0-f3b5-4bb5-ae57-f7d592d8ba5f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:52.189662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cab415a0-f3b5-4bb5-ae57-f7d592d8ba5f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:52.190098 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cab415a0-f3b5-4bb5-ae57-f7d592d8ba5f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:52.249385 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cab415a0-f3b5-4bb5-ae57-f7d592d8ba5f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:52.256647 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cab415a0-f3b5-4bb5-ae57-f7d592d8ba5f tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078244 May 10 21:30:52.257216 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1678/2454] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:52 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:53.195343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-55b72c77-d764-4419-85b6-9741aff3f170 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:53.196036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-55b72c77-d764-4419-85b6-9741aff3f170 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:53.202996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-55b72c77-d764-4419-85b6-9741aff3f170 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:53.203473 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-55b72c77-d764-4419-85b6-9741aff3f170 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:53.204240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-55b72c77-d764-4419-85b6-9741aff3f170 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:53.204679 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-55b72c77-d764-4419-85b6-9741aff3f170 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:53.264182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-55b72c77-d764-4419-85b6-9741aff3f170 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:53.272263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-55b72c77-d764-4419-85b6-9741aff3f170 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:53.273780 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-55b72c77-d764-4419-85b6-9741aff3f170 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:53.274921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-55b72c77-d764-4419-85b6-9741aff3f170 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083582 May 10 21:30:53.275526 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1679/2455] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:53 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:53.280097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-762fa846-e219-464b-99b8-ff3654966ec1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:53.280700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-762fa846-e219-464b-99b8-ff3654966ec1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:53.286259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-762fa846-e219-464b-99b8-ff3654966ec1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:53.286709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-762fa846-e219-464b-99b8-ff3654966ec1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:53.287511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-762fa846-e219-464b-99b8-ff3654966ec1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:53.287952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-762fa846-e219-464b-99b8-ff3654966ec1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:53.347557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-762fa846-e219-464b-99b8-ff3654966ec1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:53.354793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-762fa846-e219-464b-99b8-ff3654966ec1 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078341 May 10 21:30:53.355388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1680/2456] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:53 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:54.293619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-28269634-3ed0-43e6-b6a3-26b62181b71d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:54.294442 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-28269634-3ed0-43e6-b6a3-26b62181b71d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:54.301131 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28269634-3ed0-43e6-b6a3-26b62181b71d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:54.301593 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28269634-3ed0-43e6-b6a3-26b62181b71d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:54.302346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28269634-3ed0-43e6-b6a3-26b62181b71d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:54.302781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28269634-3ed0-43e6-b6a3-26b62181b71d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:54.364670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-28269634-3ed0-43e6-b6a3-26b62181b71d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:54.373659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-28269634-3ed0-43e6-b6a3-26b62181b71d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:54.375186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-28269634-3ed0-43e6-b6a3-26b62181b71d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:54.376320 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-28269634-3ed0-43e6-b6a3-26b62181b71d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087181 May 10 21:30:54.376880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1681/2457] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:54 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:54.381280 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cd12797b-d641-4f58-b54f-116f20918dc9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:54.381876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cd12797b-d641-4f58-b54f-116f20918dc9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:54.387560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd12797b-d641-4f58-b54f-116f20918dc9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:54.387951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd12797b-d641-4f58-b54f-116f20918dc9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:54.388709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd12797b-d641-4f58-b54f-116f20918dc9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:54.389148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd12797b-d641-4f58-b54f-116f20918dc9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:54.451384 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cd12797b-d641-4f58-b54f-116f20918dc9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:54.458876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cd12797b-d641-4f58-b54f-116f20918dc9 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081011 May 10 21:30:54.459473 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1682/2458] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:54 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:55.394748 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-74af14c6-ee80-483b-a02c-117680eda067 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:55.395428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-74af14c6-ee80-483b-a02c-117680eda067 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:55.401696 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74af14c6-ee80-483b-a02c-117680eda067 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:55.402154 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74af14c6-ee80-483b-a02c-117680eda067 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:55.403503 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74af14c6-ee80-483b-a02c-117680eda067 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:55.403942 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74af14c6-ee80-483b-a02c-117680eda067 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:55.462559 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-74af14c6-ee80-483b-a02c-117680eda067 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:55.471319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-74af14c6-ee80-483b-a02c-117680eda067 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:55.472829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-74af14c6-ee80-483b-a02c-117680eda067 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:55.473967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-74af14c6-ee80-483b-a02c-117680eda067 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083174 May 10 21:30:55.474523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1683/2459] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:55 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:55.478853 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6a147cf1-15d5-4915-bced-60a7c1b7a800 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:55.479487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6a147cf1-15d5-4915-bced-60a7c1b7a800 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:55.486055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a147cf1-15d5-4915-bced-60a7c1b7a800 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:55.486518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a147cf1-15d5-4915-bced-60a7c1b7a800 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:55.487325 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a147cf1-15d5-4915-bced-60a7c1b7a800 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:55.487759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a147cf1-15d5-4915-bced-60a7c1b7a800 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:55.546077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6a147cf1-15d5-4915-bced-60a7c1b7a800 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:55.553289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6a147cf1-15d5-4915-bced-60a7c1b7a800 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.077848 May 10 21:30:55.553843 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1684/2460] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:55 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:56.492909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ec4d48da-c629-4c8a-9daf-27e43e7fc789 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:56.493573 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ec4d48da-c629-4c8a-9daf-27e43e7fc789 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:56.499951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec4d48da-c629-4c8a-9daf-27e43e7fc789 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:56.500399 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec4d48da-c629-4c8a-9daf-27e43e7fc789 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:56.501158 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec4d48da-c629-4c8a-9daf-27e43e7fc789 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:56.501610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec4d48da-c629-4c8a-9daf-27e43e7fc789 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:56.563887 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ec4d48da-c629-4c8a-9daf-27e43e7fc789 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:56.572170 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ec4d48da-c629-4c8a-9daf-27e43e7fc789 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:56.573668 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ec4d48da-c629-4c8a-9daf-27e43e7fc789 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:56.575367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ec4d48da-c629-4c8a-9daf-27e43e7fc789 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086284 May 10 21:30:56.575924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1685/2461] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:56 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:56.580414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-aaed66c9-6fcd-43a3-a581-1f328eec70ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:56.581029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-aaed66c9-6fcd-43a3-a581-1f328eec70ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:56.586664 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aaed66c9-6fcd-43a3-a581-1f328eec70ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:56.587177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aaed66c9-6fcd-43a3-a581-1f328eec70ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:56.587901 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aaed66c9-6fcd-43a3-a581-1f328eec70ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:56.588335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aaed66c9-6fcd-43a3-a581-1f328eec70ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:56.647703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-aaed66c9-6fcd-43a3-a581-1f328eec70ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:56.656007 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-aaed66c9-6fcd-43a3-a581-1f328eec70ce tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079094 May 10 21:30:56.656571 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1686/2462] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:56 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:57.593780 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ef98faf7-f356-407f-899c-495879c03b48 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:57.594394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ef98faf7-f356-407f-899c-495879c03b48 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:57.600885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ef98faf7-f356-407f-899c-495879c03b48 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:57.604406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ef98faf7-f356-407f-899c-495879c03b48 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:57.604406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ef98faf7-f356-407f-899c-495879c03b48 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:57.604406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ef98faf7-f356-407f-899c-495879c03b48 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:57.663739 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ef98faf7-f356-407f-899c-495879c03b48 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:57.672143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ef98faf7-f356-407f-899c-495879c03b48 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:57.673636 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ef98faf7-f356-407f-899c-495879c03b48 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:57.674768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ef98faf7-f356-407f-899c-495879c03b48 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085493 May 10 21:30:57.675361 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1687/2463] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:57 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:57.679652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e182027d-9da2-4273-911c-66eb0b9ed74c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:57.680275 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e182027d-9da2-4273-911c-66eb0b9ed74c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:57.686344 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e182027d-9da2-4273-911c-66eb0b9ed74c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:57.686722 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e182027d-9da2-4273-911c-66eb0b9ed74c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:57.687504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e182027d-9da2-4273-911c-66eb0b9ed74c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:57.687938 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e182027d-9da2-4273-911c-66eb0b9ed74c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:57.747434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e182027d-9da2-4273-911c-66eb0b9ed74c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:57.754719 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e182027d-9da2-4273-911c-66eb0b9ed74c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078429 May 10 21:30:57.755303 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1688/2464] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:57 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:58.693081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b0a33210-341c-47db-8990-7fc90539130e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:58.693694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b0a33210-341c-47db-8990-7fc90539130e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:58.700692 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b0a33210-341c-47db-8990-7fc90539130e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:58.701164 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b0a33210-341c-47db-8990-7fc90539130e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:58.701928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b0a33210-341c-47db-8990-7fc90539130e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:58.702363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b0a33210-341c-47db-8990-7fc90539130e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:58.766238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b0a33210-341c-47db-8990-7fc90539130e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:58.774714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b0a33210-341c-47db-8990-7fc90539130e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:58.776266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b0a33210-341c-47db-8990-7fc90539130e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:58.777633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b0a33210-341c-47db-8990-7fc90539130e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.088282 May 10 21:30:58.778611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1689/2465] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:58 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:58.783030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a65b30c0-27e7-4785-933e-d28261e6185e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:58.783667 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a65b30c0-27e7-4785-933e-d28261e6185e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:58.789513 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a65b30c0-27e7-4785-933e-d28261e6185e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:58.789998 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a65b30c0-27e7-4785-933e-d28261e6185e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:58.790798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a65b30c0-27e7-4785-933e-d28261e6185e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:58.791327 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a65b30c0-27e7-4785-933e-d28261e6185e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:58.852517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a65b30c0-27e7-4785-933e-d28261e6185e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:58.860983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a65b30c0-27e7-4785-933e-d28261e6185e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081363 May 10 21:30:58.861503 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1690/2466] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:58 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:30:59.796456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3ccbd309-12e5-4080-923e-dd19eaf6875c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:59.797097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3ccbd309-12e5-4080-923e-dd19eaf6875c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:59.803401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ccbd309-12e5-4080-923e-dd19eaf6875c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:59.803854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ccbd309-12e5-4080-923e-dd19eaf6875c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:59.804624 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ccbd309-12e5-4080-923e-dd19eaf6875c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:59.805062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ccbd309-12e5-4080-923e-dd19eaf6875c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:59.865856 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3ccbd309-12e5-4080-923e-dd19eaf6875c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:59.875095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3ccbd309-12e5-4080-923e-dd19eaf6875c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:59.876644 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3ccbd309-12e5-4080-923e-dd19eaf6875c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:59.877794 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3ccbd309-12e5-4080-923e-dd19eaf6875c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085818 May 10 21:30:59.878356 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1691/2467] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:30:59 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:30:59.882662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fb421855-a4a4-4fda-9c05-06b4c9fe7b35 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:30:59.883296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fb421855-a4a4-4fda-9c05-06b4c9fe7b35 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:30:59.890228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb421855-a4a4-4fda-9c05-06b4c9fe7b35 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:59.890681 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb421855-a4a4-4fda-9c05-06b4c9fe7b35 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:59.891499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb421855-a4a4-4fda-9c05-06b4c9fe7b35 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:30:59.891968 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb421855-a4a4-4fda-9c05-06b4c9fe7b35 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:30:59.951944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fb421855-a4a4-4fda-9c05-06b4c9fe7b35 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:30:59.959497 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fb421855-a4a4-4fda-9c05-06b4c9fe7b35 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080192 May 10 21:30:59.960065 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1692/2468] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:30:59 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:00.896966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f11101f0-3e1f-4afa-ae6e-dbdd86356087 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:00.897659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f11101f0-3e1f-4afa-ae6e-dbdd86356087 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:00.905076 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f11101f0-3e1f-4afa-ae6e-dbdd86356087 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:00.905530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f11101f0-3e1f-4afa-ae6e-dbdd86356087 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:00.906294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f11101f0-3e1f-4afa-ae6e-dbdd86356087 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:00.906737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f11101f0-3e1f-4afa-ae6e-dbdd86356087 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:00.969482 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f11101f0-3e1f-4afa-ae6e-dbdd86356087 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:00.977975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f11101f0-3e1f-4afa-ae6e-dbdd86356087 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:00.979507 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f11101f0-3e1f-4afa-ae6e-dbdd86356087 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:00.981570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f11101f0-3e1f-4afa-ae6e-dbdd86356087 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087793 May 10 21:31:00.982138 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1693/2469] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:00 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:00.986527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7f492876-864a-46f3-889d-0417a55a3f75 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:00.987203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7f492876-864a-46f3-889d-0417a55a3f75 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:00.993146 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7f492876-864a-46f3-889d-0417a55a3f75 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:00.993601 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7f492876-864a-46f3-889d-0417a55a3f75 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:00.994431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7f492876-864a-46f3-889d-0417a55a3f75 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:00.994895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7f492876-864a-46f3-889d-0417a55a3f75 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:01.053884 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7f492876-864a-46f3-889d-0417a55a3f75 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:01.061158 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7f492876-864a-46f3-889d-0417a55a3f75 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078054 May 10 21:31:01.061719 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1694/2470] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:00 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:02.000203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-de32fad8-2215-4c64-adf9-0ce87a68e826 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:02.000853 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-de32fad8-2215-4c64-adf9-0ce87a68e826 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:02.007032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de32fad8-2215-4c64-adf9-0ce87a68e826 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:02.007518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de32fad8-2215-4c64-adf9-0ce87a68e826 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:02.008281 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de32fad8-2215-4c64-adf9-0ce87a68e826 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:02.008723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de32fad8-2215-4c64-adf9-0ce87a68e826 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:02.068261 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-de32fad8-2215-4c64-adf9-0ce87a68e826 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:02.077025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-de32fad8-2215-4c64-adf9-0ce87a68e826 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:02.078530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-de32fad8-2215-4c64-adf9-0ce87a68e826 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:02.079701 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-de32fad8-2215-4c64-adf9-0ce87a68e826 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083708 May 10 21:31:02.080257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1695/2471] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:01 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:02.084789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d0267ef8-33fc-4ac4-bd30-5b26042d9bca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:02.085387 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d0267ef8-33fc-4ac4-bd30-5b26042d9bca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:02.092214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0267ef8-33fc-4ac4-bd30-5b26042d9bca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:02.092670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0267ef8-33fc-4ac4-bd30-5b26042d9bca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:02.093440 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0267ef8-33fc-4ac4-bd30-5b26042d9bca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:02.093880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0267ef8-33fc-4ac4-bd30-5b26042d9bca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:02.158976 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d0267ef8-33fc-4ac4-bd30-5b26042d9bca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:02.166613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d0267ef8-33fc-4ac4-bd30-5b26042d9bca tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.085405 May 10 21:31:02.167209 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1696/2472] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:02 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:03.097634 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5b93a4c7-c80c-4df5-941b-7d8dbba3b7f6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:03.098324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5b93a4c7-c80c-4df5-941b-7d8dbba3b7f6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:03.104590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b93a4c7-c80c-4df5-941b-7d8dbba3b7f6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:03.105046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b93a4c7-c80c-4df5-941b-7d8dbba3b7f6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:03.106891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b93a4c7-c80c-4df5-941b-7d8dbba3b7f6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:03.107362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b93a4c7-c80c-4df5-941b-7d8dbba3b7f6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:03.170884 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5b93a4c7-c80c-4df5-941b-7d8dbba3b7f6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:03.179164 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5b93a4c7-c80c-4df5-941b-7d8dbba3b7f6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:03.180687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5b93a4c7-c80c-4df5-941b-7d8dbba3b7f6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:03.181830 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5b93a4c7-c80c-4df5-941b-7d8dbba3b7f6 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.088159 May 10 21:31:03.182389 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1697/2473] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:03 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:03.187098 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2ad5c36a-561d-4728-a700-1bfda69a4369 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:03.187727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2ad5c36a-561d-4728-a700-1bfda69a4369 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:03.193425 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ad5c36a-561d-4728-a700-1bfda69a4369 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:03.193880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ad5c36a-561d-4728-a700-1bfda69a4369 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:03.194640 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ad5c36a-561d-4728-a700-1bfda69a4369 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:03.195081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ad5c36a-561d-4728-a700-1bfda69a4369 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:03.255672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2ad5c36a-561d-4728-a700-1bfda69a4369 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:03.263453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2ad5c36a-561d-4728-a700-1bfda69a4369 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080097 May 10 21:31:03.264022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1698/2474] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:03 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:04.199063 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-05f8053d-2b4f-40a3-a289-f18616d394af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:04.200479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-05f8053d-2b4f-40a3-a289-f18616d394af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:04.206531 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-05f8053d-2b4f-40a3-a289-f18616d394af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:04.206985 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-05f8053d-2b4f-40a3-a289-f18616d394af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:04.208048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-05f8053d-2b4f-40a3-a289-f18616d394af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:04.208493 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-05f8053d-2b4f-40a3-a289-f18616d394af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:04.265220 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:31:04.266977 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Tue May 10 21:31:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 (ip 10.222.0.49) !!! May 10 21:31:04.268380 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-05f8053d-2b4f-40a3-a289-f18616d394af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:04.279563 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-05f8053d-2b4f-40a3-a289-f18616d394af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:04.281452 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-05f8053d-2b4f-40a3-a289-f18616d394af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:04.282590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-05f8053d-2b4f-40a3-a289-f18616d394af tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087534 May 10 21:31:04.283172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1699/2475] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:04 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:04.287474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-478eb669-3db7-4c4c-b48d-371fe06e8066 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:04.288071 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-478eb669-3db7-4c4c-b48d-371fe06e8066 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:04.293916 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-478eb669-3db7-4c4c-b48d-371fe06e8066 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:04.294359 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-478eb669-3db7-4c4c-b48d-371fe06e8066 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:04.295114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-478eb669-3db7-4c4c-b48d-371fe06e8066 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:04.295646 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-478eb669-3db7-4c4c-b48d-371fe06e8066 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:04.354236 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-478eb669-3db7-4c4c-b48d-371fe06e8066 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:04.362168 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-478eb669-3db7-4c4c-b48d-371fe06e8066 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078078 May 10 21:31:04.362731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1700/2476] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:04 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:05.300358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d9b3984a-148b-480a-9623-ee5d28bb9a19 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:05.300985 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d9b3984a-148b-480a-9623-ee5d28bb9a19 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:05.307411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d9b3984a-148b-480a-9623-ee5d28bb9a19 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:05.307869 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d9b3984a-148b-480a-9623-ee5d28bb9a19 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:05.309158 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d9b3984a-148b-480a-9623-ee5d28bb9a19 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:05.309602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d9b3984a-148b-480a-9623-ee5d28bb9a19 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:05.373489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d9b3984a-148b-480a-9623-ee5d28bb9a19 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:05.381595 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d9b3984a-148b-480a-9623-ee5d28bb9a19 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:05.383107 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d9b3984a-148b-480a-9623-ee5d28bb9a19 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:05.384272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d9b3984a-148b-480a-9623-ee5d28bb9a19 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087857 May 10 21:31:05.384835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1701/2477] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:05 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:05.389707 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4178f2e2-983b-4107-ae22-39d46af6766a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:05.390311 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4178f2e2-983b-4107-ae22-39d46af6766a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:05.395784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4178f2e2-983b-4107-ae22-39d46af6766a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:05.396235 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4178f2e2-983b-4107-ae22-39d46af6766a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:05.396994 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4178f2e2-983b-4107-ae22-39d46af6766a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:05.397431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4178f2e2-983b-4107-ae22-39d46af6766a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:05.456990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4178f2e2-983b-4107-ae22-39d46af6766a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:05.464451 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4178f2e2-983b-4107-ae22-39d46af6766a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078695 May 10 21:31:05.465244 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1702/2478] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:05 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:05.644795 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:31:05.644932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Tue May 10 21:31:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 21:31:06.403584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-042badda-0aa9-4d21-8288-c0ebbb6b0721 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:06.404236 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-042badda-0aa9-4d21-8288-c0ebbb6b0721 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:06.410594 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-042badda-0aa9-4d21-8288-c0ebbb6b0721 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:06.411041 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-042badda-0aa9-4d21-8288-c0ebbb6b0721 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:06.411825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-042badda-0aa9-4d21-8288-c0ebbb6b0721 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:06.412259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-042badda-0aa9-4d21-8288-c0ebbb6b0721 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:06.473024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-042badda-0aa9-4d21-8288-c0ebbb6b0721 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:06.481366 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-042badda-0aa9-4d21-8288-c0ebbb6b0721 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:06.482869 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-042badda-0aa9-4d21-8288-c0ebbb6b0721 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:06.484034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-042badda-0aa9-4d21-8288-c0ebbb6b0721 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084975 May 10 21:31:06.484586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1703/2479] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:06 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:06.488895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-58eff175-5cb4-4fb0-b773-4462710f316b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:06.489493 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-58eff175-5cb4-4fb0-b773-4462710f316b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:06.494969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-58eff175-5cb4-4fb0-b773-4462710f316b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:06.495455 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-58eff175-5cb4-4fb0-b773-4462710f316b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:06.496217 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-58eff175-5cb4-4fb0-b773-4462710f316b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:06.496921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-58eff175-5cb4-4fb0-b773-4462710f316b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:06.555539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-58eff175-5cb4-4fb0-b773-4462710f316b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:06.562759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-58eff175-5cb4-4fb0-b773-4462710f316b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.077253 May 10 21:31:06.563430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1704/2480] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:06 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:07.501963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7266c975-5b5e-43bd-9f3c-4c149b1b18e0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:07.502644 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7266c975-5b5e-43bd-9f3c-4c149b1b18e0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:07.508896 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7266c975-5b5e-43bd-9f3c-4c149b1b18e0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:07.509354 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7266c975-5b5e-43bd-9f3c-4c149b1b18e0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:07.510116 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7266c975-5b5e-43bd-9f3c-4c149b1b18e0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:07.510556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7266c975-5b5e-43bd-9f3c-4c149b1b18e0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:07.573060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7266c975-5b5e-43bd-9f3c-4c149b1b18e0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:07.581320 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7266c975-5b5e-43bd-9f3c-4c149b1b18e0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:07.583080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7266c975-5b5e-43bd-9f3c-4c149b1b18e0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:07.584247 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7266c975-5b5e-43bd-9f3c-4c149b1b18e0 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086308 May 10 21:31:07.584819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1705/2481] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:07 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:07.589086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-eacdc0d6-42f9-4082-b645-e5db7fe42bbf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:07.589687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-eacdc0d6-42f9-4082-b645-e5db7fe42bbf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:07.596040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eacdc0d6-42f9-4082-b645-e5db7fe42bbf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:07.596489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eacdc0d6-42f9-4082-b645-e5db7fe42bbf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:07.597250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eacdc0d6-42f9-4082-b645-e5db7fe42bbf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:07.597683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eacdc0d6-42f9-4082-b645-e5db7fe42bbf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:07.658932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-eacdc0d6-42f9-4082-b645-e5db7fe42bbf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:07.666377 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-eacdc0d6-42f9-4082-b645-e5db7fe42bbf tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080621 May 10 21:31:07.666934 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1706/2482] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:07 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:08.602909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-60869564-1262-44bf-a387-c452e550df5a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:08.603608 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-60869564-1262-44bf-a387-c452e550df5a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:08.610686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-60869564-1262-44bf-a387-c452e550df5a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:08.611162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-60869564-1262-44bf-a387-c452e550df5a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:08.611939 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-60869564-1262-44bf-a387-c452e550df5a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:08.612383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-60869564-1262-44bf-a387-c452e550df5a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:08.673454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-60869564-1262-44bf-a387-c452e550df5a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:08.681708 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-60869564-1262-44bf-a387-c452e550df5a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:08.683241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-60869564-1262-44bf-a387-c452e550df5a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:08.685259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-60869564-1262-44bf-a387-c452e550df5a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086385 May 10 21:31:08.685813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1707/2483] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:08 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:08.690138 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c9eead05-82d1-4171-8dcd-8aed43d2ccec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:08.690742 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c9eead05-82d1-4171-8dcd-8aed43d2ccec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:08.696450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9eead05-82d1-4171-8dcd-8aed43d2ccec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:08.696908 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9eead05-82d1-4171-8dcd-8aed43d2ccec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:08.697677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9eead05-82d1-4171-8dcd-8aed43d2ccec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:08.698122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9eead05-82d1-4171-8dcd-8aed43d2ccec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:08.757500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c9eead05-82d1-4171-8dcd-8aed43d2ccec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:08.764910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c9eead05-82d1-4171-8dcd-8aed43d2ccec tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078132 May 10 21:31:08.765477 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1708/2484] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:08 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:09.703639 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-33ed214e-bf02-4602-b376-2266d98206c2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:09.704285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-33ed214e-bf02-4602-b376-2266d98206c2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:09.710854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-33ed214e-bf02-4602-b376-2266d98206c2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:09.711348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-33ed214e-bf02-4602-b376-2266d98206c2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:09.712114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-33ed214e-bf02-4602-b376-2266d98206c2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:09.712554 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-33ed214e-bf02-4602-b376-2266d98206c2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:09.774739 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-33ed214e-bf02-4602-b376-2266d98206c2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:09.783406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-33ed214e-bf02-4602-b376-2266d98206c2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:09.784924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-33ed214e-bf02-4602-b376-2266d98206c2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:09.786077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-33ed214e-bf02-4602-b376-2266d98206c2 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086993 May 10 21:31:09.786635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1709/2485] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:09 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:09.791013 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2da2eb9b-496a-456f-bac3-678c8119c16e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:09.791709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2da2eb9b-496a-456f-bac3-678c8119c16e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:09.797449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2da2eb9b-496a-456f-bac3-678c8119c16e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:09.798006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2da2eb9b-496a-456f-bac3-678c8119c16e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:09.798779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2da2eb9b-496a-456f-bac3-678c8119c16e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:09.799247 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2da2eb9b-496a-456f-bac3-678c8119c16e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:09.858527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2da2eb9b-496a-456f-bac3-678c8119c16e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:09.865778 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2da2eb9b-496a-456f-bac3-678c8119c16e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078195 May 10 21:31:09.866349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1710/2486] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:09 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:10.804161 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f4ee1af1-3480-4c30-9986-b57e19318cf4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:10.804772 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f4ee1af1-3480-4c30-9986-b57e19318cf4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:10.811448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4ee1af1-3480-4c30-9986-b57e19318cf4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:10.811897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4ee1af1-3480-4c30-9986-b57e19318cf4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:10.812658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4ee1af1-3480-4c30-9986-b57e19318cf4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:10.813087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4ee1af1-3480-4c30-9986-b57e19318cf4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:10.874108 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f4ee1af1-3480-4c30-9986-b57e19318cf4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:10.882450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f4ee1af1-3480-4c30-9986-b57e19318cf4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:10.883971 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f4ee1af1-3480-4c30-9986-b57e19318cf4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:10.885175 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f4ee1af1-3480-4c30-9986-b57e19318cf4 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085003 May 10 21:31:10.885720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1711/2487] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:10 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:10.890982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d1c6ad20-0989-4705-8f34-d0f81e67dd0d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:10.891610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d1c6ad20-0989-4705-8f34-d0f81e67dd0d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:10.897611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d1c6ad20-0989-4705-8f34-d0f81e67dd0d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:10.898088 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d1c6ad20-0989-4705-8f34-d0f81e67dd0d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:10.898910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d1c6ad20-0989-4705-8f34-d0f81e67dd0d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:10.899372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d1c6ad20-0989-4705-8f34-d0f81e67dd0d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:10.960181 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d1c6ad20-0989-4705-8f34-d0f81e67dd0d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:10.968182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d1c6ad20-0989-4705-8f34-d0f81e67dd0d tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081546 May 10 21:31:10.968733 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1712/2488] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:10 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:11.903975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cafa9470-bb29-44c6-adf5-c669af28a606 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:11.904562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cafa9470-bb29-44c6-adf5-c669af28a606 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:11.910981 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cafa9470-bb29-44c6-adf5-c669af28a606 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:11.911460 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cafa9470-bb29-44c6-adf5-c669af28a606 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:11.912226 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cafa9470-bb29-44c6-adf5-c669af28a606 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:11.912662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cafa9470-bb29-44c6-adf5-c669af28a606 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:11.976411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cafa9470-bb29-44c6-adf5-c669af28a606 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:11.984750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cafa9470-bb29-44c6-adf5-c669af28a606 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:11.986253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cafa9470-bb29-44c6-adf5-c669af28a606 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:11.987423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cafa9470-bb29-44c6-adf5-c669af28a606 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087692 May 10 21:31:11.987974 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1713/2489] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:11 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:11.992233 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-124aa5ff-352f-4ad1-985b-6a46ee910e12 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:11.992829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-124aa5ff-352f-4ad1-985b-6a46ee910e12 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:11.998914 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-124aa5ff-352f-4ad1-985b-6a46ee910e12 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:11.999385 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-124aa5ff-352f-4ad1-985b-6a46ee910e12 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:12.000142 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-124aa5ff-352f-4ad1-985b-6a46ee910e12 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:12.000577 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-124aa5ff-352f-4ad1-985b-6a46ee910e12 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:12.061294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-124aa5ff-352f-4ad1-985b-6a46ee910e12 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:12.068479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-124aa5ff-352f-4ad1-985b-6a46ee910e12 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079596 May 10 21:31:12.069027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1714/2490] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:11 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:13.005916 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3a87157f-951e-44af-a7cb-7626b3f46ab5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:13.006554 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3a87157f-951e-44af-a7cb-7626b3f46ab5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:13.012925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3a87157f-951e-44af-a7cb-7626b3f46ab5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:13.013374 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3a87157f-951e-44af-a7cb-7626b3f46ab5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:13.014136 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3a87157f-951e-44af-a7cb-7626b3f46ab5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:13.014571 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3a87157f-951e-44af-a7cb-7626b3f46ab5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:13.075636 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3a87157f-951e-44af-a7cb-7626b3f46ab5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:13.084297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3a87157f-951e-44af-a7cb-7626b3f46ab5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:13.085805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3a87157f-951e-44af-a7cb-7626b3f46ab5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:13.086941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3a87157f-951e-44af-a7cb-7626b3f46ab5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085109 May 10 21:31:13.087530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1715/2491] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:13 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:13.092449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-67db053a-58e4-40c1-8eec-8c4d18126310 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:13.093053 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-67db053a-58e4-40c1-8eec-8c4d18126310 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:13.098679 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-67db053a-58e4-40c1-8eec-8c4d18126310 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:13.099149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-67db053a-58e4-40c1-8eec-8c4d18126310 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:13.099925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-67db053a-58e4-40c1-8eec-8c4d18126310 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:13.100369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-67db053a-58e4-40c1-8eec-8c4d18126310 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:13.159163 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-67db053a-58e4-40c1-8eec-8c4d18126310 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:13.166298 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-67db053a-58e4-40c1-8eec-8c4d18126310 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.077843 May 10 21:31:13.166857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1716/2492] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:13 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:14.105441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1b229d85-5dc4-4019-ba0b-3bf0f31df68d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:14.111759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1b229d85-5dc4-4019-ba0b-3bf0f31df68d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:14.113215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1b229d85-5dc4-4019-ba0b-3bf0f31df68d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:14.113664 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1b229d85-5dc4-4019-ba0b-3bf0f31df68d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:14.114426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1b229d85-5dc4-4019-ba0b-3bf0f31df68d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:14.114859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1b229d85-5dc4-4019-ba0b-3bf0f31df68d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:14.177426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1b229d85-5dc4-4019-ba0b-3bf0f31df68d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:14.185804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1b229d85-5dc4-4019-ba0b-3bf0f31df68d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:14.187332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1b229d85-5dc4-4019-ba0b-3bf0f31df68d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:14.188487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1b229d85-5dc4-4019-ba0b-3bf0f31df68d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087155 May 10 21:31:14.189019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1717/2493] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:14 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:14.193283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5a631a88-ed10-4032-b71a-b79c87107c18 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:14.193884 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5a631a88-ed10-4032-b71a-b79c87107c18 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:14.199236 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5a631a88-ed10-4032-b71a-b79c87107c18 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:14.199931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5a631a88-ed10-4032-b71a-b79c87107c18 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:14.200466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5a631a88-ed10-4032-b71a-b79c87107c18 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:14.200900 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5a631a88-ed10-4032-b71a-b79c87107c18 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:14.260161 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5a631a88-ed10-4032-b71a-b79c87107c18 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:14.267274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5a631a88-ed10-4032-b71a-b79c87107c18 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.077308 May 10 21:31:14.267831 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1718/2494] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:14 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:15.206859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ba78619c-476d-4241-ae87-9b61fda44da5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:15.207823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ba78619c-476d-4241-ae87-9b61fda44da5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:15.214131 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ba78619c-476d-4241-ae87-9b61fda44da5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:15.214598 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ba78619c-476d-4241-ae87-9b61fda44da5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:15.215497 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ba78619c-476d-4241-ae87-9b61fda44da5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:15.215901 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ba78619c-476d-4241-ae87-9b61fda44da5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:15.277200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ba78619c-476d-4241-ae87-9b61fda44da5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:15.285669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ba78619c-476d-4241-ae87-9b61fda44da5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:15.287182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ba78619c-476d-4241-ae87-9b61fda44da5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:15.288310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ba78619c-476d-4241-ae87-9b61fda44da5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085765 May 10 21:31:15.288862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1719/2495] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:15 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:15.293793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-81ca6b82-ff98-4946-99e9-b2cb4c49843b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:15.294390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-81ca6b82-ff98-4946-99e9-b2cb4c49843b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:15.299823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-81ca6b82-ff98-4946-99e9-b2cb4c49843b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:15.300270 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-81ca6b82-ff98-4946-99e9-b2cb4c49843b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:15.301026 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-81ca6b82-ff98-4946-99e9-b2cb4c49843b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:15.301459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-81ca6b82-ff98-4946-99e9-b2cb4c49843b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:15.360600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-81ca6b82-ff98-4946-99e9-b2cb4c49843b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:15.367820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-81ca6b82-ff98-4946-99e9-b2cb4c49843b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078045 May 10 21:31:15.368389 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1720/2496] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:15 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:16.306990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-595360b4-3880-4556-b483-1879fc607b3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:16.307676 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-595360b4-3880-4556-b483-1879fc607b3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:16.314146 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-595360b4-3880-4556-b483-1879fc607b3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:16.314673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-595360b4-3880-4556-b483-1879fc607b3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:16.315482 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-595360b4-3880-4556-b483-1879fc607b3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:16.315925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-595360b4-3880-4556-b483-1879fc607b3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:16.378197 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-595360b4-3880-4556-b483-1879fc607b3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:16.386742 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-595360b4-3880-4556-b483-1879fc607b3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:16.389318 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-595360b4-3880-4556-b483-1879fc607b3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:16.390452 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-595360b4-3880-4556-b483-1879fc607b3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087415 May 10 21:31:16.391003 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1721/2497] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:16 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:16.395372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-89bda1e5-eed8-4701-9575-1dd0aa456e92 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:16.395970 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-89bda1e5-eed8-4701-9575-1dd0aa456e92 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:16.401481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89bda1e5-eed8-4701-9575-1dd0aa456e92 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:16.401930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89bda1e5-eed8-4701-9575-1dd0aa456e92 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:16.402732 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89bda1e5-eed8-4701-9575-1dd0aa456e92 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:16.403241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89bda1e5-eed8-4701-9575-1dd0aa456e92 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:16.463171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-89bda1e5-eed8-4701-9575-1dd0aa456e92 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:16.470583 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-89bda1e5-eed8-4701-9575-1dd0aa456e92 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078626 May 10 21:31:16.471167 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1722/2498] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:16 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:17.409041 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-26142a7e-dbb1-4c6d-8ec1-3c96ad40dd03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:17.409693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-26142a7e-dbb1-4c6d-8ec1-3c96ad40dd03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:17.416087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-26142a7e-dbb1-4c6d-8ec1-3c96ad40dd03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:17.416539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-26142a7e-dbb1-4c6d-8ec1-3c96ad40dd03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:17.417304 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-26142a7e-dbb1-4c6d-8ec1-3c96ad40dd03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:17.417743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-26142a7e-dbb1-4c6d-8ec1-3c96ad40dd03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:17.480157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-26142a7e-dbb1-4c6d-8ec1-3c96ad40dd03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:17.489400 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-26142a7e-dbb1-4c6d-8ec1-3c96ad40dd03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:17.490910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-26142a7e-dbb1-4c6d-8ec1-3c96ad40dd03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:17.492084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-26142a7e-dbb1-4c6d-8ec1-3c96ad40dd03 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087076 May 10 21:31:17.492637 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1723/2499] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:17 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:17.496988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e91be8f5-eb99-4dcc-b169-b2af399c542c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:17.497584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e91be8f5-eb99-4dcc-b169-b2af399c542c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:17.503232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e91be8f5-eb99-4dcc-b169-b2af399c542c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:17.503683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e91be8f5-eb99-4dcc-b169-b2af399c542c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:17.504446 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e91be8f5-eb99-4dcc-b169-b2af399c542c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:17.504884 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e91be8f5-eb99-4dcc-b169-b2af399c542c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:17.568412 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e91be8f5-eb99-4dcc-b169-b2af399c542c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:17.575781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e91be8f5-eb99-4dcc-b169-b2af399c542c tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082217 May 10 21:31:17.576341 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1724/2500] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:17 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:18.510353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c10de22f-b613-44eb-9658-184cdcb7be25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:18.511035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c10de22f-b613-44eb-9658-184cdcb7be25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:18.518347 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c10de22f-b613-44eb-9658-184cdcb7be25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:18.518798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c10de22f-b613-44eb-9658-184cdcb7be25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:18.519593 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c10de22f-b613-44eb-9658-184cdcb7be25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:18.520034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c10de22f-b613-44eb-9658-184cdcb7be25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:18.580561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c10de22f-b613-44eb-9658-184cdcb7be25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:18.589098 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c10de22f-b613-44eb-9658-184cdcb7be25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:18.591420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c10de22f-b613-44eb-9658-184cdcb7be25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:18.592549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c10de22f-b613-44eb-9658-184cdcb7be25 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086200 May 10 21:31:18.593099 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1725/2501] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:18 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:18.597540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ca53f975-713a-40f2-918e-95f0f40b803a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:18.598166 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ca53f975-713a-40f2-918e-95f0f40b803a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:18.603992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ca53f975-713a-40f2-918e-95f0f40b803a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:18.604437 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ca53f975-713a-40f2-918e-95f0f40b803a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:18.605197 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ca53f975-713a-40f2-918e-95f0f40b803a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:18.605696 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ca53f975-713a-40f2-918e-95f0f40b803a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:18.664621 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ca53f975-713a-40f2-918e-95f0f40b803a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:18.672258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ca53f975-713a-40f2-918e-95f0f40b803a tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078166 May 10 21:31:18.673047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1726/2502] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:18 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:19.610565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1ceeb8e4-d640-4a8e-b581-b72edce0064d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:19.611201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1ceeb8e4-d640-4a8e-b581-b72edce0064d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:19.617576 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1ceeb8e4-d640-4a8e-b581-b72edce0064d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:19.618029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1ceeb8e4-d640-4a8e-b581-b72edce0064d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:19.618831 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1ceeb8e4-d640-4a8e-b581-b72edce0064d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:19.619310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1ceeb8e4-d640-4a8e-b581-b72edce0064d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:19.680099 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1ceeb8e4-d640-4a8e-b581-b72edce0064d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:19.687079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1ceeb8e4-d640-4a8e-b581-b72edce0064d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:19.688622 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1ceeb8e4-d640-4a8e-b581-b72edce0064d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:19.689758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1ceeb8e4-d640-4a8e-b581-b72edce0064d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083165 May 10 21:31:19.690321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1727/2503] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:19 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:19.694615 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-07bafc85-75df-43f8-9594-8c3d67dc26ea tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:19.695245 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-07bafc85-75df-43f8-9594-8c3d67dc26ea tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:19.701020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07bafc85-75df-43f8-9594-8c3d67dc26ea tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:19.701466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07bafc85-75df-43f8-9594-8c3d67dc26ea tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:19.702230 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07bafc85-75df-43f8-9594-8c3d67dc26ea tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:19.702665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07bafc85-75df-43f8-9594-8c3d67dc26ea tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:19.765242 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-07bafc85-75df-43f8-9594-8c3d67dc26ea tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:19.772566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-07bafc85-75df-43f8-9594-8c3d67dc26ea tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081311 May 10 21:31:19.773124 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1728/2504] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:19 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:20.707968 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a28375a0-5dce-41a0-89c8-66639719a72d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:20.708580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a28375a0-5dce-41a0-89c8-66639719a72d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:20.715343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a28375a0-5dce-41a0-89c8-66639719a72d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:20.715808 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a28375a0-5dce-41a0-89c8-66639719a72d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:20.716586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a28375a0-5dce-41a0-89c8-66639719a72d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:20.717028 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a28375a0-5dce-41a0-89c8-66639719a72d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:20.777964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a28375a0-5dce-41a0-89c8-66639719a72d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:20.786342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a28375a0-5dce-41a0-89c8-66639719a72d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:20.787926 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a28375a0-5dce-41a0-89c8-66639719a72d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:20.789083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a28375a0-5dce-41a0-89c8-66639719a72d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085349 May 10 21:31:20.789656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1729/2505] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:20 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:20.794689 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cb659fd7-a180-447a-ace3-e8e54a50ea6e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:20.795335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cb659fd7-a180-447a-ace3-e8e54a50ea6e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:20.801418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb659fd7-a180-447a-ace3-e8e54a50ea6e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:20.801924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb659fd7-a180-447a-ace3-e8e54a50ea6e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:20.802716 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb659fd7-a180-447a-ace3-e8e54a50ea6e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:20.803192 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb659fd7-a180-447a-ace3-e8e54a50ea6e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:20.864839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cb659fd7-a180-447a-ace3-e8e54a50ea6e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:20.872948 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cb659fd7-a180-447a-ace3-e8e54a50ea6e tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082322 May 10 21:31:20.873502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1730/2506] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:20 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:21.807481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-96c4c97b-bdea-4773-8537-fa91bcea2345 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:21.808160 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-96c4c97b-bdea-4773-8537-fa91bcea2345 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:21.815051 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-96c4c97b-bdea-4773-8537-fa91bcea2345 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:21.815540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-96c4c97b-bdea-4773-8537-fa91bcea2345 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:21.816308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-96c4c97b-bdea-4773-8537-fa91bcea2345 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:21.816748 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-96c4c97b-bdea-4773-8537-fa91bcea2345 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:21.879926 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-96c4c97b-bdea-4773-8537-fa91bcea2345 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:21.888613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-96c4c97b-bdea-4773-8537-fa91bcea2345 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:21.890119 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-96c4c97b-bdea-4773-8537-fa91bcea2345 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:21.891329 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-96c4c97b-bdea-4773-8537-fa91bcea2345 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087733 May 10 21:31:21.891891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1731/2507] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:21 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:21.896200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-82e4b830-631e-488e-9d2d-b604c23601b3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:21.896795 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-82e4b830-631e-488e-9d2d-b604c23601b3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:21.903356 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-82e4b830-631e-488e-9d2d-b604c23601b3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:21.903491 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-82e4b830-631e-488e-9d2d-b604c23601b3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:21.904252 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-82e4b830-631e-488e-9d2d-b604c23601b3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:21.904684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-82e4b830-631e-488e-9d2d-b604c23601b3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:21.968222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-82e4b830-631e-488e-9d2d-b604c23601b3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:21.975585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-82e4b830-631e-488e-9d2d-b604c23601b3 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082734 May 10 21:31:21.976148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1732/2508] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:21 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:22.909402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1c2a623f-58c1-4d84-913f-8df2f702fe1e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:22.910050 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1c2a623f-58c1-4d84-913f-8df2f702fe1e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:22.916342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1c2a623f-58c1-4d84-913f-8df2f702fe1e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:22.916788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1c2a623f-58c1-4d84-913f-8df2f702fe1e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:22.917541 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1c2a623f-58c1-4d84-913f-8df2f702fe1e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:22.917990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1c2a623f-58c1-4d84-913f-8df2f702fe1e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:22.978042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1c2a623f-58c1-4d84-913f-8df2f702fe1e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:22.986411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1c2a623f-58c1-4d84-913f-8df2f702fe1e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:22.988038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1c2a623f-58c1-4d84-913f-8df2f702fe1e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:22.989170 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1c2a623f-58c1-4d84-913f-8df2f702fe1e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083691 May 10 21:31:22.989720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1733/2509] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:22 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:22.994241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c6c08e63-f953-4d86-9818-61686045f784 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:22.994837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c6c08e63-f953-4d86-9818-61686045f784 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:23.000467 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c6c08e63-f953-4d86-9818-61686045f784 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:23.000910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c6c08e63-f953-4d86-9818-61686045f784 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:23.001659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c6c08e63-f953-4d86-9818-61686045f784 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:23.002093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c6c08e63-f953-4d86-9818-61686045f784 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:23.061775 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c6c08e63-f953-4d86-9818-61686045f784 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:23.069071 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c6c08e63-f953-4d86-9818-61686045f784 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078380 May 10 21:31:23.069632 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1734/2510] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:22 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:24.007165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3ca13b23-69ee-41d2-a1b6-1febd6fd8751 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:24.007809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3ca13b23-69ee-41d2-a1b6-1febd6fd8751 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:24.014743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ca13b23-69ee-41d2-a1b6-1febd6fd8751 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:24.015232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ca13b23-69ee-41d2-a1b6-1febd6fd8751 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:24.016005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ca13b23-69ee-41d2-a1b6-1febd6fd8751 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:24.016444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ca13b23-69ee-41d2-a1b6-1febd6fd8751 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:24.077842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3ca13b23-69ee-41d2-a1b6-1febd6fd8751 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:24.086540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3ca13b23-69ee-41d2-a1b6-1febd6fd8751 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:24.088088 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3ca13b23-69ee-41d2-a1b6-1febd6fd8751 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:24.089223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3ca13b23-69ee-41d2-a1b6-1febd6fd8751 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086155 May 10 21:31:24.089823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1735/2511] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:24 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:24.094146 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1067c612-2820-4ab2-83d9-48bd89e0f4de tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:24.094783 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1067c612-2820-4ab2-83d9-48bd89e0f4de tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:24.100344 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1067c612-2820-4ab2-83d9-48bd89e0f4de tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:24.100802 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1067c612-2820-4ab2-83d9-48bd89e0f4de tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:24.101577 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1067c612-2820-4ab2-83d9-48bd89e0f4de tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:24.102024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1067c612-2820-4ab2-83d9-48bd89e0f4de tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:24.164853 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1067c612-2820-4ab2-83d9-48bd89e0f4de tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:24.172888 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1067c612-2820-4ab2-83d9-48bd89e0f4de tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082139 May 10 21:31:24.173457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1736/2512] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:24 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:25.107006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-56772aa3-3a31-4226-959a-a01333da6519 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:25.107703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-56772aa3-3a31-4226-959a-a01333da6519 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:25.113940 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-56772aa3-3a31-4226-959a-a01333da6519 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:25.114389 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-56772aa3-3a31-4226-959a-a01333da6519 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:25.115172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-56772aa3-3a31-4226-959a-a01333da6519 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:25.115612 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-56772aa3-3a31-4226-959a-a01333da6519 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:25.175908 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-56772aa3-3a31-4226-959a-a01333da6519 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:25.184839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-56772aa3-3a31-4226-959a-a01333da6519 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:25.186398 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-56772aa3-3a31-4226-959a-a01333da6519 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:25.187574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-56772aa3-3a31-4226-959a-a01333da6519 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.085087 May 10 21:31:25.188141 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1737/2513] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:25 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:25.192512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ed9818f7-2a5e-4fbd-929a-128dadd738ad tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:25.193145 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ed9818f7-2a5e-4fbd-929a-128dadd738ad tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:25.198880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed9818f7-2a5e-4fbd-929a-128dadd738ad tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:25.199372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed9818f7-2a5e-4fbd-929a-128dadd738ad tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:25.200143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed9818f7-2a5e-4fbd-929a-128dadd738ad tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:25.200582 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed9818f7-2a5e-4fbd-929a-128dadd738ad tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:25.260946 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ed9818f7-2a5e-4fbd-929a-128dadd738ad tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:25.268155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ed9818f7-2a5e-4fbd-929a-128dadd738ad tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.079088 May 10 21:31:25.268716 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1738/2514] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:25 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:26.206063 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-953a958b-dd8a-485d-a9d3-5d0802ea6f92 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:26.206759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-953a958b-dd8a-485d-a9d3-5d0802ea6f92 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:26.213363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-953a958b-dd8a-485d-a9d3-5d0802ea6f92 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:26.213807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-953a958b-dd8a-485d-a9d3-5d0802ea6f92 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:26.214562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-953a958b-dd8a-485d-a9d3-5d0802ea6f92 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:26.215986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-953a958b-dd8a-485d-a9d3-5d0802ea6f92 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:26.278717 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-953a958b-dd8a-485d-a9d3-5d0802ea6f92 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:26.287290 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-953a958b-dd8a-485d-a9d3-5d0802ea6f92 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:26.288792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-953a958b-dd8a-485d-a9d3-5d0802ea6f92 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:26.289950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-953a958b-dd8a-485d-a9d3-5d0802ea6f92 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087763 May 10 21:31:26.290517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1739/2515] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:26 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:26.295736 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-241c5a83-4083-4588-b3a7-d430a562d619 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:26.296337 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-241c5a83-4083-4588-b3a7-d430a562d619 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:26.302013 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-241c5a83-4083-4588-b3a7-d430a562d619 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:26.303360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-241c5a83-4083-4588-b3a7-d430a562d619 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:26.303360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-241c5a83-4083-4588-b3a7-d430a562d619 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:26.303671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-241c5a83-4083-4588-b3a7-d430a562d619 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:26.365729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-241c5a83-4083-4588-b3a7-d430a562d619 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:26.373627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-241c5a83-4083-4588-b3a7-d430a562d619 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082181 May 10 21:31:26.374191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1740/2516] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:26 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:27.308763 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-26bc8c63-3001-4269-9fa2-ca64396ac617 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:27.309466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-26bc8c63-3001-4269-9fa2-ca64396ac617 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:27.315951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-26bc8c63-3001-4269-9fa2-ca64396ac617 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:27.316407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-26bc8c63-3001-4269-9fa2-ca64396ac617 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:27.317177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-26bc8c63-3001-4269-9fa2-ca64396ac617 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:27.317618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-26bc8c63-3001-4269-9fa2-ca64396ac617 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:27.379533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-26bc8c63-3001-4269-9fa2-ca64396ac617 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:27.388325 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-26bc8c63-3001-4269-9fa2-ca64396ac617 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:27.389834 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-26bc8c63-3001-4269-9fa2-ca64396ac617 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:27.390984 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-26bc8c63-3001-4269-9fa2-ca64396ac617 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086338 May 10 21:31:27.391580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1741/2517] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:27 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:27.395950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6bd0f62f-20a6-4887-8c82-09802ad9f4ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:27.396556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6bd0f62f-20a6-4887-8c82-09802ad9f4ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:27.402130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6bd0f62f-20a6-4887-8c82-09802ad9f4ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:27.403729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6bd0f62f-20a6-4887-8c82-09802ad9f4ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:27.404520 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6bd0f62f-20a6-4887-8c82-09802ad9f4ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:27.404960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6bd0f62f-20a6-4887-8c82-09802ad9f4ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:27.466074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6bd0f62f-20a6-4887-8c82-09802ad9f4ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:27.473623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6bd0f62f-20a6-4887-8c82-09802ad9f4ef tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081114 May 10 21:31:27.474182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1742/2518] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:27 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:28.408994 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b3fcf8f7-7856-4d13-8814-7092a6bf5b68 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:28.409669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b3fcf8f7-7856-4d13-8814-7092a6bf5b68 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:28.415924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3fcf8f7-7856-4d13-8814-7092a6bf5b68 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:28.416373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3fcf8f7-7856-4d13-8814-7092a6bf5b68 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:28.417130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3fcf8f7-7856-4d13-8814-7092a6bf5b68 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:28.417563 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3fcf8f7-7856-4d13-8814-7092a6bf5b68 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:28.477940 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b3fcf8f7-7856-4d13-8814-7092a6bf5b68 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:28.486362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b3fcf8f7-7856-4d13-8814-7092a6bf5b68 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:28.487897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b3fcf8f7-7856-4d13-8814-7092a6bf5b68 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:28.489033 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b3fcf8f7-7856-4d13-8814-7092a6bf5b68 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.083938 May 10 21:31:28.489585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1743/2519] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:28 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:31:28.493827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6a0bad98-a67d-4524-ab36-be40c0cd0673 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:28.494420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6a0bad98-a67d-4524-ab36-be40c0cd0673 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:28.500448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a0bad98-a67d-4524-ab36-be40c0cd0673 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:28.500892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a0bad98-a67d-4524-ab36-be40c0cd0673 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:28.501641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a0bad98-a67d-4524-ab36-be40c0cd0673 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:28.502073 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a0bad98-a67d-4524-ab36-be40c0cd0673 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:28.563947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6a0bad98-a67d-4524-ab36-be40c0cd0673 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:28.571268 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6a0bad98-a67d-4524-ab36-be40c0cd0673 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.080736 May 10 21:31:28.571825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1744/2520] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:28 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:29.507966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c972cbfc-badc-4c6b-a094-c5221870b76e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:29.508659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c972cbfc-badc-4c6b-a094-c5221870b76e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:29.516173 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c972cbfc-badc-4c6b-a094-c5221870b76e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:29.516619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c972cbfc-badc-4c6b-a094-c5221870b76e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:29.517383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c972cbfc-badc-4c6b-a094-c5221870b76e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:29.517815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c972cbfc-badc-4c6b-a094-c5221870b76e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:29.582289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c972cbfc-badc-4c6b-a094-c5221870b76e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:29.593537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c972cbfc-badc-4c6b-a094-c5221870b76e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:29.595311 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c972cbfc-badc-4c6b-a094-c5221870b76e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:29.596474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c972cbfc-badc-4c6b-a094-c5221870b76e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.092649 May 10 21:31:29.597041 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1745/2521] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:29 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:29.601599 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2891456d-b9a7-45e6-ac7d-39cd02d13929 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:29.602216 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2891456d-b9a7-45e6-ac7d-39cd02d13929 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:29.608445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2891456d-b9a7-45e6-ac7d-39cd02d13929 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:29.608905 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2891456d-b9a7-45e6-ac7d-39cd02d13929 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:29.609689 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2891456d-b9a7-45e6-ac7d-39cd02d13929 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:29.610130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2891456d-b9a7-45e6-ac7d-39cd02d13929 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:29.673179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2891456d-b9a7-45e6-ac7d-39cd02d13929 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:29.681362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2891456d-b9a7-45e6-ac7d-39cd02d13929 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.083309 May 10 21:31:29.681932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1746/2522] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:29 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:30.614163 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5811273e-64ac-4914-8c4c-7fe7391aa3b5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:30.614769 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5811273e-64ac-4914-8c4c-7fe7391aa3b5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:30.621718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5811273e-64ac-4914-8c4c-7fe7391aa3b5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:30.622255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5811273e-64ac-4914-8c4c-7fe7391aa3b5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:30.623010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5811273e-64ac-4914-8c4c-7fe7391aa3b5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:30.623467 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5811273e-64ac-4914-8c4c-7fe7391aa3b5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:30.685406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5811273e-64ac-4914-8c4c-7fe7391aa3b5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:30.693621 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5811273e-64ac-4914-8c4c-7fe7391aa3b5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:30.695142 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5811273e-64ac-4914-8c4c-7fe7391aa3b5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:30.696267 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5811273e-64ac-4914-8c4c-7fe7391aa3b5 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086048 May 10 21:31:30.696825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1747/2523] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:30 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:30.701614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c68450ea-4646-439a-8dce-748cd26bc9aa tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:30.702208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c68450ea-4646-439a-8dce-748cd26bc9aa tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:30.707995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c68450ea-4646-439a-8dce-748cd26bc9aa tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:30.708437 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c68450ea-4646-439a-8dce-748cd26bc9aa tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:30.709188 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c68450ea-4646-439a-8dce-748cd26bc9aa tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:30.709617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c68450ea-4646-439a-8dce-748cd26bc9aa tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:30.773805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c68450ea-4646-439a-8dce-748cd26bc9aa tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:30.783666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c68450ea-4646-439a-8dce-748cd26bc9aa tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.084572 May 10 21:31:30.783666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1748/2524] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:30 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:31.714216 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7c6d98c5-d316-4a29-ae63-6d8314db0394 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:31.715009 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7c6d98c5-d316-4a29-ae63-6d8314db0394 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:31.721340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c6d98c5-d316-4a29-ae63-6d8314db0394 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:31.721786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c6d98c5-d316-4a29-ae63-6d8314db0394 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:31.722587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c6d98c5-d316-4a29-ae63-6d8314db0394 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:31.723037 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c6d98c5-d316-4a29-ae63-6d8314db0394 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:31.785953 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7c6d98c5-d316-4a29-ae63-6d8314db0394 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:31.794351 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7c6d98c5-d316-4a29-ae63-6d8314db0394 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:31.795898 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7c6d98c5-d316-4a29-ae63-6d8314db0394 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:31.797026 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7c6d98c5-d316-4a29-ae63-6d8314db0394 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.086887 May 10 21:31:31.797575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1749/2525] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:31 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:31.801841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e544227c-b218-4099-a12f-b38ebc80d506 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:31.802433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e544227c-b218-4099-a12f-b38ebc80d506 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:31.807986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e544227c-b218-4099-a12f-b38ebc80d506 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:31.808454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e544227c-b218-4099-a12f-b38ebc80d506 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:31.809372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e544227c-b218-4099-a12f-b38ebc80d506 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:31.809805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e544227c-b218-4099-a12f-b38ebc80d506 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:31.869493 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e544227c-b218-4099-a12f-b38ebc80d506 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:31.877037 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e544227c-b218-4099-a12f-b38ebc80d506 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078547 May 10 21:31:31.877601 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1750/2526] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:31 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:32.815707 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-21fd1cff-78da-42f1-a958-c183cd1c9a6e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:32.816317 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-21fd1cff-78da-42f1-a958-c183cd1c9a6e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:32.822662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21fd1cff-78da-42f1-a958-c183cd1c9a6e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:32.823111 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21fd1cff-78da-42f1-a958-c183cd1c9a6e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:32.823931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21fd1cff-78da-42f1-a958-c183cd1c9a6e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:32.824616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21fd1cff-78da-42f1-a958-c183cd1c9a6e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:32.885654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-21fd1cff-78da-42f1-a958-c183cd1c9a6e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:32.894042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-21fd1cff-78da-42f1-a958-c183cd1c9a6e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:32.895585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-21fd1cff-78da-42f1-a958-c183cd1c9a6e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:32.896726 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-21fd1cff-78da-42f1-a958-c183cd1c9a6e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084973 May 10 21:31:32.897281 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1751/2527] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:32 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:32.901566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-89230f13-db1e-46c9-9ad7-793fbb1ea247 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:32.903081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-89230f13-db1e-46c9-9ad7-793fbb1ea247 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:32.908935 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89230f13-db1e-46c9-9ad7-793fbb1ea247 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:32.909384 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89230f13-db1e-46c9-9ad7-793fbb1ea247 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:32.910149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89230f13-db1e-46c9-9ad7-793fbb1ea247 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:32.910585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89230f13-db1e-46c9-9ad7-793fbb1ea247 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:32.973231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-89230f13-db1e-46c9-9ad7-793fbb1ea247 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:32.981221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-89230f13-db1e-46c9-9ad7-793fbb1ea247 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.082385 May 10 21:31:32.981902 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1752/2528] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:32 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:33.915204 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2011001b-1135-4fb9-b51f-5c2bd8830c9d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:33.915871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2011001b-1135-4fb9-b51f-5c2bd8830c9d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:33.922363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2011001b-1135-4fb9-b51f-5c2bd8830c9d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:33.922822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2011001b-1135-4fb9-b51f-5c2bd8830c9d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:33.923611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2011001b-1135-4fb9-b51f-5c2bd8830c9d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:33.924058 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2011001b-1135-4fb9-b51f-5c2bd8830c9d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:33.985151 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2011001b-1135-4fb9-b51f-5c2bd8830c9d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:33.993231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2011001b-1135-4fb9-b51f-5c2bd8830c9d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:33.994735 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2011001b-1135-4fb9-b51f-5c2bd8830c9d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:33.995905 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2011001b-1135-4fb9-b51f-5c2bd8830c9d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.084744 May 10 21:31:33.997032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1753/2529] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:33 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:34.001336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c0464887-feca-4056-84f3-e7b55dab882b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:34.001934 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c0464887-feca-4056-84f3-e7b55dab882b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:34.007433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c0464887-feca-4056-84f3-e7b55dab882b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:34.007880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c0464887-feca-4056-84f3-e7b55dab882b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:34.008640 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c0464887-feca-4056-84f3-e7b55dab882b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:34.009077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c0464887-feca-4056-84f3-e7b55dab882b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:34.068297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c0464887-feca-4056-84f3-e7b55dab882b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:34.076108 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c0464887-feca-4056-84f3-e7b55dab882b tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.078153 May 10 21:31:34.076670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1754/2530] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:33 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:35.016052 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-542b9fb2-3d1c-47f4-ad1b-1bc3d8ccca4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:35.016698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-542b9fb2-3d1c-47f4-ad1b-1bc3d8ccca4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:35.022936 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-542b9fb2-3d1c-47f4-ad1b-1bc3d8ccca4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:35.023417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-542b9fb2-3d1c-47f4-ad1b-1bc3d8ccca4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:35.024336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-542b9fb2-3d1c-47f4-ad1b-1bc3d8ccca4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:35.024768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-542b9fb2-3d1c-47f4-ad1b-1bc3d8ccca4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:35.086583 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-542b9fb2-3d1c-47f4-ad1b-1bc3d8ccca4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:35.095810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-542b9fb2-3d1c-47f4-ad1b-1bc3d8ccca4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:35.097464 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-542b9fb2-3d1c-47f4-ad1b-1bc3d8ccca4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:35.098616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-542b9fb2-3d1c-47f4-ad1b-1bc3d8ccca4e tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 200 len: 1444 microversion: 2.20 time: 0.087371 May 10 21:31:35.099197 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1755/2531] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:35 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:35.103535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f7064b11-33fe-45c7-93ce-b24916203651 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:35.104143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f7064b11-33fe-45c7-93ce-b24916203651 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:35.109958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f7064b11-33fe-45c7-93ce-b24916203651 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:35.110411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f7064b11-33fe-45c7-93ce-b24916203651 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:35.111211 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f7064b11-33fe-45c7-93ce-b24916203651 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:35.111655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f7064b11-33fe-45c7-93ce-b24916203651 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:35.178789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f7064b11-33fe-45c7-93ce-b24916203651 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:35.187014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f7064b11-33fe-45c7-93ce-b24916203651 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.086852 May 10 21:31:35.187621 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1756/2532] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:35 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:35.191983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-449d629b-bf46-41f0-b0e6-ffc832b63a71 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '.version_select at 0x7f85d5442700>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:35.256567 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-449d629b-bf46-41f0-b0e6-ffc832b63a71 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-139296194" status: 204 len: 0 microversion: 2.20 time: 0.067926 May 10 21:31:35.257144 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1757/2533] 10.222.0.49 () {60 vars in 1258 bytes} [Tue May 10 21:31:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-139296194 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 21:31:36.153594 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e9095150-d8bc-4d30-8285-305ffb760b5a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Action: 'create', calling method: .version_select at 0x7f85d52ff0d0>, body: {"keypair": {"name": "tempest-keypair-2123220165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJh9z8/tVLYndIiHV/VfMua8Jee08AX2oGcpQa25FhATzebDK4zAi8BLMmu20h5wBgiCi6B0ech8LLU2Ipkn6Juo28XrHooBcExVyt7XXkOj55iGcXxwqV8qJ/Y5E4WHng=="}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:31:36.169168 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-e9095150-d8bc-4d30-8285-305ffb760b5a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Getting quotas for project 8df9bf1cf45743dc8206cab528d583a1. Resources: {'key_pairs'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:31:36.173173 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-e9095150-d8bc-4d30-8285-305ffb760b5a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Getting quotas for user da06520884ff4677af84f9e7356818ef and project 8df9bf1cf45743dc8206cab528d583a1. Resources: {'key_pairs'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:31:36.257140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e9095150-d8bc-4d30-8285-305ffb760b5a tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.108322 May 10 21:31:36.257737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1758/2534] 10.222.0.49 () {62 vars in 1199 bytes} [Tue May 10 21:31:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 110 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 21:31:36.263037 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e271125a-4b09-4574-aec0-bcca270284f5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:36.264438 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e271125a-4b09-4574-aec0-bcca270284f5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:36.269759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e271125a-4b09-4574-aec0-bcca270284f5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:36.270199 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e271125a-4b09-4574-aec0-bcca270284f5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:36.271100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e271125a-4b09-4574-aec0-bcca270284f5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:36.271534 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e271125a-4b09-4574-aec0-bcca270284f5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:36.332479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e271125a-4b09-4574-aec0-bcca270284f5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:36.340745 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e271125a-4b09-4574-aec0-bcca270284f5 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.081868 May 10 21:31:36.341307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1759/2535] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:36 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:31:37.358564 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0d89a6a6-67e5-4734-ac79-430903b2b822 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:37.359223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0d89a6a6-67e5-4734-ac79-430903b2b822 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] [instance: d4c7c73d-54f3-4695-87bc-4c9d22d5652f] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:37.365595 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d89a6a6-67e5-4734-ac79-430903b2b822 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:37.366048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d89a6a6-67e5-4734-ac79-430903b2b822 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:37.366825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d89a6a6-67e5-4734-ac79-430903b2b822 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:37.367299 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d89a6a6-67e5-4734-ac79-430903b2b822 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:37.431174 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0d89a6a6-67e5-4734-ac79-430903b2b822 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4ab23d3e7b4b018d144bea8b98dc24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa59d3d177fb4b578fecee910e079117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:37.438944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0d89a6a6-67e5-4734-ac79-430903b2b822 tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f" status: 200 len: 1218 microversion: 2.1 time: 0.085064 May 10 21:31:37.439544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1760/2536] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:37 2022] GET /compute/v2.1/servers/d4c7c73d-54f3-4695-87bc-4c9d22d5652f => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:31:37.731036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-19dd4240-f243-4169-aa91-d6059de645dc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] Calling method '.version_select at 0x7f85d53cf040>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:37.811916 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-19dd4240-f243-4169-aa91-d6059de645dc tempest-TestShelveInstance-322068821 tempest-TestShelveInstance-322068821-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-576792337" status: 202 len: 0 microversion: 2.1 time: 0.085127 May 10 21:31:37.812514 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1761/2537] 10.222.0.49 () {58 vars in 1250 bytes} [Tue May 10 21:31:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-576792337 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 21:31:38.602986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-24c897bd-3569-48bb-8b86-4d43ed8a2e3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-816080096", "imageRef": "cb321ccf-1ce7-4dda-90d0-f05332eb6fe1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "411e8f68-b02f-49ed-9c70-3713b4941372"}], "security_groups": [{"name": "tempest-securitygroup--870984673"}], "key_name": "tempest-keypair-2123220165", "user_data": "}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:31:38.703516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.network.neutron [None req-24c897bd-3569-48bb-8b86-4d43ed8a2e3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] validate_networks() for [('411e8f68-b02f-49ed-9c70-3713b4941372', None, None, None, None, None)] {{(pid=117714) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:31:39.125462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-24c897bd-3569-48bb-8b86-4d43ed8a2e3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Flavor limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:31:39.125881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-24c897bd-3569-48bb-8b86-4d43ed8a2e3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Image limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:31:39.126349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-24c897bd-3569-48bb-8b86-4d43ed8a2e3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Flavor pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:31:39.126750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-24c897bd-3569-48bb-8b86-4d43ed8a2e3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Image pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:31:39.127179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-24c897bd-3569-48bb-8b86-4d43ed8a2e3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:31:39.135881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-24c897bd-3569-48bb-8b86-4d43ed8a2e3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:39.136326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-24c897bd-3569-48bb-8b86-4d43ed8a2e3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:39.137349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-24c897bd-3569-48bb-8b86-4d43ed8a2e3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:39.137631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-24c897bd-3569-48bb-8b86-4d43ed8a2e3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:39.154552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-24c897bd-3569-48bb-8b86-4d43ed8a2e3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Getting quotas for project 8df9bf1cf45743dc8206cab528d583a1. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:31:39.158550 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-24c897bd-3569-48bb-8b86-4d43ed8a2e3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Getting quotas for user da06520884ff4677af84f9e7356818ef and project 8df9bf1cf45743dc8206cab528d583a1. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:31:39.170268 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-24c897bd-3569-48bb-8b86-4d43ed8a2e3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Going to run 1 instances... {{(pid=117714) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:31:39.172583 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-24c897bd-3569-48bb-8b86-4d43ed8a2e3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: b92a0cb7-77d4-4b1c-b6eb-03060079cd40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb321ccf-1ce7-4dda-90d0-f05332eb6fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117714) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:31:39.280715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-24c897bd-3569-48bb-8b86-4d43ed8a2e3c tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.683398 May 10 21:31:39.281365 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1762/2538] 10.222.0.49 () {62 vars in 1187 bytes} [Tue May 10 21:31:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 10 21:31:39.291588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3a0f4cc4-554d-4da0-83d0-93c6393981e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:39.292204 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3a0f4cc4-554d-4da0-83d0-93c6393981e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: b92a0cb7-77d4-4b1c-b6eb-03060079cd40] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:39.373672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3a0f4cc4-554d-4da0-83d0-93c6393981e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:39.381271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3a0f4cc4-554d-4da0-83d0-93c6393981e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:39.382637 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3a0f4cc4-554d-4da0-83d0-93c6393981e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:39.383766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3a0f4cc4-554d-4da0-83d0-93c6393981e7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40" status: 200 len: 1281 microversion: 2.20 time: 0.096374 May 10 21:31:39.384822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1763/2539] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:39 2022] GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40 => generated 1281 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:40.403977 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0d4507f4-64dc-4a47-a5f5-72f631a935b1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:40.404602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0d4507f4-64dc-4a47-a5f5-72f631a935b1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: b92a0cb7-77d4-4b1c-b6eb-03060079cd40] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:40.411173 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d4507f4-64dc-4a47-a5f5-72f631a935b1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:40.411632 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d4507f4-64dc-4a47-a5f5-72f631a935b1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:40.412469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d4507f4-64dc-4a47-a5f5-72f631a935b1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:40.412905 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d4507f4-64dc-4a47-a5f5-72f631a935b1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:40.476789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0d4507f4-64dc-4a47-a5f5-72f631a935b1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:40.485494 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0d4507f4-64dc-4a47-a5f5-72f631a935b1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:40.487000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0d4507f4-64dc-4a47-a5f5-72f631a935b1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:40.489167 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0d4507f4-64dc-4a47-a5f5-72f631a935b1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40" status: 200 len: 1285 microversion: 2.20 time: 0.089917 May 10 21:31:40.489743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1764/2540] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:40 2022] GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40 => generated 1285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:31:41.509231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b785bd09-ad73-4fc2-b4e1-aa46a0927726 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:41.509231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b785bd09-ad73-4fc2-b4e1-aa46a0927726 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: b92a0cb7-77d4-4b1c-b6eb-03060079cd40] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:41.515170 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b785bd09-ad73-4fc2-b4e1-aa46a0927726 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:41.515627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b785bd09-ad73-4fc2-b4e1-aa46a0927726 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:41.516481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b785bd09-ad73-4fc2-b4e1-aa46a0927726 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:41.516952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b785bd09-ad73-4fc2-b4e1-aa46a0927726 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:41.648879 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b785bd09-ad73-4fc2-b4e1-aa46a0927726 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:41.657753 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b785bd09-ad73-4fc2-b4e1-aa46a0927726 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:41.659922 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b785bd09-ad73-4fc2-b4e1-aa46a0927726 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:41.661055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b785bd09-ad73-4fc2-b4e1-aa46a0927726 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40" status: 200 len: 1351 microversion: 2.20 time: 0.158372 May 10 21:31:41.661622 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1765/2541] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:41 2022] GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40 => generated 1351 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:31:42.680234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-598b5c77-dfb7-4156-8e82-506358b8f80d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:42.680858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-598b5c77-dfb7-4156-8e82-506358b8f80d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: b92a0cb7-77d4-4b1c-b6eb-03060079cd40] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:42.687800 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-598b5c77-dfb7-4156-8e82-506358b8f80d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:42.688488 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-598b5c77-dfb7-4156-8e82-506358b8f80d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:42.689505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-598b5c77-dfb7-4156-8e82-506358b8f80d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:42.690109 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-598b5c77-dfb7-4156-8e82-506358b8f80d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:42.943768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-598b5c77-dfb7-4156-8e82-506358b8f80d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:42.953675 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-598b5c77-dfb7-4156-8e82-506358b8f80d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:42.955213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-598b5c77-dfb7-4156-8e82-506358b8f80d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:42.956339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-598b5c77-dfb7-4156-8e82-506358b8f80d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40" status: 200 len: 1406 microversion: 2.20 time: 0.280894 May 10 21:31:42.956899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1766/2542] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:42 2022] GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40 => generated 1406 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:43.768649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-92ed9c2a-56c4-41e3-a241-19209bdbf46e req-12815c6f-7349-42f7-98ed-fbed71cdd63a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b92a0cb7-77d4-4b1c-b6eb-03060079cd40", "tag": "0d188702-e9dd-421a-9c5b-d515ebde9a07"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:31:43.777974 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-92ed9c2a-56c4-41e3-a241-19209bdbf46e req-12815c6f-7349-42f7-98ed-fbed71cdd63a service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:43.778773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-92ed9c2a-56c4-41e3-a241-19209bdbf46e req-12815c6f-7349-42f7-98ed-fbed71cdd63a service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:43.791174 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-92ed9c2a-56c4-41e3-a241-19209bdbf46e req-12815c6f-7349-42f7-98ed-fbed71cdd63a service nova] Creating event network-changed:0d188702-e9dd-421a-9c5b-d515ebde9a07 for instance b92a0cb7-77d4-4b1c-b6eb-03060079cd40 on hv-cinder-82880 May 10 21:31:43.804803 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-92ed9c2a-56c4-41e3-a241-19209bdbf46e req-12815c6f-7349-42f7-98ed-fbed71cdd63a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114768 May 10 21:31:43.805748 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1767/2543] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:31:43.976305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5d493565-ac0b-461d-bd98-3daf0db0d271 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:43.977840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5d493565-ac0b-461d-bd98-3daf0db0d271 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: b92a0cb7-77d4-4b1c-b6eb-03060079cd40] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:43.986408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5d493565-ac0b-461d-bd98-3daf0db0d271 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:43.987694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5d493565-ac0b-461d-bd98-3daf0db0d271 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:43.988661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5d493565-ac0b-461d-bd98-3daf0db0d271 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:43.989547 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5d493565-ac0b-461d-bd98-3daf0db0d271 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:44.201171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5d493565-ac0b-461d-bd98-3daf0db0d271 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:44.210413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5d493565-ac0b-461d-bd98-3daf0db0d271 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:44.212134 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5d493565-ac0b-461d-bd98-3daf0db0d271 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:44.213368 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5d493565-ac0b-461d-bd98-3daf0db0d271 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40" status: 200 len: 1406 microversion: 2.20 time: 0.241292 May 10 21:31:44.214114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1768/2544] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:43 2022] GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40 => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:31:45.232364 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0dbcd6be-05a3-46b6-913b-36a771cf41f1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:45.233361 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0dbcd6be-05a3-46b6-913b-36a771cf41f1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: b92a0cb7-77d4-4b1c-b6eb-03060079cd40] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:45.240459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0dbcd6be-05a3-46b6-913b-36a771cf41f1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:45.241203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0dbcd6be-05a3-46b6-913b-36a771cf41f1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:45.241993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0dbcd6be-05a3-46b6-913b-36a771cf41f1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:45.242441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0dbcd6be-05a3-46b6-913b-36a771cf41f1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:45.465797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0dbcd6be-05a3-46b6-913b-36a771cf41f1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:45.473709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0dbcd6be-05a3-46b6-913b-36a771cf41f1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:45.475245 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0dbcd6be-05a3-46b6-913b-36a771cf41f1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:45.476361 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0dbcd6be-05a3-46b6-913b-36a771cf41f1 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40" status: 200 len: 1406 microversion: 2.20 time: 0.249375 May 10 21:31:45.476931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1769/2545] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:45 2022] GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40 => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:46.494606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-65fa53c0-d62e-4405-99e2-412c7cd07928 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:46.495252 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-65fa53c0-d62e-4405-99e2-412c7cd07928 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: b92a0cb7-77d4-4b1c-b6eb-03060079cd40] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:46.502253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65fa53c0-d62e-4405-99e2-412c7cd07928 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:46.503043 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65fa53c0-d62e-4405-99e2-412c7cd07928 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:46.503535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65fa53c0-d62e-4405-99e2-412c7cd07928 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:46.503970 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65fa53c0-d62e-4405-99e2-412c7cd07928 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:46.644839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-65fa53c0-d62e-4405-99e2-412c7cd07928 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:46.652921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-65fa53c0-d62e-4405-99e2-412c7cd07928 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:46.654497 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-65fa53c0-d62e-4405-99e2-412c7cd07928 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:46.655682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-65fa53c0-d62e-4405-99e2-412c7cd07928 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40" status: 200 len: 1406 microversion: 2.20 time: 0.165040 May 10 21:31:46.657835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1770/2546] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:46 2022] GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:31:47.674044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-72ceb9ce-9961-4325-bc8c-74af5cb247cb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:47.674653 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-72ceb9ce-9961-4325-bc8c-74af5cb247cb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: b92a0cb7-77d4-4b1c-b6eb-03060079cd40] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:47.681138 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-72ceb9ce-9961-4325-bc8c-74af5cb247cb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:47.681586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-72ceb9ce-9961-4325-bc8c-74af5cb247cb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:47.682340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-72ceb9ce-9961-4325-bc8c-74af5cb247cb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:47.682778 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-72ceb9ce-9961-4325-bc8c-74af5cb247cb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:47.817960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-72ceb9ce-9961-4325-bc8c-74af5cb247cb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:47.826325 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-72ceb9ce-9961-4325-bc8c-74af5cb247cb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:47.827877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-72ceb9ce-9961-4325-bc8c-74af5cb247cb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:47.828982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-72ceb9ce-9961-4325-bc8c-74af5cb247cb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40" status: 200 len: 1406 microversion: 2.20 time: 0.158926 May 10 21:31:47.829641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1771/2547] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:47 2022] GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:48.847039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-81556fee-4cc0-45e2-a952-2d77fdf28b70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:48.847685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-81556fee-4cc0-45e2-a952-2d77fdf28b70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: b92a0cb7-77d4-4b1c-b6eb-03060079cd40] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:48.854202 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-81556fee-4cc0-45e2-a952-2d77fdf28b70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:48.854662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-81556fee-4cc0-45e2-a952-2d77fdf28b70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:48.855497 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-81556fee-4cc0-45e2-a952-2d77fdf28b70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:48.856503 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-81556fee-4cc0-45e2-a952-2d77fdf28b70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:48.991574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-81556fee-4cc0-45e2-a952-2d77fdf28b70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:49.000156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-81556fee-4cc0-45e2-a952-2d77fdf28b70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:49.001677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-81556fee-4cc0-45e2-a952-2d77fdf28b70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:49.002787 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-81556fee-4cc0-45e2-a952-2d77fdf28b70 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40" status: 200 len: 1406 microversion: 2.20 time: 0.159597 May 10 21:31:49.003384 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1772/2548] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:48 2022] GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:49.179184 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-020057c2-0e24-4b9a-a050-e557ee24aa38 req-f9d3dc48-077e-4ce3-888c-4573758b8954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b92a0cb7-77d4-4b1c-b6eb-03060079cd40", "name": "network-vif-plugged", "status": "completed", "tag": "0d188702-e9dd-421a-9c5b-d515ebde9a07"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:31:49.187112 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-020057c2-0e24-4b9a-a050-e557ee24aa38 req-f9d3dc48-077e-4ce3-888c-4573758b8954 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:49.187596 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-020057c2-0e24-4b9a-a050-e557ee24aa38 req-f9d3dc48-077e-4ce3-888c-4573758b8954 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:49.200658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-020057c2-0e24-4b9a-a050-e557ee24aa38 req-f9d3dc48-077e-4ce3-888c-4573758b8954 service nova] Creating event network-vif-plugged:0d188702-e9dd-421a-9c5b-d515ebde9a07 for instance b92a0cb7-77d4-4b1c-b6eb-03060079cd40 on hv-cinder-82880 May 10 21:31:49.205639 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-020057c2-0e24-4b9a-a050-e557ee24aa38 req-f9d3dc48-077e-4ce3-888c-4573758b8954 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201104 May 10 21:31:49.206214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1773/2549] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:31:50.022225 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-048b6e46-bdf6-4644-bd33-1d24a5464afb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:50.022919 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-048b6e46-bdf6-4644-bd33-1d24a5464afb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: b92a0cb7-77d4-4b1c-b6eb-03060079cd40] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:50.030150 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-048b6e46-bdf6-4644-bd33-1d24a5464afb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:50.030594 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-048b6e46-bdf6-4644-bd33-1d24a5464afb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:50.031463 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-048b6e46-bdf6-4644-bd33-1d24a5464afb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:50.031898 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-048b6e46-bdf6-4644-bd33-1d24a5464afb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:50.158749 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-048b6e46-bdf6-4644-bd33-1d24a5464afb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:50.166600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-048b6e46-bdf6-4644-bd33-1d24a5464afb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:50.168348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-048b6e46-bdf6-4644-bd33-1d24a5464afb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:50.169461 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-048b6e46-bdf6-4644-bd33-1d24a5464afb tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40" status: 200 len: 1406 microversion: 2.20 time: 0.151980 May 10 21:31:50.170020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1774/2550] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:50 2022] GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:51.187252 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-be9b21d4-a2ea-425b-8c6c-3e6add354483 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:51.187901 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-be9b21d4-a2ea-425b-8c6c-3e6add354483 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: b92a0cb7-77d4-4b1c-b6eb-03060079cd40] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:51.194302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be9b21d4-a2ea-425b-8c6c-3e6add354483 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:51.194758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be9b21d4-a2ea-425b-8c6c-3e6add354483 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:51.195603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be9b21d4-a2ea-425b-8c6c-3e6add354483 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:51.196048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be9b21d4-a2ea-425b-8c6c-3e6add354483 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:51.327725 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-be9b21d4-a2ea-425b-8c6c-3e6add354483 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:51.335887 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-be9b21d4-a2ea-425b-8c6c-3e6add354483 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:51.337400 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-be9b21d4-a2ea-425b-8c6c-3e6add354483 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:51.338554 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-be9b21d4-a2ea-425b-8c6c-3e6add354483 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40" status: 200 len: 1599 microversion: 2.20 time: 0.155348 May 10 21:31:51.339114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1775/2551] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:31:51 2022] GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:31:51.356036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f0f5699d-b32c-4716-9d55-4e537730c924 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:51.356525 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f0f5699d-b32c-4716-9d55-4e537730c924 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: b92a0cb7-77d4-4b1c-b6eb-03060079cd40] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:51.362123 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0f5699d-b32c-4716-9d55-4e537730c924 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:51.362568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0f5699d-b32c-4716-9d55-4e537730c924 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:51.363351 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0f5699d-b32c-4716-9d55-4e537730c924 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:51.363784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0f5699d-b32c-4716-9d55-4e537730c924 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:51.440309 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f0f5699d-b32c-4716-9d55-4e537730c924 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.087963 May 10 21:31:51.441022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1776/2552] 10.222.0.49 () {60 vars in 1315 bytes} [Tue May 10 21:31:51 2022] GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:31:52.464496 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-2be16e28-ec32-4b20-9d92-36ab5084bbcb req-0a4e0255-5796-4641-aa5d-01ed3936e7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b92a0cb7-77d4-4b1c-b6eb-03060079cd40", "tag": "0d188702-e9dd-421a-9c5b-d515ebde9a07"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:31:52.472726 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-2be16e28-ec32-4b20-9d92-36ab5084bbcb req-0a4e0255-5796-4641-aa5d-01ed3936e7e1 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:52.473174 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-2be16e28-ec32-4b20-9d92-36ab5084bbcb req-0a4e0255-5796-4641-aa5d-01ed3936e7e1 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:52.484041 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-2be16e28-ec32-4b20-9d92-36ab5084bbcb req-0a4e0255-5796-4641-aa5d-01ed3936e7e1 service nova] Creating event network-changed:0d188702-e9dd-421a-9c5b-d515ebde9a07 for instance b92a0cb7-77d4-4b1c-b6eb-03060079cd40 on hv-cinder-82880 May 10 21:31:52.489313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-2be16e28-ec32-4b20-9d92-36ab5084bbcb req-0a4e0255-5796-4641-aa5d-01ed3936e7e1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028920 May 10 21:31:52.490062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1777/2553] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:31:57.765621 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cbf33647-020f-4b01-874b-67df6856a653 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:57.766253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cbf33647-020f-4b01-874b-67df6856a653 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:57.772288 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbf33647-020f-4b01-874b-67df6856a653 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:57.772765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbf33647-020f-4b01-874b-67df6856a653 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:57.773506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbf33647-020f-4b01-874b-67df6856a653 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:57.773936 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbf33647-020f-4b01-874b-67df6856a653 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:57.799366 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cbf33647-020f-4b01-874b-67df6856a653 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Going to try to terminate instance {{(pid=117714) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:31:58.049861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cbf33647-020f-4b01-874b-67df6856a653 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 204 len: 0 microversion: 2.1 time: 0.288696 May 10 21:31:58.050500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1778/2554] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 21:31:57 2022] DELETE /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 21:31:58.058778 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6a722284-6766-4897-82b0-1224f73ec35a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:58.069536 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6a722284-6766-4897-82b0-1224f73ec35a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:58.069536 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a722284-6766-4897-82b0-1224f73ec35a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:58.069536 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a722284-6766-4897-82b0-1224f73ec35a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:58.069536 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a722284-6766-4897-82b0-1224f73ec35a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:58.069971 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a722284-6766-4897-82b0-1224f73ec35a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:58.198059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6a722284-6766-4897-82b0-1224f73ec35a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:58.206607 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6a722284-6766-4897-82b0-1224f73ec35a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.151764 May 10 21:31:58.207201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1779/2555] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:58 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:31:59.227817 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b898ee52-d6e1-4e89-8791-27ef597c997b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:31:59.228461 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b898ee52-d6e1-4e89-8791-27ef597c997b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:31:59.235630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b898ee52-d6e1-4e89-8791-27ef597c997b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:59.236082 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b898ee52-d6e1-4e89-8791-27ef597c997b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:59.236849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b898ee52-d6e1-4e89-8791-27ef597c997b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:31:59.237286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b898ee52-d6e1-4e89-8791-27ef597c997b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:31:59.364241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b898ee52-d6e1-4e89-8791-27ef597c997b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:31:59.372794 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b898ee52-d6e1-4e89-8791-27ef597c997b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148213 May 10 21:31:59.373437 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1780/2556] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:31:59 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:00.390107 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5436892e-ab50-4a3a-ab75-73d68a358db0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:00.390763 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5436892e-ab50-4a3a-ab75-73d68a358db0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:00.397137 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5436892e-ab50-4a3a-ab75-73d68a358db0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:00.397581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5436892e-ab50-4a3a-ab75-73d68a358db0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:00.398500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5436892e-ab50-4a3a-ab75-73d68a358db0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:00.398931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5436892e-ab50-4a3a-ab75-73d68a358db0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:00.526989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5436892e-ab50-4a3a-ab75-73d68a358db0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:00.534915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5436892e-ab50-4a3a-ab75-73d68a358db0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149019 May 10 21:32:00.535514 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1781/2557] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:00 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:01.553456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-92adee49-fa6e-4504-93fe-83a94b0c43ce tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:01.554132 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-92adee49-fa6e-4504-93fe-83a94b0c43ce tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:01.561085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-92adee49-fa6e-4504-93fe-83a94b0c43ce tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:01.561532 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-92adee49-fa6e-4504-93fe-83a94b0c43ce tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:01.562292 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-92adee49-fa6e-4504-93fe-83a94b0c43ce tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:01.562735 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-92adee49-fa6e-4504-93fe-83a94b0c43ce tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:01.692980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-92adee49-fa6e-4504-93fe-83a94b0c43ce tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:01.701854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-92adee49-fa6e-4504-93fe-83a94b0c43ce tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.152260 May 10 21:32:01.702452 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1782/2558] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:01 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:02.719443 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ffad6d7d-708b-4c44-b025-51b03d4d7beb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:02.720135 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ffad6d7d-708b-4c44-b025-51b03d4d7beb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:02.726709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ffad6d7d-708b-4c44-b025-51b03d4d7beb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:02.727195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ffad6d7d-708b-4c44-b025-51b03d4d7beb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:02.727978 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ffad6d7d-708b-4c44-b025-51b03d4d7beb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:02.728418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ffad6d7d-708b-4c44-b025-51b03d4d7beb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:02.857038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ffad6d7d-708b-4c44-b025-51b03d4d7beb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:02.864893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ffad6d7d-708b-4c44-b025-51b03d4d7beb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149550 May 10 21:32:02.865461 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1783/2559] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:02 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:03.881826 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ca0d218b-eb42-4e04-b31a-b8afde1b543d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:03.882440 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ca0d218b-eb42-4e04-b31a-b8afde1b543d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:03.889726 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ca0d218b-eb42-4e04-b31a-b8afde1b543d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:03.890183 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ca0d218b-eb42-4e04-b31a-b8afde1b543d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:03.890954 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ca0d218b-eb42-4e04-b31a-b8afde1b543d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:03.891427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ca0d218b-eb42-4e04-b31a-b8afde1b543d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:04.021415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ca0d218b-eb42-4e04-b31a-b8afde1b543d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:04.029283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ca0d218b-eb42-4e04-b31a-b8afde1b543d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.151414 May 10 21:32:04.029847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1784/2560] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:03 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:05.045945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-23911d84-46e8-43a6-af64-1e1dd373d170 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:05.046667 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-23911d84-46e8-43a6-af64-1e1dd373d170 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:05.052847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-23911d84-46e8-43a6-af64-1e1dd373d170 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:05.053276 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-23911d84-46e8-43a6-af64-1e1dd373d170 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:05.054030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-23911d84-46e8-43a6-af64-1e1dd373d170 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:05.054466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-23911d84-46e8-43a6-af64-1e1dd373d170 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:05.182774 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-23911d84-46e8-43a6-af64-1e1dd373d170 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:05.191272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-23911d84-46e8-43a6-af64-1e1dd373d170 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149291 May 10 21:32:05.191847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1785/2561] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:05 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:06.208848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-01439705-3bfa-4969-b0dd-ac414c44591e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:06.209551 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-01439705-3bfa-4969-b0dd-ac414c44591e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:06.216099 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01439705-3bfa-4969-b0dd-ac414c44591e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:06.216544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01439705-3bfa-4969-b0dd-ac414c44591e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:06.217311 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01439705-3bfa-4969-b0dd-ac414c44591e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:06.217744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01439705-3bfa-4969-b0dd-ac414c44591e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:06.351999 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-01439705-3bfa-4969-b0dd-ac414c44591e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:06.360691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-01439705-3bfa-4969-b0dd-ac414c44591e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.156099 May 10 21:32:06.361262 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1786/2562] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:06 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:07.377953 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1de8a042-079b-4eb9-aa28-5f71aae1bb19 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:07.378637 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1de8a042-079b-4eb9-aa28-5f71aae1bb19 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:07.384931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1de8a042-079b-4eb9-aa28-5f71aae1bb19 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:07.385383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1de8a042-079b-4eb9-aa28-5f71aae1bb19 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:07.386143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1de8a042-079b-4eb9-aa28-5f71aae1bb19 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:07.386585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1de8a042-079b-4eb9-aa28-5f71aae1bb19 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:07.511911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1de8a042-079b-4eb9-aa28-5f71aae1bb19 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:07.519733 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1de8a042-079b-4eb9-aa28-5f71aae1bb19 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.145684 May 10 21:32:07.520297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1787/2563] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:07 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:08.536703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9585cad9-f569-417f-8cac-e336ea654a43 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:08.537392 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9585cad9-f569-417f-8cac-e336ea654a43 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:08.544330 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9585cad9-f569-417f-8cac-e336ea654a43 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:08.544887 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9585cad9-f569-417f-8cac-e336ea654a43 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:08.545649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9585cad9-f569-417f-8cac-e336ea654a43 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:08.546085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9585cad9-f569-417f-8cac-e336ea654a43 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:08.673199 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9585cad9-f569-417f-8cac-e336ea654a43 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:08.681188 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9585cad9-f569-417f-8cac-e336ea654a43 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148330 May 10 21:32:08.681772 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1788/2564] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:08 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:09.700475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dd077e54-f724-44b4-8396-5564df3676ca tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:09.701285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dd077e54-f724-44b4-8396-5564df3676ca tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:09.709004 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dd077e54-f724-44b4-8396-5564df3676ca tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:09.709690 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dd077e54-f724-44b4-8396-5564df3676ca tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:09.710444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dd077e54-f724-44b4-8396-5564df3676ca tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:09.710877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dd077e54-f724-44b4-8396-5564df3676ca tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:09.840983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dd077e54-f724-44b4-8396-5564df3676ca tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:09.848658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dd077e54-f724-44b4-8396-5564df3676ca tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.152861 May 10 21:32:09.849234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1789/2565] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:09 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:10.865349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7738aed7-f3dd-4b4f-a33c-b48904daabc7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:10.865951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7738aed7-f3dd-4b4f-a33c-b48904daabc7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:10.873011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7738aed7-f3dd-4b4f-a33c-b48904daabc7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:10.873456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7738aed7-f3dd-4b4f-a33c-b48904daabc7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:10.874222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7738aed7-f3dd-4b4f-a33c-b48904daabc7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:10.874658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7738aed7-f3dd-4b4f-a33c-b48904daabc7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:11.002134 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7738aed7-f3dd-4b4f-a33c-b48904daabc7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:11.010005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7738aed7-f3dd-4b4f-a33c-b48904daabc7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148736 May 10 21:32:11.010567 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1790/2566] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:10 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:12.027847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f2099517-1510-4c63-bbac-9e0af06ddf0e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:12.028822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f2099517-1510-4c63-bbac-9e0af06ddf0e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:12.034721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2099517-1510-4c63-bbac-9e0af06ddf0e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:12.035259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2099517-1510-4c63-bbac-9e0af06ddf0e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:12.036016 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2099517-1510-4c63-bbac-9e0af06ddf0e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:12.036453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2099517-1510-4c63-bbac-9e0af06ddf0e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:12.165597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f2099517-1510-4c63-bbac-9e0af06ddf0e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:12.174063 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f2099517-1510-4c63-bbac-9e0af06ddf0e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150146 May 10 21:32:12.174640 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1791/2567] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:12 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:13.191026 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a41f1793-8db8-4946-8093-4bb2e55dbfb7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:13.191723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a41f1793-8db8-4946-8093-4bb2e55dbfb7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:13.197977 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a41f1793-8db8-4946-8093-4bb2e55dbfb7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:13.198423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a41f1793-8db8-4946-8093-4bb2e55dbfb7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:13.199201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a41f1793-8db8-4946-8093-4bb2e55dbfb7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:13.199636 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a41f1793-8db8-4946-8093-4bb2e55dbfb7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:13.327952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a41f1793-8db8-4946-8093-4bb2e55dbfb7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:13.335928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a41f1793-8db8-4946-8093-4bb2e55dbfb7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148931 May 10 21:32:13.336521 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1792/2568] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:13 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:14.353158 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-32152a22-dcab-4074-ae3c-3f129387e797 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:14.353795 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-32152a22-dcab-4074-ae3c-3f129387e797 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:14.360261 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-32152a22-dcab-4074-ae3c-3f129387e797 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:14.360720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-32152a22-dcab-4074-ae3c-3f129387e797 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:14.361496 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-32152a22-dcab-4074-ae3c-3f129387e797 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:14.361940 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-32152a22-dcab-4074-ae3c-3f129387e797 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:14.492575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-32152a22-dcab-4074-ae3c-3f129387e797 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:14.497924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-32152a22-dcab-4074-ae3c-3f129387e797 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148023 May 10 21:32:14.498489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1793/2569] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:14 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:15.515057 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-57662bfb-7566-47e9-8f29-0432f021a422 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:15.515780 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-57662bfb-7566-47e9-8f29-0432f021a422 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:15.522068 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-57662bfb-7566-47e9-8f29-0432f021a422 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:15.522509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-57662bfb-7566-47e9-8f29-0432f021a422 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:15.523326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-57662bfb-7566-47e9-8f29-0432f021a422 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:15.523760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-57662bfb-7566-47e9-8f29-0432f021a422 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:15.653672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-57662bfb-7566-47e9-8f29-0432f021a422 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:15.661649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-57662bfb-7566-47e9-8f29-0432f021a422 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150821 May 10 21:32:15.662210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1794/2570] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:15 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:16.679548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-814c4ced-f91d-4710-86f0-2b1c6e43ee15 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:16.680571 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-814c4ced-f91d-4710-86f0-2b1c6e43ee15 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:16.687539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-814c4ced-f91d-4710-86f0-2b1c6e43ee15 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:16.687997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-814c4ced-f91d-4710-86f0-2b1c6e43ee15 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:16.688774 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-814c4ced-f91d-4710-86f0-2b1c6e43ee15 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:16.689210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-814c4ced-f91d-4710-86f0-2b1c6e43ee15 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:16.885802 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-814c4ced-f91d-4710-86f0-2b1c6e43ee15 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:16.893714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-814c4ced-f91d-4710-86f0-2b1c6e43ee15 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.218048 May 10 21:32:16.894288 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1795/2571] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:16 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:17.910084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-39dc86ef-e2a7-4a59-a856-a34a3d227ded tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:17.910768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-39dc86ef-e2a7-4a59-a856-a34a3d227ded tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:17.917184 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39dc86ef-e2a7-4a59-a856-a34a3d227ded tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:17.917641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39dc86ef-e2a7-4a59-a856-a34a3d227ded tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:17.918412 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39dc86ef-e2a7-4a59-a856-a34a3d227ded tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:17.918859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39dc86ef-e2a7-4a59-a856-a34a3d227ded tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:18.045027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-39dc86ef-e2a7-4a59-a856-a34a3d227ded tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:18.053151 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-39dc86ef-e2a7-4a59-a856-a34a3d227ded tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.147009 May 10 21:32:18.053729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1796/2572] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:17 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:19.070224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9a8f0ad2-68bf-4565-a210-7862e5686eaf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:19.070868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9a8f0ad2-68bf-4565-a210-7862e5686eaf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:19.078021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9a8f0ad2-68bf-4565-a210-7862e5686eaf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:19.078470 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9a8f0ad2-68bf-4565-a210-7862e5686eaf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:19.079287 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9a8f0ad2-68bf-4565-a210-7862e5686eaf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:19.079711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9a8f0ad2-68bf-4565-a210-7862e5686eaf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:19.207810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9a8f0ad2-68bf-4565-a210-7862e5686eaf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:19.216850 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9a8f0ad2-68bf-4565-a210-7862e5686eaf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149538 May 10 21:32:19.219735 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1797/2573] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:19 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:20.233420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-127d127b-444e-4c33-9af4-11ab0b44141b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:20.234104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-127d127b-444e-4c33-9af4-11ab0b44141b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:20.240393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-127d127b-444e-4c33-9af4-11ab0b44141b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:20.240844 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-127d127b-444e-4c33-9af4-11ab0b44141b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:20.241615 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-127d127b-444e-4c33-9af4-11ab0b44141b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:20.242052 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-127d127b-444e-4c33-9af4-11ab0b44141b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:20.373335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-127d127b-444e-4c33-9af4-11ab0b44141b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:20.381087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-127d127b-444e-4c33-9af4-11ab0b44141b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.151798 May 10 21:32:20.381661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1798/2574] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:20 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:21.399354 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3d2b2ee1-2870-4e76-906e-bf2618f8db14 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:21.400050 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3d2b2ee1-2870-4e76-906e-bf2618f8db14 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:21.406617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d2b2ee1-2870-4e76-906e-bf2618f8db14 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:21.407061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d2b2ee1-2870-4e76-906e-bf2618f8db14 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:21.407851 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d2b2ee1-2870-4e76-906e-bf2618f8db14 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:21.408279 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d2b2ee1-2870-4e76-906e-bf2618f8db14 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:21.537376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3d2b2ee1-2870-4e76-906e-bf2618f8db14 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:21.545681 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3d2b2ee1-2870-4e76-906e-bf2618f8db14 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150297 May 10 21:32:21.546246 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1799/2575] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:21 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:22.562755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c22ca109-b3db-4f03-8bdf-e165b44a5a8a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:22.563533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c22ca109-b3db-4f03-8bdf-e165b44a5a8a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:22.570095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c22ca109-b3db-4f03-8bdf-e165b44a5a8a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:22.570540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c22ca109-b3db-4f03-8bdf-e165b44a5a8a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:22.571330 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c22ca109-b3db-4f03-8bdf-e165b44a5a8a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:22.571763 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c22ca109-b3db-4f03-8bdf-e165b44a5a8a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:22.703603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c22ca109-b3db-4f03-8bdf-e165b44a5a8a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:22.711620 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c22ca109-b3db-4f03-8bdf-e165b44a5a8a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.153328 May 10 21:32:22.712240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1800/2576] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:22 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:22.907951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-87b610b0-f610-4def-a0bc-997be061f0f7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:22.908489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-87b610b0-f610-4def-a0bc-997be061f0f7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: b92a0cb7-77d4-4b1c-b6eb-03060079cd40] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:22.914458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87b610b0-f610-4def-a0bc-997be061f0f7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:22.914915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87b610b0-f610-4def-a0bc-997be061f0f7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:22.915710 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87b610b0-f610-4def-a0bc-997be061f0f7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:22.916155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87b610b0-f610-4def-a0bc-997be061f0f7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:22.940150 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-87b610b0-f610-4def-a0bc-997be061f0f7 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40/ips" status: 200 len: 153 microversion: 2.20 time: 0.036113 May 10 21:32:22.940725 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1801/2577] 10.222.0.49 () {60 vars in 1288 bytes} [Tue May 10 21:32:22 2022] GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40/ips => generated 153 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 21:32:23.728121 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9c1fb936-af05-4b07-b142-58b2a14c5926 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:23.728739 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9c1fb936-af05-4b07-b142-58b2a14c5926 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:23.735638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c1fb936-af05-4b07-b142-58b2a14c5926 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:23.736087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c1fb936-af05-4b07-b142-58b2a14c5926 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:23.736860 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c1fb936-af05-4b07-b142-58b2a14c5926 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:23.737300 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c1fb936-af05-4b07-b142-58b2a14c5926 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:23.866218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9c1fb936-af05-4b07-b142-58b2a14c5926 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:23.874734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9c1fb936-af05-4b07-b142-58b2a14c5926 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150590 May 10 21:32:23.875336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1802/2578] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:23 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:24.892737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2e482b10-5ee5-4f7d-91a2-dafb020c01c0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:24.893342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2e482b10-5ee5-4f7d-91a2-dafb020c01c0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:24.899568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e482b10-5ee5-4f7d-91a2-dafb020c01c0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:24.900012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e482b10-5ee5-4f7d-91a2-dafb020c01c0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:24.900767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e482b10-5ee5-4f7d-91a2-dafb020c01c0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:24.901198 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e482b10-5ee5-4f7d-91a2-dafb020c01c0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:25.033761 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2e482b10-5ee5-4f7d-91a2-dafb020c01c0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:25.041757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2e482b10-5ee5-4f7d-91a2-dafb020c01c0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.152952 May 10 21:32:25.042318 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1803/2579] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:24 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:26.059788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-021a57cf-427e-4278-b42d-f7cd829ce605 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:26.060916 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-021a57cf-427e-4278-b42d-f7cd829ce605 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:26.067324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-021a57cf-427e-4278-b42d-f7cd829ce605 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:26.067776 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-021a57cf-427e-4278-b42d-f7cd829ce605 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:26.068542 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-021a57cf-427e-4278-b42d-f7cd829ce605 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:26.068982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-021a57cf-427e-4278-b42d-f7cd829ce605 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:26.197732 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-021a57cf-427e-4278-b42d-f7cd829ce605 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:26.206541 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-021a57cf-427e-4278-b42d-f7cd829ce605 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.151231 May 10 21:32:26.207133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1804/2580] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:26 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:27.223685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5efbb1e8-ec79-41f8-8a15-6a8e15c4bb32 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:27.224378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5efbb1e8-ec79-41f8-8a15-6a8e15c4bb32 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:27.230506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5efbb1e8-ec79-41f8-8a15-6a8e15c4bb32 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:27.230948 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5efbb1e8-ec79-41f8-8a15-6a8e15c4bb32 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:27.232400 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5efbb1e8-ec79-41f8-8a15-6a8e15c4bb32 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:27.232835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5efbb1e8-ec79-41f8-8a15-6a8e15c4bb32 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:27.360290 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5efbb1e8-ec79-41f8-8a15-6a8e15c4bb32 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:27.368099 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5efbb1e8-ec79-41f8-8a15-6a8e15c4bb32 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148322 May 10 21:32:27.368667 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1805/2581] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:27 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:28.385825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7a32b409-888b-4a3a-8fcb-f721c0abf4c9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:28.386508 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7a32b409-888b-4a3a-8fcb-f721c0abf4c9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:28.393713 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7a32b409-888b-4a3a-8fcb-f721c0abf4c9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:28.394164 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7a32b409-888b-4a3a-8fcb-f721c0abf4c9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:28.394923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7a32b409-888b-4a3a-8fcb-f721c0abf4c9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:28.395387 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7a32b409-888b-4a3a-8fcb-f721c0abf4c9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:28.529256 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7a32b409-888b-4a3a-8fcb-f721c0abf4c9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:28.537101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7a32b409-888b-4a3a-8fcb-f721c0abf4c9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.155179 May 10 21:32:28.537684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1806/2582] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:28 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:29.554991 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f3a07388-9349-4e96-ba14-39b7fd518150 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:29.555672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f3a07388-9349-4e96-ba14-39b7fd518150 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:29.562179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f3a07388-9349-4e96-ba14-39b7fd518150 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:29.562627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f3a07388-9349-4e96-ba14-39b7fd518150 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:29.563430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f3a07388-9349-4e96-ba14-39b7fd518150 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:29.563871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f3a07388-9349-4e96-ba14-39b7fd518150 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:29.693753 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f3a07388-9349-4e96-ba14-39b7fd518150 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:29.702024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f3a07388-9349-4e96-ba14-39b7fd518150 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150961 May 10 21:32:29.702595 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1807/2583] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:29 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:30.719674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dfe598cb-5ca8-4e15-8355-dc6f3a4ccea7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:30.720315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dfe598cb-5ca8-4e15-8355-dc6f3a4ccea7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:30.726756 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dfe598cb-5ca8-4e15-8355-dc6f3a4ccea7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:30.727241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dfe598cb-5ca8-4e15-8355-dc6f3a4ccea7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:30.728056 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dfe598cb-5ca8-4e15-8355-dc6f3a4ccea7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:30.728647 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dfe598cb-5ca8-4e15-8355-dc6f3a4ccea7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:30.884082 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dfe598cb-5ca8-4e15-8355-dc6f3a4ccea7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:30.893565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dfe598cb-5ca8-4e15-8355-dc6f3a4ccea7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.177986 May 10 21:32:30.894137 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1808/2584] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:30 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:31.911454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-253010c0-a501-44dc-8200-b2019d56d10c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:31.912123 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-253010c0-a501-44dc-8200-b2019d56d10c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:31.919014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-253010c0-a501-44dc-8200-b2019d56d10c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:31.919671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-253010c0-a501-44dc-8200-b2019d56d10c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:31.920441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-253010c0-a501-44dc-8200-b2019d56d10c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:31.920875 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-253010c0-a501-44dc-8200-b2019d56d10c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:32.047644 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-253010c0-a501-44dc-8200-b2019d56d10c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:32.055316 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-253010c0-a501-44dc-8200-b2019d56d10c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.147815 May 10 21:32:32.055882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1809/2585] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:31 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:33.073371 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-df4c76ca-eadf-4be6-b550-52e57da1d63b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:33.073996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-df4c76ca-eadf-4be6-b550-52e57da1d63b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:33.081378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df4c76ca-eadf-4be6-b550-52e57da1d63b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:33.081830 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df4c76ca-eadf-4be6-b550-52e57da1d63b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:33.082605 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df4c76ca-eadf-4be6-b550-52e57da1d63b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:33.083026 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df4c76ca-eadf-4be6-b550-52e57da1d63b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:33.208854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-df4c76ca-eadf-4be6-b550-52e57da1d63b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:33.218141 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-df4c76ca-eadf-4be6-b550-52e57da1d63b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148764 May 10 21:32:33.218716 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1810/2586] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:33 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:34.235703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2df458a7-823d-477a-bfad-2069a349a59c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:34.236402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2df458a7-823d-477a-bfad-2069a349a59c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:34.242579 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2df458a7-823d-477a-bfad-2069a349a59c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:34.243030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2df458a7-823d-477a-bfad-2069a349a59c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:34.243824 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2df458a7-823d-477a-bfad-2069a349a59c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:34.244269 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2df458a7-823d-477a-bfad-2069a349a59c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:34.374963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2df458a7-823d-477a-bfad-2069a349a59c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:34.382685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2df458a7-823d-477a-bfad-2069a349a59c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.151401 May 10 21:32:34.383271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1811/2587] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:34 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:35.400328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c3992c7c-22ec-451d-95ca-fb69d40a122e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:35.401097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c3992c7c-22ec-451d-95ca-fb69d40a122e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:35.407972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c3992c7c-22ec-451d-95ca-fb69d40a122e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:35.408417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c3992c7c-22ec-451d-95ca-fb69d40a122e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:35.409175 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c3992c7c-22ec-451d-95ca-fb69d40a122e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:35.409644 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c3992c7c-22ec-451d-95ca-fb69d40a122e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:35.536784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c3992c7c-22ec-451d-95ca-fb69d40a122e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:35.544773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c3992c7c-22ec-451d-95ca-fb69d40a122e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148320 May 10 21:32:35.545342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1812/2588] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:35 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:36.562094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-21d011e2-34ad-40fe-8dd7-2cc8e611b739 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:36.562802 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-21d011e2-34ad-40fe-8dd7-2cc8e611b739 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:36.569306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21d011e2-34ad-40fe-8dd7-2cc8e611b739 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:36.569749 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21d011e2-34ad-40fe-8dd7-2cc8e611b739 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:36.570502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21d011e2-34ad-40fe-8dd7-2cc8e611b739 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:36.570933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21d011e2-34ad-40fe-8dd7-2cc8e611b739 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:36.702793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-21d011e2-34ad-40fe-8dd7-2cc8e611b739 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:36.710767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-21d011e2-34ad-40fe-8dd7-2cc8e611b739 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.153028 May 10 21:32:36.711358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1813/2589] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:36 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:37.728119 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-68012096-29bd-45f4-b680-8ae3dc5965d9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:37.728730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-68012096-29bd-45f4-b680-8ae3dc5965d9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:37.735098 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-68012096-29bd-45f4-b680-8ae3dc5965d9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:37.735560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-68012096-29bd-45f4-b680-8ae3dc5965d9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:37.736321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-68012096-29bd-45f4-b680-8ae3dc5965d9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:37.736752 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-68012096-29bd-45f4-b680-8ae3dc5965d9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:37.865002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-68012096-29bd-45f4-b680-8ae3dc5965d9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:37.873222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-68012096-29bd-45f4-b680-8ae3dc5965d9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149041 May 10 21:32:37.873797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1814/2590] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:37 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:38.889912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3330510a-0425-404d-9ee4-ef92f628ba86 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:38.890494 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3330510a-0425-404d-9ee4-ef92f628ba86 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:38.896849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3330510a-0425-404d-9ee4-ef92f628ba86 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:38.897303 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3330510a-0425-404d-9ee4-ef92f628ba86 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:38.898067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3330510a-0425-404d-9ee4-ef92f628ba86 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:38.898506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3330510a-0425-404d-9ee4-ef92f628ba86 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:39.027413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3330510a-0425-404d-9ee4-ef92f628ba86 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:39.035685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3330510a-0425-404d-9ee4-ef92f628ba86 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149859 May 10 21:32:39.036254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1815/2591] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:38 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:40.052540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0c110924-4753-4e3a-82b0-7832188fdb83 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:40.053190 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0c110924-4753-4e3a-82b0-7832188fdb83 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:40.059703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c110924-4753-4e3a-82b0-7832188fdb83 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:40.060157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c110924-4753-4e3a-82b0-7832188fdb83 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:40.060930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c110924-4753-4e3a-82b0-7832188fdb83 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:40.061373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c110924-4753-4e3a-82b0-7832188fdb83 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:40.189483 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0c110924-4753-4e3a-82b0-7832188fdb83 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:40.197322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0c110924-4753-4e3a-82b0-7832188fdb83 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148834 May 10 21:32:40.197890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1816/2592] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:40 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:41.215894 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e98cff73-56a1-41f9-b6e5-687e99141a5d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:41.216667 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e98cff73-56a1-41f9-b6e5-687e99141a5d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:41.223035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e98cff73-56a1-41f9-b6e5-687e99141a5d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:41.223518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e98cff73-56a1-41f9-b6e5-687e99141a5d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:41.224275 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e98cff73-56a1-41f9-b6e5-687e99141a5d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:41.224711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e98cff73-56a1-41f9-b6e5-687e99141a5d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:41.351296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e98cff73-56a1-41f9-b6e5-687e99141a5d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:41.359812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e98cff73-56a1-41f9-b6e5-687e99141a5d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148400 May 10 21:32:41.360403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1817/2593] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:41 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:42.377658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fb6d7806-03eb-44c3-a6dc-7b38939b1d00 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:42.378333 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fb6d7806-03eb-44c3-a6dc-7b38939b1d00 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:42.384557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb6d7806-03eb-44c3-a6dc-7b38939b1d00 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:42.385000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb6d7806-03eb-44c3-a6dc-7b38939b1d00 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:42.385754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb6d7806-03eb-44c3-a6dc-7b38939b1d00 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:42.386187 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb6d7806-03eb-44c3-a6dc-7b38939b1d00 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:42.516969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fb6d7806-03eb-44c3-a6dc-7b38939b1d00 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:42.524766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fb6d7806-03eb-44c3-a6dc-7b38939b1d00 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.151052 May 10 21:32:42.525339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1818/2594] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:42 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:32:43.543220 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8bad4784-0cb2-4da8-83a0-b15b8ea62896 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:43.544997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8bad4784-0cb2-4da8-83a0-b15b8ea62896 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:43.550989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8bad4784-0cb2-4da8-83a0-b15b8ea62896 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:43.551467 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8bad4784-0cb2-4da8-83a0-b15b8ea62896 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:43.552220 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8bad4784-0cb2-4da8-83a0-b15b8ea62896 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:43.552652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8bad4784-0cb2-4da8-83a0-b15b8ea62896 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:43.680837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8bad4784-0cb2-4da8-83a0-b15b8ea62896 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:43.688649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8bad4784-0cb2-4da8-83a0-b15b8ea62896 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149349 May 10 21:32:43.689213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1819/2595] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:43 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:44.706343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fc42dc59-7865-4e7d-92a5-3d8ad45e309d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:44.707010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fc42dc59-7865-4e7d-92a5-3d8ad45e309d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:44.713513 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fc42dc59-7865-4e7d-92a5-3d8ad45e309d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:44.713952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fc42dc59-7865-4e7d-92a5-3d8ad45e309d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:44.714706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fc42dc59-7865-4e7d-92a5-3d8ad45e309d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:44.715161 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fc42dc59-7865-4e7d-92a5-3d8ad45e309d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:44.847721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fc42dc59-7865-4e7d-92a5-3d8ad45e309d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:44.855527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fc42dc59-7865-4e7d-92a5-3d8ad45e309d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.152991 May 10 21:32:44.856742 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1820/2596] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:44 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:45.872640 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-296d31b6-6c41-4ada-83f9-65cb1c9e7fcd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:45.873274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-296d31b6-6c41-4ada-83f9-65cb1c9e7fcd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:45.879493 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-296d31b6-6c41-4ada-83f9-65cb1c9e7fcd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:45.879943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-296d31b6-6c41-4ada-83f9-65cb1c9e7fcd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:45.880693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-296d31b6-6c41-4ada-83f9-65cb1c9e7fcd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:45.881126 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-296d31b6-6c41-4ada-83f9-65cb1c9e7fcd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:46.010588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-296d31b6-6c41-4ada-83f9-65cb1c9e7fcd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:46.018676 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-296d31b6-6c41-4ada-83f9-65cb1c9e7fcd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149956 May 10 21:32:46.019264 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1821/2597] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:45 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:47.036986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b4796472-d078-428e-aac0-fc342c07ad5d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:47.037635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b4796472-d078-428e-aac0-fc342c07ad5d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:47.044775 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b4796472-d078-428e-aac0-fc342c07ad5d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:47.045222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b4796472-d078-428e-aac0-fc342c07ad5d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:47.046139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b4796472-d078-428e-aac0-fc342c07ad5d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:47.046579 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b4796472-d078-428e-aac0-fc342c07ad5d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:47.172498 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b4796472-d078-428e-aac0-fc342c07ad5d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:47.180387 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b4796472-d078-428e-aac0-fc342c07ad5d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.147400 May 10 21:32:47.180953 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1822/2598] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:47 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:48.197417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1cf4b65f-419b-47c2-8a9c-a7850a0bedbe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:48.198081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1cf4b65f-419b-47c2-8a9c-a7850a0bedbe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:48.204681 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1cf4b65f-419b-47c2-8a9c-a7850a0bedbe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:48.205128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1cf4b65f-419b-47c2-8a9c-a7850a0bedbe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:48.205881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1cf4b65f-419b-47c2-8a9c-a7850a0bedbe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:48.206313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1cf4b65f-419b-47c2-8a9c-a7850a0bedbe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:48.336500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1cf4b65f-419b-47c2-8a9c-a7850a0bedbe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:48.345302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1cf4b65f-419b-47c2-8a9c-a7850a0bedbe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.151829 May 10 21:32:48.345862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1823/2599] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:48 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:49.362549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-adf8e82e-4309-4dce-a1a6-018fe9c4977a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:49.363276 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-adf8e82e-4309-4dce-a1a6-018fe9c4977a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:49.369513 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-adf8e82e-4309-4dce-a1a6-018fe9c4977a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:49.369961 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-adf8e82e-4309-4dce-a1a6-018fe9c4977a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:49.370714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-adf8e82e-4309-4dce-a1a6-018fe9c4977a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:49.371166 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-adf8e82e-4309-4dce-a1a6-018fe9c4977a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:49.497641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-adf8e82e-4309-4dce-a1a6-018fe9c4977a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:49.505371 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-adf8e82e-4309-4dce-a1a6-018fe9c4977a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.146894 May 10 21:32:49.505934 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1824/2600] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:49 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:50.523370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f527d7a4-a440-4068-863c-f79b1dc84379 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:50.524000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f527d7a4-a440-4068-863c-f79b1dc84379 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:50.531863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f527d7a4-a440-4068-863c-f79b1dc84379 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:50.532316 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f527d7a4-a440-4068-863c-f79b1dc84379 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:50.533081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f527d7a4-a440-4068-863c-f79b1dc84379 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:50.533518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f527d7a4-a440-4068-863c-f79b1dc84379 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:50.667301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f527d7a4-a440-4068-863c-f79b1dc84379 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:50.675657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f527d7a4-a440-4068-863c-f79b1dc84379 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.156300 May 10 21:32:50.676216 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1825/2601] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:50 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:51.692708 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-07ae6a68-974d-4365-9184-b1055893173d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:51.693306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-07ae6a68-974d-4365-9184-b1055893173d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:51.699693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07ae6a68-974d-4365-9184-b1055893173d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:51.700145 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07ae6a68-974d-4365-9184-b1055893173d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:51.701570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07ae6a68-974d-4365-9184-b1055893173d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:51.702015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07ae6a68-974d-4365-9184-b1055893173d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:51.836340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-07ae6a68-974d-4365-9184-b1055893173d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:51.844613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-07ae6a68-974d-4365-9184-b1055893173d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.155749 May 10 21:32:51.845191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1826/2602] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:51 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:52.861843 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fd75986d-5bd1-4e74-a953-04a47ffaab71 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:52.862454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fd75986d-5bd1-4e74-a953-04a47ffaab71 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:52.868860 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fd75986d-5bd1-4e74-a953-04a47ffaab71 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:52.869306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fd75986d-5bd1-4e74-a953-04a47ffaab71 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:52.870060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fd75986d-5bd1-4e74-a953-04a47ffaab71 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:52.870494 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fd75986d-5bd1-4e74-a953-04a47ffaab71 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:53.003130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fd75986d-5bd1-4e74-a953-04a47ffaab71 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:53.010849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fd75986d-5bd1-4e74-a953-04a47ffaab71 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.152918 May 10 21:32:53.011436 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1827/2603] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:52 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:54.028776 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fc152e88-3f74-41c9-a97d-641080db18e5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:54.029447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fc152e88-3f74-41c9-a97d-641080db18e5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:54.035953 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fc152e88-3f74-41c9-a97d-641080db18e5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:54.036395 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fc152e88-3f74-41c9-a97d-641080db18e5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:54.037151 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fc152e88-3f74-41c9-a97d-641080db18e5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:54.037702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fc152e88-3f74-41c9-a97d-641080db18e5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:54.164732 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fc152e88-3f74-41c9-a97d-641080db18e5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:54.173061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fc152e88-3f74-41c9-a97d-641080db18e5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148267 May 10 21:32:54.173620 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1828/2604] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:54 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:55.190596 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bf4ffb08-e897-47dd-802d-122fe1c86d75 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:55.191316 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bf4ffb08-e897-47dd-802d-122fe1c86d75 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:55.197656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf4ffb08-e897-47dd-802d-122fe1c86d75 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:55.198112 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf4ffb08-e897-47dd-802d-122fe1c86d75 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:55.198881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf4ffb08-e897-47dd-802d-122fe1c86d75 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:55.199388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf4ffb08-e897-47dd-802d-122fe1c86d75 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:55.328153 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bf4ffb08-e897-47dd-802d-122fe1c86d75 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:55.336147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bf4ffb08-e897-47dd-802d-122fe1c86d75 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149465 May 10 21:32:55.336715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1829/2605] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:55 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:56.353571 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3d5facc6-830b-41f6-b159-974dd9ec42f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:56.354197 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3d5facc6-830b-41f6-b159-974dd9ec42f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:56.360737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d5facc6-830b-41f6-b159-974dd9ec42f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:56.361195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d5facc6-830b-41f6-b159-974dd9ec42f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:56.361971 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d5facc6-830b-41f6-b159-974dd9ec42f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:56.362416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d5facc6-830b-41f6-b159-974dd9ec42f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:56.493906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3d5facc6-830b-41f6-b159-974dd9ec42f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:56.502464 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3d5facc6-830b-41f6-b159-974dd9ec42f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.152786 May 10 21:32:56.503034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1830/2606] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:56 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:57.520486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-77f390fa-6b1b-4451-a58a-a4c669c481d5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:57.521092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-77f390fa-6b1b-4451-a58a-a4c669c481d5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:57.528779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-77f390fa-6b1b-4451-a58a-a4c669c481d5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:57.528779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-77f390fa-6b1b-4451-a58a-a4c669c481d5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:57.528779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-77f390fa-6b1b-4451-a58a-a4c669c481d5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:57.529266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-77f390fa-6b1b-4451-a58a-a4c669c481d5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:57.658124 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-77f390fa-6b1b-4451-a58a-a4c669c481d5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:57.665980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-77f390fa-6b1b-4451-a58a-a4c669c481d5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149408 May 10 21:32:57.666544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1831/2607] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:57 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:58.683741 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6bed35d5-9338-44b2-acc1-dd2521efebd6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:58.684358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6bed35d5-9338-44b2-acc1-dd2521efebd6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:58.691425 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6bed35d5-9338-44b2-acc1-dd2521efebd6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:58.691875 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6bed35d5-9338-44b2-acc1-dd2521efebd6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:58.692629 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6bed35d5-9338-44b2-acc1-dd2521efebd6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:58.693063 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6bed35d5-9338-44b2-acc1-dd2521efebd6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:58.825367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6bed35d5-9338-44b2-acc1-dd2521efebd6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:58.834485 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6bed35d5-9338-44b2-acc1-dd2521efebd6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.154289 May 10 21:32:58.835072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1832/2608] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:58 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:32:59.852469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-143337e1-b8d1-4874-8299-eaba31821161 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:32:59.853112 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-143337e1-b8d1-4874-8299-eaba31821161 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:32:59.859703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-143337e1-b8d1-4874-8299-eaba31821161 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:59.860086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-143337e1-b8d1-4874-8299-eaba31821161 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:59.860839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-143337e1-b8d1-4874-8299-eaba31821161 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:32:59.861269 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-143337e1-b8d1-4874-8299-eaba31821161 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:32:59.988846 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-143337e1-b8d1-4874-8299-eaba31821161 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:32:59.996584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-143337e1-b8d1-4874-8299-eaba31821161 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148003 May 10 21:32:59.997142 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1833/2609] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:32:59 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:01.013851 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dbb3b35d-1eeb-4362-8379-46adc4628a1c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:01.015394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dbb3b35d-1eeb-4362-8379-46adc4628a1c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:01.021346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dbb3b35d-1eeb-4362-8379-46adc4628a1c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:01.021804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dbb3b35d-1eeb-4362-8379-46adc4628a1c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:01.022568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dbb3b35d-1eeb-4362-8379-46adc4628a1c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:01.023046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dbb3b35d-1eeb-4362-8379-46adc4628a1c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:01.151553 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dbb3b35d-1eeb-4362-8379-46adc4628a1c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:01.159599 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dbb3b35d-1eeb-4362-8379-46adc4628a1c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149662 May 10 21:33:01.160166 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1834/2610] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:01 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:02.176898 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f9884726-2ef3-4058-be4d-bbcd829bff31 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:02.177549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f9884726-2ef3-4058-be4d-bbcd829bff31 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:02.183945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f9884726-2ef3-4058-be4d-bbcd829bff31 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:02.184397 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f9884726-2ef3-4058-be4d-bbcd829bff31 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:02.185160 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f9884726-2ef3-4058-be4d-bbcd829bff31 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:02.185597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f9884726-2ef3-4058-be4d-bbcd829bff31 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:02.316710 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f9884726-2ef3-4058-be4d-bbcd829bff31 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:02.324509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f9884726-2ef3-4058-be4d-bbcd829bff31 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.151544 May 10 21:33:02.325080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1835/2611] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:02 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:03.342042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5e26ef96-f76a-4b02-828a-8372e5c07d4a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:03.342840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5e26ef96-f76a-4b02-828a-8372e5c07d4a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:03.349265 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5e26ef96-f76a-4b02-828a-8372e5c07d4a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:03.349718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5e26ef96-f76a-4b02-828a-8372e5c07d4a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:03.350481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5e26ef96-f76a-4b02-828a-8372e5c07d4a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:03.350922 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5e26ef96-f76a-4b02-828a-8372e5c07d4a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:03.478256 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5e26ef96-f76a-4b02-828a-8372e5c07d4a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:03.486510 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5e26ef96-f76a-4b02-828a-8372e5c07d4a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148323 May 10 21:33:03.487088 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1836/2612] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:03 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:04.504426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-af6af849-1d5e-451f-8d67-cc04f6a7612a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:04.505121 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-af6af849-1d5e-451f-8d67-cc04f6a7612a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:04.511466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af6af849-1d5e-451f-8d67-cc04f6a7612a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:04.511921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af6af849-1d5e-451f-8d67-cc04f6a7612a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:04.512690 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af6af849-1d5e-451f-8d67-cc04f6a7612a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:04.513130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af6af849-1d5e-451f-8d67-cc04f6a7612a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:04.646027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-af6af849-1d5e-451f-8d67-cc04f6a7612a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:04.653789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-af6af849-1d5e-451f-8d67-cc04f6a7612a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.153354 May 10 21:33:04.654366 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1837/2613] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:04 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:05.671572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3fd478fc-1ff9-40dc-ba80-5eca8a1a3a99 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:05.672217 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3fd478fc-1ff9-40dc-ba80-5eca8a1a3a99 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:05.678805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3fd478fc-1ff9-40dc-ba80-5eca8a1a3a99 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:05.679295 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3fd478fc-1ff9-40dc-ba80-5eca8a1a3a99 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:05.680100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3fd478fc-1ff9-40dc-ba80-5eca8a1a3a99 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:05.680541 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3fd478fc-1ff9-40dc-ba80-5eca8a1a3a99 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:05.806390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3fd478fc-1ff9-40dc-ba80-5eca8a1a3a99 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:05.814140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3fd478fc-1ff9-40dc-ba80-5eca8a1a3a99 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.147153 May 10 21:33:05.814710 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1838/2614] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:05 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:06.831685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bf0b048c-19fc-4c65-bd5a-121d2e1a3c85 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:06.833061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bf0b048c-19fc-4c65-bd5a-121d2e1a3c85 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:06.839983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf0b048c-19fc-4c65-bd5a-121d2e1a3c85 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:06.840448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf0b048c-19fc-4c65-bd5a-121d2e1a3c85 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:06.841226 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf0b048c-19fc-4c65-bd5a-121d2e1a3c85 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:06.841824 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf0b048c-19fc-4c65-bd5a-121d2e1a3c85 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:06.974760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bf0b048c-19fc-4c65-bd5a-121d2e1a3c85 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:06.982603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bf0b048c-19fc-4c65-bd5a-121d2e1a3c85 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.154736 May 10 21:33:06.983253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1839/2615] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:06 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:08.000391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cee76d14-4a13-4952-845f-16a91a2cdc78 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:08.001034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cee76d14-4a13-4952-845f-16a91a2cdc78 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:08.007334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cee76d14-4a13-4952-845f-16a91a2cdc78 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:08.007779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cee76d14-4a13-4952-845f-16a91a2cdc78 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:08.008532 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cee76d14-4a13-4952-845f-16a91a2cdc78 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:08.008964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cee76d14-4a13-4952-845f-16a91a2cdc78 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:08.137179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cee76d14-4a13-4952-845f-16a91a2cdc78 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:08.145684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cee76d14-4a13-4952-845f-16a91a2cdc78 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149596 May 10 21:33:08.146254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1840/2616] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:07 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:09.163498 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f7075834-8042-454e-9e86-288c6f1f46af tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:09.164156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f7075834-8042-454e-9e86-288c6f1f46af tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:09.171108 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f7075834-8042-454e-9e86-288c6f1f46af tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:09.171580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f7075834-8042-454e-9e86-288c6f1f46af tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:09.172335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f7075834-8042-454e-9e86-288c6f1f46af tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:09.172764 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f7075834-8042-454e-9e86-288c6f1f46af tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:09.298553 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f7075834-8042-454e-9e86-288c6f1f46af tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:09.306473 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f7075834-8042-454e-9e86-288c6f1f46af tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.146804 May 10 21:33:09.307039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1841/2617] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:09 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:10.323070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6acaf59a-229f-4835-955c-ce219188e21e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:10.323782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6acaf59a-229f-4835-955c-ce219188e21e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:10.330228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6acaf59a-229f-4835-955c-ce219188e21e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:10.330669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6acaf59a-229f-4835-955c-ce219188e21e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:10.331449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6acaf59a-229f-4835-955c-ce219188e21e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:10.331884 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6acaf59a-229f-4835-955c-ce219188e21e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:10.463996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6acaf59a-229f-4835-955c-ce219188e21e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:10.472330 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6acaf59a-229f-4835-955c-ce219188e21e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.153150 May 10 21:33:10.473169 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1842/2618] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:10 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:11.489905 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7b88accb-86e3-4ff5-b105-c9cd88f1c970 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:11.490580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7b88accb-86e3-4ff5-b105-c9cd88f1c970 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:11.496967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b88accb-86e3-4ff5-b105-c9cd88f1c970 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:11.497415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b88accb-86e3-4ff5-b105-c9cd88f1c970 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:11.499036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b88accb-86e3-4ff5-b105-c9cd88f1c970 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:11.499529 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b88accb-86e3-4ff5-b105-c9cd88f1c970 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:11.630852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7b88accb-86e3-4ff5-b105-c9cd88f1c970 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:11.638622 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7b88accb-86e3-4ff5-b105-c9cd88f1c970 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.152604 May 10 21:33:11.639957 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1843/2619] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:11 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:12.657384 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0e31aae1-66c9-4baa-b18d-94777c87db2d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:12.658054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0e31aae1-66c9-4baa-b18d-94777c87db2d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:12.664457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0e31aae1-66c9-4baa-b18d-94777c87db2d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:12.664910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0e31aae1-66c9-4baa-b18d-94777c87db2d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:12.665711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0e31aae1-66c9-4baa-b18d-94777c87db2d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:12.666155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0e31aae1-66c9-4baa-b18d-94777c87db2d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:12.794302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0e31aae1-66c9-4baa-b18d-94777c87db2d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:12.802015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0e31aae1-66c9-4baa-b18d-94777c87db2d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149359 May 10 21:33:12.802577 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1844/2620] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:12 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:13.819621 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f5b243e9-427b-4c24-8ae6-7a279286891e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:13.820243 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f5b243e9-427b-4c24-8ae6-7a279286891e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:13.826341 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5b243e9-427b-4c24-8ae6-7a279286891e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:13.826793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5b243e9-427b-4c24-8ae6-7a279286891e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:13.827595 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5b243e9-427b-4c24-8ae6-7a279286891e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:13.828042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5b243e9-427b-4c24-8ae6-7a279286891e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:13.958476 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f5b243e9-427b-4c24-8ae6-7a279286891e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:13.966503 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f5b243e9-427b-4c24-8ae6-7a279286891e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150791 May 10 21:33:13.967618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1845/2621] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:13 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:14.984124 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a78342b3-1e49-4973-b050-f4dc47f5b54d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:14.984757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a78342b3-1e49-4973-b050-f4dc47f5b54d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:14.990990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a78342b3-1e49-4973-b050-f4dc47f5b54d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:14.991619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a78342b3-1e49-4973-b050-f4dc47f5b54d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:14.992370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a78342b3-1e49-4973-b050-f4dc47f5b54d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:14.992804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a78342b3-1e49-4973-b050-f4dc47f5b54d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:15.119284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a78342b3-1e49-4973-b050-f4dc47f5b54d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:15.127765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a78342b3-1e49-4973-b050-f4dc47f5b54d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148415 May 10 21:33:15.128328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1846/2622] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:14 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:16.144994 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-67d1bcd1-4f11-400f-b347-976048043bee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:16.145696 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-67d1bcd1-4f11-400f-b347-976048043bee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:16.151972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-67d1bcd1-4f11-400f-b347-976048043bee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:16.152425 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-67d1bcd1-4f11-400f-b347-976048043bee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:16.153188 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-67d1bcd1-4f11-400f-b347-976048043bee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:16.153627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-67d1bcd1-4f11-400f-b347-976048043bee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:16.286691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-67d1bcd1-4f11-400f-b347-976048043bee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:16.294584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-67d1bcd1-4f11-400f-b347-976048043bee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.153552 May 10 21:33:16.295630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1847/2623] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:16 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:17.317159 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5b71978d-0b71-4832-9a2d-6c8c78f73847 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:17.317841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5b71978d-0b71-4832-9a2d-6c8c78f73847 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:17.324267 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b71978d-0b71-4832-9a2d-6c8c78f73847 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:17.339336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b71978d-0b71-4832-9a2d-6c8c78f73847 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:17.339336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b71978d-0b71-4832-9a2d-6c8c78f73847 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:17.339336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b71978d-0b71-4832-9a2d-6c8c78f73847 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:17.453889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5b71978d-0b71-4832-9a2d-6c8c78f73847 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:17.461916 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5b71978d-0b71-4832-9a2d-6c8c78f73847 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148629 May 10 21:33:17.462479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1848/2624] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:17 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:18.479852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a8a7dd97-0a55-44d6-a662-93070309d548 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:18.480493 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a8a7dd97-0a55-44d6-a662-93070309d548 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:18.487355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a8a7dd97-0a55-44d6-a662-93070309d548 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:18.487809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a8a7dd97-0a55-44d6-a662-93070309d548 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:18.488579 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a8a7dd97-0a55-44d6-a662-93070309d548 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:18.489016 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a8a7dd97-0a55-44d6-a662-93070309d548 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:18.627201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a8a7dd97-0a55-44d6-a662-93070309d548 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:18.634969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a8a7dd97-0a55-44d6-a662-93070309d548 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.159080 May 10 21:33:18.635568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1849/2625] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:18 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:19.652964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2e4c84c0-8590-4b2d-b274-d3477ea902ab tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:19.653622 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2e4c84c0-8590-4b2d-b274-d3477ea902ab tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:19.660681 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e4c84c0-8590-4b2d-b274-d3477ea902ab tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:19.661138 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e4c84c0-8590-4b2d-b274-d3477ea902ab tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:19.661909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e4c84c0-8590-4b2d-b274-d3477ea902ab tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:19.662351 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e4c84c0-8590-4b2d-b274-d3477ea902ab tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:19.789232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2e4c84c0-8590-4b2d-b274-d3477ea902ab tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:19.797249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2e4c84c0-8590-4b2d-b274-d3477ea902ab tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148153 May 10 21:33:19.797820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1850/2626] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:19 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:20.815266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-47d7d372-b61c-47e1-88c0-ae8c9c13fcb8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:20.815889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-47d7d372-b61c-47e1-88c0-ae8c9c13fcb8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:20.822201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47d7d372-b61c-47e1-88c0-ae8c9c13fcb8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:20.822654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47d7d372-b61c-47e1-88c0-ae8c9c13fcb8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:20.823437 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47d7d372-b61c-47e1-88c0-ae8c9c13fcb8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:20.823866 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47d7d372-b61c-47e1-88c0-ae8c9c13fcb8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:20.955541 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-47d7d372-b61c-47e1-88c0-ae8c9c13fcb8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:20.963600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-47d7d372-b61c-47e1-88c0-ae8c9c13fcb8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.153196 May 10 21:33:20.964162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1851/2627] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:20 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:21.981399 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ac26cd4a-3648-4020-adc5-265c1159fa47 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:21.982023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ac26cd4a-3648-4020-adc5-265c1159fa47 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:21.988360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ac26cd4a-3648-4020-adc5-265c1159fa47 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:21.988801 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ac26cd4a-3648-4020-adc5-265c1159fa47 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:21.989557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ac26cd4a-3648-4020-adc5-265c1159fa47 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:21.989987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ac26cd4a-3648-4020-adc5-265c1159fa47 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:22.116975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ac26cd4a-3648-4020-adc5-265c1159fa47 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:22.125447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ac26cd4a-3648-4020-adc5-265c1159fa47 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.147967 May 10 21:33:22.126003 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1852/2628] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:21 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:23.035995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1833eb00-c5cc-496b-9221-aa885b8b6452 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:23.036669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1833eb00-c5cc-496b-9221-aa885b8b6452 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: b92a0cb7-77d4-4b1c-b6eb-03060079cd40] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:23.042896 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1833eb00-c5cc-496b-9221-aa885b8b6452 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:23.043375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1833eb00-c5cc-496b-9221-aa885b8b6452 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:23.044140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1833eb00-c5cc-496b-9221-aa885b8b6452 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:23.044577 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1833eb00-c5cc-496b-9221-aa885b8b6452 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:23.070689 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1833eb00-c5cc-496b-9221-aa885b8b6452 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: b92a0cb7-77d4-4b1c-b6eb-03060079cd40] Going to try to terminate instance {{(pid=117714) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:33:23.371451 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1833eb00-c5cc-496b-9221-aa885b8b6452 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40" status: 204 len: 0 microversion: 2.20 time: 0.339022 May 10 21:33:23.372049 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1853/2629] 10.222.0.49 () {60 vars in 1279 bytes} [Tue May 10 21:33:23 2022] DELETE /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 10 21:33:23.377018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2e21adbc-b843-4014-ad8f-9d3b4f9552d3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:23.377711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2e21adbc-b843-4014-ad8f-9d3b4f9552d3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:23.383447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e21adbc-b843-4014-ad8f-9d3b4f9552d3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:23.383890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e21adbc-b843-4014-ad8f-9d3b4f9552d3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:23.384642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e21adbc-b843-4014-ad8f-9d3b4f9552d3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:23.385073 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e21adbc-b843-4014-ad8f-9d3b4f9552d3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:23.516575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2e21adbc-b843-4014-ad8f-9d3b4f9552d3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:23.524272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2e21adbc-b843-4014-ad8f-9d3b4f9552d3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.151146 May 10 21:33:23.524829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1854/2630] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:23 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:23.529204 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8a98e07f-2d20-4be0-a161-da476b3c9a81 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:23.529829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8a98e07f-2d20-4be0-a161-da476b3c9a81 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: b92a0cb7-77d4-4b1c-b6eb-03060079cd40] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:23.535278 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8a98e07f-2d20-4be0-a161-da476b3c9a81 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:23.535725 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8a98e07f-2d20-4be0-a161-da476b3c9a81 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:23.536478 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8a98e07f-2d20-4be0-a161-da476b3c9a81 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:23.536910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8a98e07f-2d20-4be0-a161-da476b3c9a81 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:23.667194 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8a98e07f-2d20-4be0-a161-da476b3c9a81 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:23.674974 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8a98e07f-2d20-4be0-a161-da476b3c9a81 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:23.676516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8a98e07f-2d20-4be0-a161-da476b3c9a81 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:23.677681 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8a98e07f-2d20-4be0-a161-da476b3c9a81 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40" status: 200 len: 1724 microversion: 2.20 time: 0.151946 May 10 21:33:23.678250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1855/2631] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:33:23 2022] GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:33:24.541351 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e728cc83-11e9-43cb-aeb5-58817b2924a8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:24.542069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e728cc83-11e9-43cb-aeb5-58817b2924a8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:24.549130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e728cc83-11e9-43cb-aeb5-58817b2924a8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:24.552812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e728cc83-11e9-43cb-aeb5-58817b2924a8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:24.552812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e728cc83-11e9-43cb-aeb5-58817b2924a8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:24.552812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e728cc83-11e9-43cb-aeb5-58817b2924a8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:24.681995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e728cc83-11e9-43cb-aeb5-58817b2924a8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:24.691905 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e728cc83-11e9-43cb-aeb5-58817b2924a8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.154169 May 10 21:33:24.692528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1856/2632] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:24 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:24.697085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5dc81ab2-4f69-40df-88cf-1f582d489b32 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:24.697752 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5dc81ab2-4f69-40df-88cf-1f582d489b32 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: b92a0cb7-77d4-4b1c-b6eb-03060079cd40] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:24.704765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5dc81ab2-4f69-40df-88cf-1f582d489b32 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:24.705217 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5dc81ab2-4f69-40df-88cf-1f582d489b32 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:24.705980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5dc81ab2-4f69-40df-88cf-1f582d489b32 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:24.706415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5dc81ab2-4f69-40df-88cf-1f582d489b32 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:24.914876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5dc81ab2-4f69-40df-88cf-1f582d489b32 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:24.923327 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5dc81ab2-4f69-40df-88cf-1f582d489b32 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:24.924987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5dc81ab2-4f69-40df-88cf-1f582d489b32 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:24.926364 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5dc81ab2-4f69-40df-88cf-1f582d489b32 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40" status: 200 len: 1724 microversion: 2.20 time: 0.232853 May 10 21:33:24.926928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1857/2633] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:33:24 2022] GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 21:33:25.709691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-628d1234-22dd-4720-8550-edb1f6bcc900 req-cbb0be2a-88f7-414d-b065-f402ec70cecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b92a0cb7-77d4-4b1c-b6eb-03060079cd40", "name": "network-vif-deleted", "tag": "0d188702-e9dd-421a-9c5b-d515ebde9a07"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:33:25.718692 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-628d1234-22dd-4720-8550-edb1f6bcc900 req-cbb0be2a-88f7-414d-b065-f402ec70cecf service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:25.719215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-628d1234-22dd-4720-8550-edb1f6bcc900 req-cbb0be2a-88f7-414d-b065-f402ec70cecf service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:25.730977 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-628d1234-22dd-4720-8550-edb1f6bcc900 req-cbb0be2a-88f7-414d-b065-f402ec70cecf service nova] Creating event network-vif-deleted:0d188702-e9dd-421a-9c5b-d515ebde9a07 for instance b92a0cb7-77d4-4b1c-b6eb-03060079cd40 on hv-cinder-82880 May 10 21:33:25.737378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-628d1234-22dd-4720-8550-edb1f6bcc900 req-cbb0be2a-88f7-414d-b065-f402ec70cecf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032282 May 10 21:33:25.738604 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1858/2634] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:33:25.746862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-39effaf7-2b81-46ee-90a4-022fbeeb33da tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:25.748950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-39effaf7-2b81-46ee-90a4-022fbeeb33da tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:25.757604 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39effaf7-2b81-46ee-90a4-022fbeeb33da tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:25.758061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39effaf7-2b81-46ee-90a4-022fbeeb33da tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:25.759220 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39effaf7-2b81-46ee-90a4-022fbeeb33da tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:25.761934 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39effaf7-2b81-46ee-90a4-022fbeeb33da tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:25.929594 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-39effaf7-2b81-46ee-90a4-022fbeeb33da tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:25.939740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-39effaf7-2b81-46ee-90a4-022fbeeb33da tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.199046 May 10 21:33:25.940533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1859/2635] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:25 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:25.945510 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b9a99486-7edb-4ff5-85ff-0acd5e87e639 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:25.946180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b9a99486-7edb-4ff5-85ff-0acd5e87e639 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: b92a0cb7-77d4-4b1c-b6eb-03060079cd40] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:25.955454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b9a99486-7edb-4ff5-85ff-0acd5e87e639 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:25.955911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b9a99486-7edb-4ff5-85ff-0acd5e87e639 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:25.956685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b9a99486-7edb-4ff5-85ff-0acd5e87e639 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:25.957127 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b9a99486-7edb-4ff5-85ff-0acd5e87e639 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:26.024877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b9a99486-7edb-4ff5-85ff-0acd5e87e639 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:26.032935 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b9a99486-7edb-4ff5-85ff-0acd5e87e639 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:26.034575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b9a99486-7edb-4ff5-85ff-0acd5e87e639 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da06520884ff4677af84f9e7356818ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df9bf1cf45743dc8206cab528d583a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:26.035878 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b9a99486-7edb-4ff5-85ff-0acd5e87e639 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40" status: 200 len: 1366 microversion: 2.20 time: 0.094364 May 10 21:33:26.036516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1860/2636] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:33:25 2022] GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40 => generated 1366 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 21:33:26.957083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2d3a9ee3-4840-4a1e-9de8-811f8028a196 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:26.957726 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2d3a9ee3-4840-4a1e-9de8-811f8028a196 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:26.964336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d3a9ee3-4840-4a1e-9de8-811f8028a196 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:26.964786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d3a9ee3-4840-4a1e-9de8-811f8028a196 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:26.965542 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d3a9ee3-4840-4a1e-9de8-811f8028a196 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:26.965980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d3a9ee3-4840-4a1e-9de8-811f8028a196 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:27.096217 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2d3a9ee3-4840-4a1e-9de8-811f8028a196 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:27.104114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2d3a9ee3-4840-4a1e-9de8-811f8028a196 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150894 May 10 21:33:27.104680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1861/2637] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:26 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:27.109184 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e3e4ab99-db09-4388-b612-4066e3e6c67d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:27.109779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e3e4ab99-db09-4388-b612-4066e3e6c67d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: b92a0cb7-77d4-4b1c-b6eb-03060079cd40] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:27.115294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e3e4ab99-db09-4388-b612-4066e3e6c67d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:27.115743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e3e4ab99-db09-4388-b612-4066e3e6c67d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:27.116496 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e3e4ab99-db09-4388-b612-4066e3e6c67d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:27.116927 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e3e4ab99-db09-4388-b612-4066e3e6c67d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:27.130410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-e3e4ab99-db09-4388-b612-4066e3e6c67d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] HTTP exception thrown: Instance b92a0cb7-77d4-4b1c-b6eb-03060079cd40 could not be found. May 10 21:33:27.132059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e3e4ab99-db09-4388-b612-4066e3e6c67d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Request method failure captured: May 10 21:33:27.132059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40 HTTP/1.1 May 10 21:33:27.132059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:33:27.132059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:33:27.132059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:33:27.132059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:33:27.132059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:33:27.132059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:33:27.132059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:33:27.132059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:33:27.132059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietR6Tl7QjLjKc4K1w0HGnHSaNRifu7i3MbGIwqZy-dRdsyX74b1HlxBr6BhyH3N55C0ul38iQpgHnWUEPkBG33RWMl0Yfjq6w9eHCTAp1EAs3VP7Z5vTy5x9NKqEp_4zr-iAY7V6vP-IrpJ2RHTopJm4F8nn7ELXpb1P8bWhFTtKxW4 May 10 21:33:27.132059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:33:27.132059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:33:27.132059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:33:27.132059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:33:27.132059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Openstack-Nova-Api-Version: 2.20 May 10 21:33:27.132059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:33:27.132059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:33:27.132059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 8df9bf1cf45743dc8206cab528d583a1 May 10 21:33:27.132059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1498611481 May 10 21:33:27.132059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:33:27.132059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:33:27.133835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8df9bf1cf45743dc8206cab528d583a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8df9bf1cf45743dc8206cab528d583a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8df9bf1cf45743dc8206cab528d583a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8df9bf1cf45743dc8206cab528d583a1", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:33:27.133835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1498611481 May 10 21:33:27.133835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 8df9bf1cf45743dc8206cab528d583a1 May 10 21:33:27.133835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1498611481 May 10 21:33:27.133835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-AttachVolumeShelveTestJSON-1498611481-project May 10 21:33:27.133835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:33:27.133835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:33:27.133835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: da06520884ff4677af84f9e7356818ef May 10 21:33:27.133835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1498611481-project May 10 21:33:27.133835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:33:27.133835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance b92a0cb7-77d4-4b1c-b6eb-03060079cd40 could not be found. May 10 21:33:27.133835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': 'b92a0cb7-77d4-4b1c-b6eb-03060079cd40'} May 10 21:33:27.134833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:33:27.134833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:33:27.134833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:33:27.134833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:33:27.134833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:33:27.134833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:33:27.134833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:33:27.134833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:33:27.134833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:33:27.134833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:33:27.134833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b92a0cb7-77d4-4b1c-b6eb-03060079cd40 could not be found. May 10 21:33:27.134833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:33:27.134833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:33:27.134833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:33:27.134833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:33:27.134833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:33:27.134833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:33:27.134833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:33:27.134833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:33:27.134833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:33:27.136459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:33:27.136459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:33:27.136459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:33:27.136459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:33:27.136459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:33:27.136459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:33:27.136459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:33:27.136459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b92a0cb7-77d4-4b1c-b6eb-03060079cd40 could not be found. May 10 21:33:27.136459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:33:27.136459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:33:27.136459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:33:27.136459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:33:27.136459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:33:27.136459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:33:27.136459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:33:27.136459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:33:27.136459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b92a0cb7-77d4-4b1c-b6eb-03060079cd40 could not be found. May 10 21:33:27.136459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:33:27.138027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e3e4ab99-db09-4388-b612-4066e3e6c67d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Returning 404 to user: Instance b92a0cb7-77d4-4b1c-b6eb-03060079cd40 could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:33:27.138027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e3e4ab99-db09-4388-b612-4066e3e6c67d tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40" status: 404 len: 111 microversion: 2.20 time: 0.027824 May 10 21:33:27.138027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1862/2638] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:33:27 2022] GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 21:33:27.142934 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-51177bb2-ce43-45c1-a9a7-b35abcc5dc68 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '.version_select at 0x7f85d5274a60>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:27.232477 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-51177bb2-ce43-45c1-a9a7-b35abcc5dc68 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2123220165" status: 204 len: 0 microversion: 2.20 time: 0.093907 May 10 21:33:27.233671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1863/2639] 10.222.0.49 () {60 vars in 1261 bytes} [Tue May 10 21:33:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2123220165 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 10 21:33:27.997189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-698c4686-ace2-4934-b602-5a19dd868daa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:27.997798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-698c4686-ace2-4934-b602-5a19dd868daa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: b92a0cb7-77d4-4b1c-b6eb-03060079cd40] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:28.004692 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-698c4686-ace2-4934-b602-5a19dd868daa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:28.005140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-698c4686-ace2-4934-b602-5a19dd868daa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:28.005895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-698c4686-ace2-4934-b602-5a19dd868daa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:28.006383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-698c4686-ace2-4934-b602-5a19dd868daa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:28.020076 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-698c4686-ace2-4934-b602-5a19dd868daa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] HTTP exception thrown: Instance b92a0cb7-77d4-4b1c-b6eb-03060079cd40 could not be found. May 10 21:33:28.021645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-698c4686-ace2-4934-b602-5a19dd868daa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Request method failure captured: May 10 21:33:28.021645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: DELETE /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40 HTTP/1.1 May 10 21:33:28.021645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:33:28.021645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:33:28.021645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:33:28.021645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:33:28.021645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:33:28.021645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:33:28.021645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:33:28.021645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:33:28.021645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietR6Tl7QjLjKc4K1w0HGnHSaNRifu7i3MbGIwqZy-dRdsyX74b1HlxBr6BhyH3N55C0ul38iQpgHnWUEPkBG33RWMl0Yfjq6w9eHCTAp1EAs3VP7Z5vTy5x9NKqEp_4zr-iAY7V6vP-IrpJ2RHTopJm4F8nn7ELXpb1P8bWhFTtKxW4 May 10 21:33:28.021645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:33:28.021645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:33:28.021645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:33:28.021645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:33:28.021645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Openstack-Nova-Api-Version: 2.20 May 10 21:33:28.021645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:33:28.021645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:33:28.021645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 8df9bf1cf45743dc8206cab528d583a1 May 10 21:33:28.021645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1498611481 May 10 21:33:28.021645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:33:28.021645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:33:28.023348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8df9bf1cf45743dc8206cab528d583a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8df9bf1cf45743dc8206cab528d583a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8df9bf1cf45743dc8206cab528d583a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8df9bf1cf45743dc8206cab528d583a1", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:33:28.023348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1498611481 May 10 21:33:28.023348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 8df9bf1cf45743dc8206cab528d583a1 May 10 21:33:28.023348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1498611481 May 10 21:33:28.023348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-AttachVolumeShelveTestJSON-1498611481-project May 10 21:33:28.023348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:33:28.023348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:33:28.023348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: da06520884ff4677af84f9e7356818ef May 10 21:33:28.023348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1498611481-project May 10 21:33:28.023348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:33:28.023348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance b92a0cb7-77d4-4b1c-b6eb-03060079cd40 could not be found. May 10 21:33:28.023348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': 'b92a0cb7-77d4-4b1c-b6eb-03060079cd40'} May 10 21:33:28.024283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:33:28.024283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:33:28.024283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:33:28.024283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:33:28.024283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:33:28.024283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:33:28.024283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:33:28.024283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:33:28.024283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:33:28.024283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:33:28.024283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b92a0cb7-77d4-4b1c-b6eb-03060079cd40 could not be found. May 10 21:33:28.024283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:33:28.024283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:33:28.024283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:33:28.024283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:33:28.024283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:33:28.024283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:33:28.024283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:33:28.024283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:33:28.024283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:33:28.025793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:33:28.025793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 21:33:28.025793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 21:33:28.025793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 21:33:28.025793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 21:33:28.025793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:33:28.025793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:33:28.025793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:33:28.025793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:33:28.025793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b92a0cb7-77d4-4b1c-b6eb-03060079cd40 could not be found. May 10 21:33:28.025793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:33:28.025793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:33:28.025793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:33:28.025793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:33:28.025793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:33:28.025793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:33:28.025793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:33:28.025793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:33:28.025793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b92a0cb7-77d4-4b1c-b6eb-03060079cd40 could not be found. May 10 21:33:28.025793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:33:28.027269 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-698c4686-ace2-4934-b602-5a19dd868daa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Returning 404 to user: Instance b92a0cb7-77d4-4b1c-b6eb-03060079cd40 could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:33:28.027269 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-698c4686-ace2-4934-b602-5a19dd868daa tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40" status: 404 len: 111 microversion: 2.20 time: 0.030249 May 10 21:33:28.027269 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1864/2640] 10.222.0.49 () {60 vars in 1279 bytes} [Tue May 10 21:33:27 2022] DELETE /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 10 21:33:28.031103 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-586a0f56-858e-43d4-842d-8c0617258808 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:28.032467 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-586a0f56-858e-43d4-842d-8c0617258808 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: b92a0cb7-77d4-4b1c-b6eb-03060079cd40] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:28.038083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-586a0f56-858e-43d4-842d-8c0617258808 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:28.038530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-586a0f56-858e-43d4-842d-8c0617258808 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:28.039312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-586a0f56-858e-43d4-842d-8c0617258808 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:28.039749 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-586a0f56-858e-43d4-842d-8c0617258808 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:28.052414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-586a0f56-858e-43d4-842d-8c0617258808 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] HTTP exception thrown: Instance b92a0cb7-77d4-4b1c-b6eb-03060079cd40 could not be found. May 10 21:33:28.053895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-586a0f56-858e-43d4-842d-8c0617258808 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Request method failure captured: May 10 21:33:28.053895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40 HTTP/1.1 May 10 21:33:28.053895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:33:28.053895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:33:28.053895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:33:28.053895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:33:28.053895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:33:28.053895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:33:28.053895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:33:28.053895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:33:28.053895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietR6Tl7QjLjKc4K1w0HGnHSaNRifu7i3MbGIwqZy-dRdsyX74b1HlxBr6BhyH3N55C0ul38iQpgHnWUEPkBG33RWMl0Yfjq6w9eHCTAp1EAs3VP7Z5vTy5x9NKqEp_4zr-iAY7V6vP-IrpJ2RHTopJm4F8nn7ELXpb1P8bWhFTtKxW4 May 10 21:33:28.053895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:33:28.053895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:33:28.053895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:33:28.053895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:33:28.053895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Openstack-Nova-Api-Version: 2.20 May 10 21:33:28.053895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:33:28.053895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:33:28.053895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 8df9bf1cf45743dc8206cab528d583a1 May 10 21:33:28.053895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1498611481 May 10 21:33:28.053895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:33:28.053895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:33:28.055648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8df9bf1cf45743dc8206cab528d583a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8df9bf1cf45743dc8206cab528d583a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8df9bf1cf45743dc8206cab528d583a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8df9bf1cf45743dc8206cab528d583a1", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:33:28.055648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1498611481 May 10 21:33:28.055648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 8df9bf1cf45743dc8206cab528d583a1 May 10 21:33:28.055648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1498611481 May 10 21:33:28.055648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-AttachVolumeShelveTestJSON-1498611481-project May 10 21:33:28.055648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:33:28.055648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:33:28.055648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: da06520884ff4677af84f9e7356818ef May 10 21:33:28.055648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1498611481-project May 10 21:33:28.055648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:33:28.055648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance b92a0cb7-77d4-4b1c-b6eb-03060079cd40 could not be found. May 10 21:33:28.055648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': 'b92a0cb7-77d4-4b1c-b6eb-03060079cd40'} May 10 21:33:28.056560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:33:28.056560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:33:28.056560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:33:28.056560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:33:28.056560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:33:28.056560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:33:28.056560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:33:28.056560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:33:28.056560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:33:28.056560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:33:28.056560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b92a0cb7-77d4-4b1c-b6eb-03060079cd40 could not be found. May 10 21:33:28.056560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:33:28.056560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:33:28.056560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:33:28.056560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:33:28.056560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:33:28.056560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:33:28.056560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:33:28.056560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:33:28.056560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:33:28.058157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:33:28.058157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:33:28.058157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:33:28.058157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:33:28.058157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:33:28.058157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:33:28.058157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:33:28.058157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b92a0cb7-77d4-4b1c-b6eb-03060079cd40 could not be found. May 10 21:33:28.058157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:33:28.058157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:33:28.058157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:33:28.058157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:33:28.058157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:33:28.058157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:33:28.058157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:33:28.058157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:33:28.058157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b92a0cb7-77d4-4b1c-b6eb-03060079cd40 could not be found. May 10 21:33:28.058157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:33:28.059842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-586a0f56-858e-43d4-842d-8c0617258808 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Returning 404 to user: Instance b92a0cb7-77d4-4b1c-b6eb-03060079cd40 could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:33:28.059842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-586a0f56-858e-43d4-842d-8c0617258808 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40" status: 404 len: 111 microversion: 2.20 time: 0.027758 May 10 21:33:28.059842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1865/2641] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:33:28 2022] GET /compute/v2.1/servers/b92a0cb7-77d4-4b1c-b6eb-03060079cd40 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 10 21:33:28.121194 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f08c1bf5-d75c-4b16-aa43-d57069466ec8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:28.121728 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f08c1bf5-d75c-4b16-aa43-d57069466ec8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:28.127977 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f08c1bf5-d75c-4b16-aa43-d57069466ec8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:28.128430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f08c1bf5-d75c-4b16-aa43-d57069466ec8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:28.129191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f08c1bf5-d75c-4b16-aa43-d57069466ec8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:28.129631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f08c1bf5-d75c-4b16-aa43-d57069466ec8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:28.258672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f08c1bf5-d75c-4b16-aa43-d57069466ec8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:28.266978 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f08c1bf5-d75c-4b16-aa43-d57069466ec8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149536 May 10 21:33:28.267559 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1866/2642] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:28 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:29.284341 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-73eb3644-6916-49a8-8c71-e3de28a906d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:29.284981 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-73eb3644-6916-49a8-8c71-e3de28a906d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:29.291410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-73eb3644-6916-49a8-8c71-e3de28a906d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:29.291858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-73eb3644-6916-49a8-8c71-e3de28a906d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:29.292611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-73eb3644-6916-49a8-8c71-e3de28a906d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:29.293043 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-73eb3644-6916-49a8-8c71-e3de28a906d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:29.423536 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-73eb3644-6916-49a8-8c71-e3de28a906d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:29.431300 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-73eb3644-6916-49a8-8c71-e3de28a906d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.151454 May 10 21:33:29.431857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1867/2643] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:29 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:30.448410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9f5d24c4-e403-4c8d-b10a-47a422b51559 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:30.449027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9f5d24c4-e403-4c8d-b10a-47a422b51559 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:30.455995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9f5d24c4-e403-4c8d-b10a-47a422b51559 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:30.456482 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9f5d24c4-e403-4c8d-b10a-47a422b51559 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:30.457304 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9f5d24c4-e403-4c8d-b10a-47a422b51559 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:30.457740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9f5d24c4-e403-4c8d-b10a-47a422b51559 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:30.587568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9f5d24c4-e403-4c8d-b10a-47a422b51559 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:30.596433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9f5d24c4-e403-4c8d-b10a-47a422b51559 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.151950 May 10 21:33:30.596996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1868/2644] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:30 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:31.613798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1350c1a7-f074-40fc-b302-f4ad3531def1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:31.614402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1350c1a7-f074-40fc-b302-f4ad3531def1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:31.620909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1350c1a7-f074-40fc-b302-f4ad3531def1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:31.621367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1350c1a7-f074-40fc-b302-f4ad3531def1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:31.622142 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1350c1a7-f074-40fc-b302-f4ad3531def1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:31.622588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1350c1a7-f074-40fc-b302-f4ad3531def1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:31.777143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1350c1a7-f074-40fc-b302-f4ad3531def1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:31.785788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1350c1a7-f074-40fc-b302-f4ad3531def1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.176025 May 10 21:33:31.786373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1869/2645] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:31 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:32.804459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2c95ac9a-5f63-4800-8a14-88a8ccb3c604 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:32.805091 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2c95ac9a-5f63-4800-8a14-88a8ccb3c604 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:32.811453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c95ac9a-5f63-4800-8a14-88a8ccb3c604 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:32.811900 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c95ac9a-5f63-4800-8a14-88a8ccb3c604 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:32.813286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c95ac9a-5f63-4800-8a14-88a8ccb3c604 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:32.813721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c95ac9a-5f63-4800-8a14-88a8ccb3c604 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:32.942415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2c95ac9a-5f63-4800-8a14-88a8ccb3c604 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:32.950202 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2c95ac9a-5f63-4800-8a14-88a8ccb3c604 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149972 May 10 21:33:32.950757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1870/2646] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:32 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:33.967762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bbf9e44d-a132-481b-a0d8-1acb50617e65 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:33.968406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bbf9e44d-a132-481b-a0d8-1acb50617e65 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:33.974609 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bbf9e44d-a132-481b-a0d8-1acb50617e65 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:33.975047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bbf9e44d-a132-481b-a0d8-1acb50617e65 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:33.979255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bbf9e44d-a132-481b-a0d8-1acb50617e65 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:33.979255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bbf9e44d-a132-481b-a0d8-1acb50617e65 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:34.106396 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bbf9e44d-a132-481b-a0d8-1acb50617e65 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:34.114757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bbf9e44d-a132-481b-a0d8-1acb50617e65 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150923 May 10 21:33:34.115355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1871/2647] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:33 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:35.131706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6860efb8-5221-4e15-b758-55edf14d65c1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:35.132348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6860efb8-5221-4e15-b758-55edf14d65c1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:35.138659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6860efb8-5221-4e15-b758-55edf14d65c1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:35.139110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6860efb8-5221-4e15-b758-55edf14d65c1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:35.139914 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6860efb8-5221-4e15-b758-55edf14d65c1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:35.141061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6860efb8-5221-4e15-b758-55edf14d65c1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:35.264815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6860efb8-5221-4e15-b758-55edf14d65c1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:35.273042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6860efb8-5221-4e15-b758-55edf14d65c1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.145233 May 10 21:33:35.273608 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1872/2648] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:35 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:36.290241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-457cca11-5f64-4e60-92b8-9aea7ed23e6c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:36.291103 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-457cca11-5f64-4e60-92b8-9aea7ed23e6c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:36.298875 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-457cca11-5f64-4e60-92b8-9aea7ed23e6c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:36.299447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-457cca11-5f64-4e60-92b8-9aea7ed23e6c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:36.300223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-457cca11-5f64-4e60-92b8-9aea7ed23e6c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:36.300666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-457cca11-5f64-4e60-92b8-9aea7ed23e6c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:36.427325 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-457cca11-5f64-4e60-92b8-9aea7ed23e6c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:36.435080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-457cca11-5f64-4e60-92b8-9aea7ed23e6c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148752 May 10 21:33:36.435678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1873/2649] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:36 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:37.455401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2cea3fcd-cf84-4d65-adb9-85c74a050ba7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:37.456110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2cea3fcd-cf84-4d65-adb9-85c74a050ba7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:37.462666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2cea3fcd-cf84-4d65-adb9-85c74a050ba7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:37.463147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2cea3fcd-cf84-4d65-adb9-85c74a050ba7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:37.463923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2cea3fcd-cf84-4d65-adb9-85c74a050ba7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:37.464369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2cea3fcd-cf84-4d65-adb9-85c74a050ba7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:37.598002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2cea3fcd-cf84-4d65-adb9-85c74a050ba7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:37.605965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2cea3fcd-cf84-4d65-adb9-85c74a050ba7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.155316 May 10 21:33:37.606532 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1874/2650] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:37 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:38.625541 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e471d229-b5c5-4e47-ab6a-26c7be139b21 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:38.626982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e471d229-b5c5-4e47-ab6a-26c7be139b21 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:38.633189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e471d229-b5c5-4e47-ab6a-26c7be139b21 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:38.633643 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e471d229-b5c5-4e47-ab6a-26c7be139b21 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:38.634413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e471d229-b5c5-4e47-ab6a-26c7be139b21 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:38.634851 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e471d229-b5c5-4e47-ab6a-26c7be139b21 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:38.772738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e471d229-b5c5-4e47-ab6a-26c7be139b21 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:38.780459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e471d229-b5c5-4e47-ab6a-26c7be139b21 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.161319 May 10 21:33:38.781044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1875/2651] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:38 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:39.799138 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a0f2327f-5b47-4b70-b3fa-920782bfb274 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:39.799791 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a0f2327f-5b47-4b70-b3fa-920782bfb274 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:39.806089 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0f2327f-5b47-4b70-b3fa-920782bfb274 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:39.806535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0f2327f-5b47-4b70-b3fa-920782bfb274 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:39.807325 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0f2327f-5b47-4b70-b3fa-920782bfb274 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:39.807762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0f2327f-5b47-4b70-b3fa-920782bfb274 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:39.938380 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a0f2327f-5b47-4b70-b3fa-920782bfb274 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:39.946155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a0f2327f-5b47-4b70-b3fa-920782bfb274 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150913 May 10 21:33:39.946712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1876/2652] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:39 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:40.964049 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a4934c4f-704e-4283-893e-6105c6d5fcc0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:40.964712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a4934c4f-704e-4283-893e-6105c6d5fcc0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:40.971393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a4934c4f-704e-4283-893e-6105c6d5fcc0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:40.974794 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a4934c4f-704e-4283-893e-6105c6d5fcc0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:40.974794 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a4934c4f-704e-4283-893e-6105c6d5fcc0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:40.974794 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a4934c4f-704e-4283-893e-6105c6d5fcc0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:41.102750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a4934c4f-704e-4283-893e-6105c6d5fcc0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:41.111292 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a4934c4f-704e-4283-893e-6105c6d5fcc0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.151511 May 10 21:33:41.111791 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1877/2653] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:40 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:42.128827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bb52f748-e44d-49f9-9abf-a42c2e6d361e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:42.129515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bb52f748-e44d-49f9-9abf-a42c2e6d361e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:42.135790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bb52f748-e44d-49f9-9abf-a42c2e6d361e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:42.136236 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bb52f748-e44d-49f9-9abf-a42c2e6d361e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:42.137000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bb52f748-e44d-49f9-9abf-a42c2e6d361e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:42.137431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bb52f748-e44d-49f9-9abf-a42c2e6d361e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:42.262567 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bb52f748-e44d-49f9-9abf-a42c2e6d361e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:42.271195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bb52f748-e44d-49f9-9abf-a42c2e6d361e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.146738 May 10 21:33:42.271759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1878/2654] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:42 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:43.288362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2385746b-6abe-46ec-b477-4fe695e1f9e8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:43.288991 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2385746b-6abe-46ec-b477-4fe695e1f9e8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:43.295174 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2385746b-6abe-46ec-b477-4fe695e1f9e8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:43.295624 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2385746b-6abe-46ec-b477-4fe695e1f9e8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:43.296380 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2385746b-6abe-46ec-b477-4fe695e1f9e8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:43.297414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2385746b-6abe-46ec-b477-4fe695e1f9e8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:43.428807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2385746b-6abe-46ec-b477-4fe695e1f9e8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:43.436658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2385746b-6abe-46ec-b477-4fe695e1f9e8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.152331 May 10 21:33:43.437220 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1879/2655] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:43 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:44.454206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e69f20b6-4a83-4978-b94a-80ea326a6636 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:44.454902 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e69f20b6-4a83-4978-b94a-80ea326a6636 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:44.461074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e69f20b6-4a83-4978-b94a-80ea326a6636 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:44.461518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e69f20b6-4a83-4978-b94a-80ea326a6636 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:44.462267 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e69f20b6-4a83-4978-b94a-80ea326a6636 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:44.462718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e69f20b6-4a83-4978-b94a-80ea326a6636 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:44.592236 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e69f20b6-4a83-4978-b94a-80ea326a6636 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:44.600783 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e69f20b6-4a83-4978-b94a-80ea326a6636 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150763 May 10 21:33:44.601352 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1880/2656] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:44 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:45.621610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d71121aa-1c4b-43f9-8ff5-049f51618154 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:45.621610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d71121aa-1c4b-43f9-8ff5-049f51618154 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:45.625562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d71121aa-1c4b-43f9-8ff5-049f51618154 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:45.626083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d71121aa-1c4b-43f9-8ff5-049f51618154 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:45.626848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d71121aa-1c4b-43f9-8ff5-049f51618154 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:45.627328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d71121aa-1c4b-43f9-8ff5-049f51618154 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:45.758237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d71121aa-1c4b-43f9-8ff5-049f51618154 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:45.766258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d71121aa-1c4b-43f9-8ff5-049f51618154 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.151955 May 10 21:33:45.766818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1881/2657] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:45 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:46.783905 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f6836243-32f4-4057-9f27-234c60f7434f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:46.784498 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f6836243-32f4-4057-9f27-234c60f7434f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:46.790897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6836243-32f4-4057-9f27-234c60f7434f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:46.791383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6836243-32f4-4057-9f27-234c60f7434f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:46.792151 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6836243-32f4-4057-9f27-234c60f7434f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:46.792586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6836243-32f4-4057-9f27-234c60f7434f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:46.920645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f6836243-32f4-4057-9f27-234c60f7434f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:46.928538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f6836243-32f4-4057-9f27-234c60f7434f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149194 May 10 21:33:46.929097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1882/2658] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:46 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:47.945839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c122309c-685b-4a26-a0e0-666337a4f8c2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:47.946485 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c122309c-685b-4a26-a0e0-666337a4f8c2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:47.952698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c122309c-685b-4a26-a0e0-666337a4f8c2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:47.953210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c122309c-685b-4a26-a0e0-666337a4f8c2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:47.954031 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c122309c-685b-4a26-a0e0-666337a4f8c2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:47.954465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c122309c-685b-4a26-a0e0-666337a4f8c2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:48.082718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c122309c-685b-4a26-a0e0-666337a4f8c2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:48.090782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c122309c-685b-4a26-a0e0-666337a4f8c2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148921 May 10 21:33:48.091378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1883/2659] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:47 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:49.108537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b8e9a346-79e6-4877-b621-4e135bfd1c6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:49.109840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b8e9a346-79e6-4877-b621-4e135bfd1c6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:49.116626 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b8e9a346-79e6-4877-b621-4e135bfd1c6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:49.117080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b8e9a346-79e6-4877-b621-4e135bfd1c6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:49.117920 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b8e9a346-79e6-4877-b621-4e135bfd1c6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:49.118363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b8e9a346-79e6-4877-b621-4e135bfd1c6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:49.245628 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b8e9a346-79e6-4877-b621-4e135bfd1c6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:49.254037 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b8e9a346-79e6-4877-b621-4e135bfd1c6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149365 May 10 21:33:49.254613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1884/2660] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:49 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:50.272060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-34759e0b-a564-4b48-8e02-e459751810a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:50.272677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-34759e0b-a564-4b48-8e02-e459751810a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:50.279235 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-34759e0b-a564-4b48-8e02-e459751810a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:50.279684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-34759e0b-a564-4b48-8e02-e459751810a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:50.280443 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-34759e0b-a564-4b48-8e02-e459751810a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:50.280881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-34759e0b-a564-4b48-8e02-e459751810a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:50.407040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-34759e0b-a564-4b48-8e02-e459751810a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:50.414815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-34759e0b-a564-4b48-8e02-e459751810a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.146590 May 10 21:33:50.415417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1885/2661] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:50 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:51.432372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7b61f02b-3d93-47e0-8b2a-8a99dbf241d7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:51.433037 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7b61f02b-3d93-47e0-8b2a-8a99dbf241d7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:51.439790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b61f02b-3d93-47e0-8b2a-8a99dbf241d7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:51.440285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b61f02b-3d93-47e0-8b2a-8a99dbf241d7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:51.441040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b61f02b-3d93-47e0-8b2a-8a99dbf241d7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:51.441480 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b61f02b-3d93-47e0-8b2a-8a99dbf241d7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:51.571936 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7b61f02b-3d93-47e0-8b2a-8a99dbf241d7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:51.580509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7b61f02b-3d93-47e0-8b2a-8a99dbf241d7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.151993 May 10 21:33:51.581088 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1886/2662] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:51 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:52.598505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-189bdf0b-c1a3-4b04-8832-f659e943b71a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:52.599439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-189bdf0b-c1a3-4b04-8832-f659e943b71a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:52.605866 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-189bdf0b-c1a3-4b04-8832-f659e943b71a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:52.606316 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-189bdf0b-c1a3-4b04-8832-f659e943b71a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:52.607087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-189bdf0b-c1a3-4b04-8832-f659e943b71a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:52.608024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-189bdf0b-c1a3-4b04-8832-f659e943b71a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:52.735660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-189bdf0b-c1a3-4b04-8832-f659e943b71a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:52.743410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-189bdf0b-c1a3-4b04-8832-f659e943b71a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149299 May 10 21:33:52.743976 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1887/2663] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:52 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:53.761113 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0d0458f7-c0ef-4267-b97f-ea7df5e9fd48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:53.761828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0d0458f7-c0ef-4267-b97f-ea7df5e9fd48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:53.768589 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d0458f7-c0ef-4267-b97f-ea7df5e9fd48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:53.769036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d0458f7-c0ef-4267-b97f-ea7df5e9fd48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:53.769788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d0458f7-c0ef-4267-b97f-ea7df5e9fd48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:53.770219 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d0458f7-c0ef-4267-b97f-ea7df5e9fd48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:53.901110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0d0458f7-c0ef-4267-b97f-ea7df5e9fd48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:53.909290 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0d0458f7-c0ef-4267-b97f-ea7df5e9fd48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.152107 May 10 21:33:53.909861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1888/2664] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:53 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:54.926543 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-128208e0-251a-4d2a-a6ee-201bc64a56c8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:54.927348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-128208e0-251a-4d2a-a6ee-201bc64a56c8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:54.933470 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-128208e0-251a-4d2a-a6ee-201bc64a56c8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:54.933916 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-128208e0-251a-4d2a-a6ee-201bc64a56c8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:54.934673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-128208e0-251a-4d2a-a6ee-201bc64a56c8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:54.935104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-128208e0-251a-4d2a-a6ee-201bc64a56c8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:55.065418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-128208e0-251a-4d2a-a6ee-201bc64a56c8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:55.073243 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-128208e0-251a-4d2a-a6ee-201bc64a56c8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150632 May 10 21:33:55.079433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1889/2665] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:54 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:56.090998 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-804c48fd-fe38-43a1-9bba-f439f38bdd91 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:56.091703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-804c48fd-fe38-43a1-9bba-f439f38bdd91 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:56.098470 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-804c48fd-fe38-43a1-9bba-f439f38bdd91 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:56.098915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-804c48fd-fe38-43a1-9bba-f439f38bdd91 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:56.099712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-804c48fd-fe38-43a1-9bba-f439f38bdd91 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:56.100150 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-804c48fd-fe38-43a1-9bba-f439f38bdd91 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:56.226475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-804c48fd-fe38-43a1-9bba-f439f38bdd91 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:56.234247 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-804c48fd-fe38-43a1-9bba-f439f38bdd91 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.147180 May 10 21:33:56.235486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1890/2666] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:56 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:57.253236 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a38e73d7-d609-4594-9b85-20c915fb709e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:57.253899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a38e73d7-d609-4594-9b85-20c915fb709e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:57.260125 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a38e73d7-d609-4594-9b85-20c915fb709e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:57.260588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a38e73d7-d609-4594-9b85-20c915fb709e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:57.261336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a38e73d7-d609-4594-9b85-20c915fb709e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:57.261774 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a38e73d7-d609-4594-9b85-20c915fb709e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:57.394108 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a38e73d7-d609-4594-9b85-20c915fb709e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:57.403409 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a38e73d7-d609-4594-9b85-20c915fb709e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.154649 May 10 21:33:57.404134 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1891/2667] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:57 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:58.421781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4fa27f99-9312-42b9-a32a-f587c1cbe870 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:58.422461 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4fa27f99-9312-42b9-a32a-f587c1cbe870 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:58.429230 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4fa27f99-9312-42b9-a32a-f587c1cbe870 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:58.429682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4fa27f99-9312-42b9-a32a-f587c1cbe870 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:58.430451 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4fa27f99-9312-42b9-a32a-f587c1cbe870 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:58.430890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4fa27f99-9312-42b9-a32a-f587c1cbe870 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:58.564528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4fa27f99-9312-42b9-a32a-f587c1cbe870 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:58.576318 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4fa27f99-9312-42b9-a32a-f587c1cbe870 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.158378 May 10 21:33:58.577040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1892/2668] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:58 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:33:58.582320 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-979d1a43-d6da-4ccd-b08b-148c5259d8dd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:58.582862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-979d1a43-d6da-4ccd-b08b-148c5259d8dd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:58.593406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-979d1a43-d6da-4ccd-b08b-148c5259d8dd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:58.593406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-979d1a43-d6da-4ccd-b08b-148c5259d8dd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:58.593406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-979d1a43-d6da-4ccd-b08b-148c5259d8dd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:58.593406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-979d1a43-d6da-4ccd-b08b-148c5259d8dd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:58.617418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-979d1a43-d6da-4ccd-b08b-148c5259d8dd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Going to try to terminate instance {{(pid=117714) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:33:58.954522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-979d1a43-d6da-4ccd-b08b-148c5259d8dd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 204 len: 0 microversion: 2.1 time: 0.375534 May 10 21:33:58.955110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1893/2669] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 21:33:58 2022] DELETE /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 21:33:58.960546 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7eed3b34-d1ab-4a7a-b576-e9c2b33da92f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:58.961156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7eed3b34-d1ab-4a7a-b576-e9c2b33da92f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:58.966948 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7eed3b34-d1ab-4a7a-b576-e9c2b33da92f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:58.967429 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7eed3b34-d1ab-4a7a-b576-e9c2b33da92f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:58.968189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7eed3b34-d1ab-4a7a-b576-e9c2b33da92f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:58.968624 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7eed3b34-d1ab-4a7a-b576-e9c2b33da92f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:58.996418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7eed3b34-d1ab-4a7a-b576-e9c2b33da92f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Going to try to terminate instance {{(pid=117714) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:33:59.259154 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7eed3b34-d1ab-4a7a-b576-e9c2b33da92f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 204 len: 0 microversion: 2.1 time: 0.302376 May 10 21:33:59.259671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1894/2670] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 21:33:58 2022] DELETE /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 21:33:59.264662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f75fd783-7859-4d1c-859f-f16b52d78d57 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:59.267028 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f75fd783-7859-4d1c-859f-f16b52d78d57 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 92b6d664-37d6-422f-a52a-0ffec8a44389] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:59.271869 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f75fd783-7859-4d1c-859f-f16b52d78d57 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:59.272315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f75fd783-7859-4d1c-859f-f16b52d78d57 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:59.273077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f75fd783-7859-4d1c-859f-f16b52d78d57 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:59.273552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f75fd783-7859-4d1c-859f-f16b52d78d57 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:59.286996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-f75fd783-7859-4d1c-859f-f16b52d78d57 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] HTTP exception thrown: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:33:59.289080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f75fd783-7859-4d1c-859f-f16b52d78d57 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Request method failure captured: May 10 21:33:59.289080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: DELETE /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389 HTTP/1.1 May 10 21:33:59.289080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:33:59.289080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:33:59.289080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:33:59.289080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:33:59.289080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:33:59.289080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:33:59.289080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:33:59.289080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:33:59.289080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietSAJMT-hnL6qBkRs7bZ3-110HT4ymfZj92vRoBUEAGHIeo_ldK2Vr4zsDgcllgzjIBDSyio1stjSGyxN0jeNBxfaE1kSHTlyNAeVLUtctiC1v8O3DwT8su8M8miZ3QqxTaNbg2K8kPDMc7k5ZJZ4ZhBF8q-vP6lWzvhhrcux6GAj2A May 10 21:33:59.289080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:33:59.289080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:33:59.289080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:33:59.289080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:33:59.289080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:33:59.289080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:33:59.289080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: bd946455713e4c36a8efadbce486ee8b May 10 21:33:59.289080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-AttachVolumeTestJSON-824855839 May 10 21:33:59.289080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:33:59.289080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:33:59.290720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd946455713e4c36a8efadbce486ee8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bd946455713e4c36a8efadbce486ee8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd946455713e4c36a8efadbce486ee8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bd946455713e4c36a8efadbce486ee8b", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:33:59.290720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-AttachVolumeTestJSON-824855839 May 10 21:33:59.290720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: bd946455713e4c36a8efadbce486ee8b May 10 21:33:59.290720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-AttachVolumeTestJSON-824855839 May 10 21:33:59.290720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-AttachVolumeTestJSON-824855839-project May 10 21:33:59.290720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:33:59.290720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:33:59.290720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: dc411f6a0a024e7eac561ad1b6d2a944 May 10 21:33:59.290720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-AttachVolumeTestJSON-824855839-project May 10 21:33:59.290720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:33:59.290720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:33:59.290720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': '92b6d664-37d6-422f-a52a-0ffec8a44389'} May 10 21:33:59.291588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:33:59.291588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:33:59.291588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:33:59.291588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:33:59.291588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:33:59.291588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:33:59.291588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:33:59.291588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:33:59.291588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:33:59.291588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:33:59.291588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:33:59.291588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:33:59.291588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:33:59.291588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:33:59.291588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:33:59.291588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:33:59.291588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:33:59.291588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:33:59.291588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:33:59.291588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:33:59.293059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:33:59.293059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 21:33:59.293059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 21:33:59.293059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 21:33:59.293059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 21:33:59.293059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:33:59.293059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:33:59.293059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:33:59.293059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:33:59.293059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:33:59.293059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:33:59.293059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:33:59.293059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:33:59.293059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:33:59.293059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:33:59.293059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:33:59.293059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:33:59.293059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:33:59.293059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:33:59.293059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:33:59.294439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f75fd783-7859-4d1c-859f-f16b52d78d57 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Returning 404 to user: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:33:59.294439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f75fd783-7859-4d1c-859f-f16b52d78d57 tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "DELETE /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389" status: 404 len: 111 microversion: 2.1 time: 0.029272 May 10 21:33:59.294439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1895/2671] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 21:33:59 2022] DELETE /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:33:59.294940 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-36f0667f-52db-4404-b2d5-114024116cde tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:59.295562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-36f0667f-52db-4404-b2d5-114024116cde tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:59.301530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-36f0667f-52db-4404-b2d5-114024116cde tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:59.302041 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-36f0667f-52db-4404-b2d5-114024116cde tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:59.302795 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-36f0667f-52db-4404-b2d5-114024116cde tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:59.303270 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-36f0667f-52db-4404-b2d5-114024116cde tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:59.433693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-36f0667f-52db-4404-b2d5-114024116cde tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:59.442274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-36f0667f-52db-4404-b2d5-114024116cde tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150862 May 10 21:33:59.442839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1896/2672] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:59 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:59.447486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-17283ad7-8402-4efa-9eb4-7d4d89387e97 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:59.448095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-17283ad7-8402-4efa-9eb4-7d4d89387e97 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:59.453731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17283ad7-8402-4efa-9eb4-7d4d89387e97 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:59.454388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17283ad7-8402-4efa-9eb4-7d4d89387e97 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:59.455182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17283ad7-8402-4efa-9eb4-7d4d89387e97 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:59.455631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17283ad7-8402-4efa-9eb4-7d4d89387e97 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:59.581993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-17283ad7-8402-4efa-9eb4-7d4d89387e97 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:59.590155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-17283ad7-8402-4efa-9eb4-7d4d89387e97 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.146284 May 10 21:33:59.590723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1897/2673] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:59 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:33:59.595501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b4d3407d-7a3f-4d5f-a3ee-d9b0208b42bf tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:59.596112 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b4d3407d-7a3f-4d5f-a3ee-d9b0208b42bf tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 92b6d664-37d6-422f-a52a-0ffec8a44389] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:59.601884 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b4d3407d-7a3f-4d5f-a3ee-d9b0208b42bf tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:59.602339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b4d3407d-7a3f-4d5f-a3ee-d9b0208b42bf tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:59.603149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b4d3407d-7a3f-4d5f-a3ee-d9b0208b42bf tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:59.603586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b4d3407d-7a3f-4d5f-a3ee-d9b0208b42bf tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:59.618457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-b4d3407d-7a3f-4d5f-a3ee-d9b0208b42bf tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] HTTP exception thrown: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:33:59.620042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b4d3407d-7a3f-4d5f-a3ee-d9b0208b42bf tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Request method failure captured: May 10 21:33:59.620042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389 HTTP/1.1 May 10 21:33:59.620042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:33:59.620042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:33:59.620042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:33:59.620042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:33:59.620042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:33:59.620042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:33:59.620042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:33:59.620042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:33:59.620042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietSAJMT-hnL6qBkRs7bZ3-110HT4ymfZj92vRoBUEAGHIeo_ldK2Vr4zsDgcllgzjIBDSyio1stjSGyxN0jeNBxfaE1kSHTlyNAeVLUtctiC1v8O3DwT8su8M8miZ3QqxTaNbg2K8kPDMc7k5ZJZ4ZhBF8q-vP6lWzvhhrcux6GAj2A May 10 21:33:59.620042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:33:59.620042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:33:59.620042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:33:59.620042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:33:59.620042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:33:59.620042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:33:59.620042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: bd946455713e4c36a8efadbce486ee8b May 10 21:33:59.620042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-AttachVolumeTestJSON-824855839 May 10 21:33:59.620042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:33:59.620042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:33:59.621635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd946455713e4c36a8efadbce486ee8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bd946455713e4c36a8efadbce486ee8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd946455713e4c36a8efadbce486ee8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bd946455713e4c36a8efadbce486ee8b", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:33:59.621635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-AttachVolumeTestJSON-824855839 May 10 21:33:59.621635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: bd946455713e4c36a8efadbce486ee8b May 10 21:33:59.621635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-AttachVolumeTestJSON-824855839 May 10 21:33:59.621635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-AttachVolumeTestJSON-824855839-project May 10 21:33:59.621635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:33:59.621635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:33:59.621635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: dc411f6a0a024e7eac561ad1b6d2a944 May 10 21:33:59.621635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-AttachVolumeTestJSON-824855839-project May 10 21:33:59.621635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:33:59.621635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:33:59.621635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': '92b6d664-37d6-422f-a52a-0ffec8a44389'} May 10 21:33:59.622481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:33:59.622481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:33:59.622481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:33:59.622481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:33:59.622481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:33:59.622481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:33:59.622481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:33:59.622481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:33:59.622481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:33:59.622481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:33:59.622481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:33:59.622481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:33:59.622481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:33:59.622481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:33:59.622481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:33:59.622481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:33:59.622481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:33:59.622481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:33:59.622481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:33:59.622481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:33:59.623819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:33:59.623819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:33:59.623819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:33:59.623819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:33:59.623819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:33:59.623819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:33:59.623819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:33:59.623819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:33:59.623819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:33:59.623819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:33:59.623819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:33:59.623819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:33:59.623819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:33:59.623819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:33:59.623819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:33:59.623819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:33:59.623819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. May 10 21:33:59.623819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:33:59.624955 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b4d3407d-7a3f-4d5f-a3ee-d9b0208b42bf tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Returning 404 to user: Instance 92b6d664-37d6-422f-a52a-0ffec8a44389 could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:33:59.624955 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b4d3407d-7a3f-4d5f-a3ee-d9b0208b42bf tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389" status: 404 len: 111 microversion: 2.1 time: 0.029782 May 10 21:33:59.624955 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1898/2674] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:59 2022] GET /compute/v2.1/servers/92b6d664-37d6-422f-a52a-0ffec8a44389 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:33:59.627045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6a150b2b-a774-4364-94a4-3a71f7f29787 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:33:59.627684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6a150b2b-a774-4364-94a4-3a71f7f29787 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:33:59.633364 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a150b2b-a774-4364-94a4-3a71f7f29787 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:59.633817 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a150b2b-a774-4364-94a4-3a71f7f29787 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:59.634583 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a150b2b-a774-4364-94a4-3a71f7f29787 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:33:59.635028 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a150b2b-a774-4364-94a4-3a71f7f29787 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:33:59.765054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6a150b2b-a774-4364-94a4-3a71f7f29787 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:33:59.772948 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6a150b2b-a774-4364-94a4-3a71f7f29787 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150060 May 10 21:33:59.773510 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1899/2675] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:33:59 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:00.460365 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-434ccc8f-df00-4642-b9b8-774c9ccdcfcd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:00.460963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-434ccc8f-df00-4642-b9b8-774c9ccdcfcd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:00.467250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-434ccc8f-df00-4642-b9b8-774c9ccdcfcd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:00.467704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-434ccc8f-df00-4642-b9b8-774c9ccdcfcd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:00.468460 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-434ccc8f-df00-4642-b9b8-774c9ccdcfcd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:00.468896 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-434ccc8f-df00-4642-b9b8-774c9ccdcfcd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:00.834443 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-434ccc8f-df00-4642-b9b8-774c9ccdcfcd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:00.842416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-434ccc8f-df00-4642-b9b8-774c9ccdcfcd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.386431 May 10 21:34:00.842974 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1900/2676] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:00 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:00.848352 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e3c8c27f-5b06-41a9-b6cb-aa65b7a8b765 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:00.848954 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e3c8c27f-5b06-41a9-b6cb-aa65b7a8b765 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:00.854285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e3c8c27f-5b06-41a9-b6cb-aa65b7a8b765 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:00.854731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e3c8c27f-5b06-41a9-b6cb-aa65b7a8b765 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:00.855535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e3c8c27f-5b06-41a9-b6cb-aa65b7a8b765 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:00.855973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e3c8c27f-5b06-41a9-b6cb-aa65b7a8b765 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:00.981501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e3c8c27f-5b06-41a9-b6cb-aa65b7a8b765 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:00.990037 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e3c8c27f-5b06-41a9-b6cb-aa65b7a8b765 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.146083 May 10 21:34:00.997021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1901/2677] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:00 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:00.997021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-23347d78-d70d-4049-884a-8519a591fa24 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:00.997021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-23347d78-d70d-4049-884a-8519a591fa24 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:01.001979 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-23347d78-d70d-4049-884a-8519a591fa24 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:01.002452 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-23347d78-d70d-4049-884a-8519a591fa24 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:01.003237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-23347d78-d70d-4049-884a-8519a591fa24 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:01.003674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-23347d78-d70d-4049-884a-8519a591fa24 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:01.134034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-23347d78-d70d-4049-884a-8519a591fa24 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:01.141960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-23347d78-d70d-4049-884a-8519a591fa24 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150434 May 10 21:34:01.142522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1902/2678] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:00 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:01.862287 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6a4a9160-7915-4ad4-8a1f-1d070dccce58 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:01.862942 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6a4a9160-7915-4ad4-8a1f-1d070dccce58 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:01.869179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a4a9160-7915-4ad4-8a1f-1d070dccce58 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:01.869628 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a4a9160-7915-4ad4-8a1f-1d070dccce58 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:01.870389 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a4a9160-7915-4ad4-8a1f-1d070dccce58 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:01.870821 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6a4a9160-7915-4ad4-8a1f-1d070dccce58 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:01.997413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6a4a9160-7915-4ad4-8a1f-1d070dccce58 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:02.005863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6a4a9160-7915-4ad4-8a1f-1d070dccce58 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149552 May 10 21:34:02.006423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1903/2679] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:01 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:02.010868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9869c793-05f1-4364-ad8e-40d5bbeff1d9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:02.011492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9869c793-05f1-4364-ad8e-40d5bbeff1d9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:02.017714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9869c793-05f1-4364-ad8e-40d5bbeff1d9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:02.018164 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9869c793-05f1-4364-ad8e-40d5bbeff1d9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:02.018916 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9869c793-05f1-4364-ad8e-40d5bbeff1d9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:02.019377 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9869c793-05f1-4364-ad8e-40d5bbeff1d9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:02.146637 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9869c793-05f1-4364-ad8e-40d5bbeff1d9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:02.154672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9869c793-05f1-4364-ad8e-40d5bbeff1d9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.147322 May 10 21:34:02.155257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1904/2680] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:02 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:02.159887 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7215b4db-e444-44f8-a6ae-e27d4f904652 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:02.160487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7215b4db-e444-44f8-a6ae-e27d4f904652 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:02.166219 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7215b4db-e444-44f8-a6ae-e27d4f904652 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:02.166703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7215b4db-e444-44f8-a6ae-e27d4f904652 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:02.167545 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7215b4db-e444-44f8-a6ae-e27d4f904652 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:02.168007 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7215b4db-e444-44f8-a6ae-e27d4f904652 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:02.293791 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7215b4db-e444-44f8-a6ae-e27d4f904652 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:02.301580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7215b4db-e444-44f8-a6ae-e27d4f904652 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.145387 May 10 21:34:02.302147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1905/2681] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:02 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:03.022452 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9a213fac-1f56-4ca8-9c30-e80a5e82a24a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:03.023092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9a213fac-1f56-4ca8-9c30-e80a5e82a24a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:03.029428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9a213fac-1f56-4ca8-9c30-e80a5e82a24a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:03.029876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9a213fac-1f56-4ca8-9c30-e80a5e82a24a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:03.030632 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9a213fac-1f56-4ca8-9c30-e80a5e82a24a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:03.031066 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9a213fac-1f56-4ca8-9c30-e80a5e82a24a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:03.162611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9a213fac-1f56-4ca8-9c30-e80a5e82a24a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:03.170456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9a213fac-1f56-4ca8-9c30-e80a5e82a24a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151799 May 10 21:34:03.171021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1906/2682] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:03 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:03.175481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c0348e62-1b64-4322-8866-c62888b229ce tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:03.176079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c0348e62-1b64-4322-8866-c62888b229ce tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:03.181724 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c0348e62-1b64-4322-8866-c62888b229ce tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:03.182169 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c0348e62-1b64-4322-8866-c62888b229ce tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:03.182921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c0348e62-1b64-4322-8866-c62888b229ce tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:03.183386 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c0348e62-1b64-4322-8866-c62888b229ce tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:03.308969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c0348e62-1b64-4322-8866-c62888b229ce tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:03.316713 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c0348e62-1b64-4322-8866-c62888b229ce tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.144737 May 10 21:34:03.317276 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1907/2683] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:03 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:03.321776 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7d15abb0-e10f-48e7-a5c4-659c7eec4ecf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:03.322378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7d15abb0-e10f-48e7-a5c4-659c7eec4ecf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:03.327888 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7d15abb0-e10f-48e7-a5c4-659c7eec4ecf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:03.328333 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7d15abb0-e10f-48e7-a5c4-659c7eec4ecf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:03.329652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7d15abb0-e10f-48e7-a5c4-659c7eec4ecf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:03.330082 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7d15abb0-e10f-48e7-a5c4-659c7eec4ecf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:03.455167 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7d15abb0-e10f-48e7-a5c4-659c7eec4ecf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:03.463308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7d15abb0-e10f-48e7-a5c4-659c7eec4ecf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.144909 May 10 21:34:03.463867 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1908/2684] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:03 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:04.187599 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-42fbda78-5f87-439a-a979-c13cc5e8664d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:04.189321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-42fbda78-5f87-439a-a979-c13cc5e8664d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:04.195381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-42fbda78-5f87-439a-a979-c13cc5e8664d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:04.195850 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-42fbda78-5f87-439a-a979-c13cc5e8664d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:04.196590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-42fbda78-5f87-439a-a979-c13cc5e8664d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:04.197024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-42fbda78-5f87-439a-a979-c13cc5e8664d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:04.326171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-42fbda78-5f87-439a-a979-c13cc5e8664d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:04.334023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-42fbda78-5f87-439a-a979-c13cc5e8664d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150281 May 10 21:34:04.334572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1909/2685] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:04 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:04.339164 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0daaaef3-19f1-42d5-a9e0-17d87c882aed tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:04.339768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0daaaef3-19f1-42d5-a9e0-17d87c882aed tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:04.345861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0daaaef3-19f1-42d5-a9e0-17d87c882aed tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:04.346305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0daaaef3-19f1-42d5-a9e0-17d87c882aed tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:04.347058 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0daaaef3-19f1-42d5-a9e0-17d87c882aed tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:04.347517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0daaaef3-19f1-42d5-a9e0-17d87c882aed tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:04.480846 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0daaaef3-19f1-42d5-a9e0-17d87c882aed tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:04.489539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0daaaef3-19f1-42d5-a9e0-17d87c882aed tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.153747 May 10 21:34:04.490098 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1910/2686] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:04 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:04.497638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6fadaefc-1928-4955-939d-4714dd0e68d8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:04.497638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6fadaefc-1928-4955-939d-4714dd0e68d8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:04.500337 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6fadaefc-1928-4955-939d-4714dd0e68d8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:04.501198 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6fadaefc-1928-4955-939d-4714dd0e68d8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:04.501691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6fadaefc-1928-4955-939d-4714dd0e68d8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:04.502123 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6fadaefc-1928-4955-939d-4714dd0e68d8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:04.633949 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6fadaefc-1928-4955-939d-4714dd0e68d8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:04.642421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6fadaefc-1928-4955-939d-4714dd0e68d8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.151365 May 10 21:34:04.642987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1911/2687] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:04 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:05.351114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a6f8de5b-f372-4bf4-a5d3-bf1cc8f7d583 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:05.351775 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a6f8de5b-f372-4bf4-a5d3-bf1cc8f7d583 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:05.358112 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a6f8de5b-f372-4bf4-a5d3-bf1cc8f7d583 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:05.358587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a6f8de5b-f372-4bf4-a5d3-bf1cc8f7d583 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:05.363353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a6f8de5b-f372-4bf4-a5d3-bf1cc8f7d583 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:05.363353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a6f8de5b-f372-4bf4-a5d3-bf1cc8f7d583 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:05.488178 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a6f8de5b-f372-4bf4-a5d3-bf1cc8f7d583 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:05.496070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a6f8de5b-f372-4bf4-a5d3-bf1cc8f7d583 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148788 May 10 21:34:05.496644 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1912/2688] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:05 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:05.511602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9b877fa1-c5a3-482e-94b9-285f86a5d332 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:05.512214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9b877fa1-c5a3-482e-94b9-285f86a5d332 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:05.518125 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9b877fa1-c5a3-482e-94b9-285f86a5d332 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:05.518587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9b877fa1-c5a3-482e-94b9-285f86a5d332 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:05.519381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9b877fa1-c5a3-482e-94b9-285f86a5d332 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:05.519832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9b877fa1-c5a3-482e-94b9-285f86a5d332 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:05.646132 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9b877fa1-c5a3-482e-94b9-285f86a5d332 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:05.654147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9b877fa1-c5a3-482e-94b9-285f86a5d332 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.146086 May 10 21:34:05.654721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1913/2689] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:05 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:05.659537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6560f3e8-e818-47cc-ab09-2f4dafc2e471 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:05.660147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6560f3e8-e818-47cc-ab09-2f4dafc2e471 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:05.665841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6560f3e8-e818-47cc-ab09-2f4dafc2e471 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:05.666289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6560f3e8-e818-47cc-ab09-2f4dafc2e471 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:05.667054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6560f3e8-e818-47cc-ab09-2f4dafc2e471 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:05.667604 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6560f3e8-e818-47cc-ab09-2f4dafc2e471 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:05.798537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6560f3e8-e818-47cc-ab09-2f4dafc2e471 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:05.806113 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6560f3e8-e818-47cc-ab09-2f4dafc2e471 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150437 May 10 21:34:05.806686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1914/2690] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:05 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:06.514411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fd25c7b9-406e-434c-8e60-282e8f2fb636 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:06.515105 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fd25c7b9-406e-434c-8e60-282e8f2fb636 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:06.522069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fd25c7b9-406e-434c-8e60-282e8f2fb636 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:06.522517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fd25c7b9-406e-434c-8e60-282e8f2fb636 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:06.523322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fd25c7b9-406e-434c-8e60-282e8f2fb636 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:06.523766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fd25c7b9-406e-434c-8e60-282e8f2fb636 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:06.651936 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fd25c7b9-406e-434c-8e60-282e8f2fb636 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:06.659831 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fd25c7b9-406e-434c-8e60-282e8f2fb636 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149294 May 10 21:34:06.660402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1915/2691] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:06 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:06.663137 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:34:06.663302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Tue May 10 21:34:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 21:34:06.674067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-47892064-95fc-4b4c-9d8a-44b19f15a7ee tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:06.675040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-47892064-95fc-4b4c-9d8a-44b19f15a7ee tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:06.681004 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47892064-95fc-4b4c-9d8a-44b19f15a7ee tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:06.681450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47892064-95fc-4b4c-9d8a-44b19f15a7ee tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:06.682205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47892064-95fc-4b4c-9d8a-44b19f15a7ee tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:06.682666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47892064-95fc-4b4c-9d8a-44b19f15a7ee tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:06.815066 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-47892064-95fc-4b4c-9d8a-44b19f15a7ee tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:06.823313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-47892064-95fc-4b4c-9d8a-44b19f15a7ee tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.155567 May 10 21:34:06.823873 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1916/2692] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:06 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:06.828306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fdf27269-e1f8-4c74-8917-ed60fed8445e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:06.829106 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fdf27269-e1f8-4c74-8917-ed60fed8445e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:06.834745 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fdf27269-e1f8-4c74-8917-ed60fed8445e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:06.835476 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fdf27269-e1f8-4c74-8917-ed60fed8445e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:06.836232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fdf27269-e1f8-4c74-8917-ed60fed8445e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:06.836759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fdf27269-e1f8-4c74-8917-ed60fed8445e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:06.963095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fdf27269-e1f8-4c74-8917-ed60fed8445e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:06.972137 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fdf27269-e1f8-4c74-8917-ed60fed8445e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.147321 May 10 21:34:06.972742 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1917/2693] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:06 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:07.677227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-793f2b50-218b-45cf-8648-fbbd310b2c0b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:07.677880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-793f2b50-218b-45cf-8648-fbbd310b2c0b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:07.684174 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-793f2b50-218b-45cf-8648-fbbd310b2c0b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:07.684623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-793f2b50-218b-45cf-8648-fbbd310b2c0b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:07.685375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-793f2b50-218b-45cf-8648-fbbd310b2c0b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:07.685807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-793f2b50-218b-45cf-8648-fbbd310b2c0b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:07.815330 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-793f2b50-218b-45cf-8648-fbbd310b2c0b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:07.823313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-793f2b50-218b-45cf-8648-fbbd310b2c0b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150431 May 10 21:34:07.823883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1918/2694] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:07 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:07.840166 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-294b3fe7-691c-49b4-83c1-03a3d015d6f9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:07.840776 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-294b3fe7-691c-49b4-83c1-03a3d015d6f9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:07.846459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-294b3fe7-691c-49b4-83c1-03a3d015d6f9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:07.847024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-294b3fe7-691c-49b4-83c1-03a3d015d6f9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:07.847821 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-294b3fe7-691c-49b4-83c1-03a3d015d6f9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:07.848265 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-294b3fe7-691c-49b4-83c1-03a3d015d6f9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:07.977398 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-294b3fe7-691c-49b4-83c1-03a3d015d6f9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:07.985992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-294b3fe7-691c-49b4-83c1-03a3d015d6f9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148533 May 10 21:34:07.986248 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1919/2695] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:07 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:07.991581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fe8301aa-d5f6-4872-95ba-eb7526cf6182 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:07.992192 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fe8301aa-d5f6-4872-95ba-eb7526cf6182 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:07.997799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fe8301aa-d5f6-4872-95ba-eb7526cf6182 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:07.998254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fe8301aa-d5f6-4872-95ba-eb7526cf6182 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:07.999168 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fe8301aa-d5f6-4872-95ba-eb7526cf6182 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:07.999619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fe8301aa-d5f6-4872-95ba-eb7526cf6182 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:08.125354 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fe8301aa-d5f6-4872-95ba-eb7526cf6182 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:08.133729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fe8301aa-d5f6-4872-95ba-eb7526cf6182 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.145702 May 10 21:34:08.134239 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1920/2696] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:07 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:08.840743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a12510ac-1a18-43fd-8c0e-9965db5cc4f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:08.841417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a12510ac-1a18-43fd-8c0e-9965db5cc4f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:08.848118 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a12510ac-1a18-43fd-8c0e-9965db5cc4f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:08.848563 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a12510ac-1a18-43fd-8c0e-9965db5cc4f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:08.849315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a12510ac-1a18-43fd-8c0e-9965db5cc4f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:08.849751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a12510ac-1a18-43fd-8c0e-9965db5cc4f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:08.981105 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a12510ac-1a18-43fd-8c0e-9965db5cc4f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:08.989869 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a12510ac-1a18-43fd-8c0e-9965db5cc4f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.152966 May 10 21:34:08.990439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1921/2697] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:08 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:09.001250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f869abf3-806e-49be-a18c-bcd93586b8d3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:09.001851 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f869abf3-806e-49be-a18c-bcd93586b8d3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:09.007505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f869abf3-806e-49be-a18c-bcd93586b8d3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:09.007950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f869abf3-806e-49be-a18c-bcd93586b8d3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:09.008705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f869abf3-806e-49be-a18c-bcd93586b8d3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:09.009138 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f869abf3-806e-49be-a18c-bcd93586b8d3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:09.145571 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f869abf3-806e-49be-a18c-bcd93586b8d3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:09.153459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f869abf3-806e-49be-a18c-bcd93586b8d3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.155836 May 10 21:34:09.154020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1922/2698] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:08 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:09.158530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dd9d81ca-75d8-4a36-a48b-8184062442a0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:09.159147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dd9d81ca-75d8-4a36-a48b-8184062442a0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:09.166109 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dd9d81ca-75d8-4a36-a48b-8184062442a0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:09.166567 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dd9d81ca-75d8-4a36-a48b-8184062442a0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:09.167409 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dd9d81ca-75d8-4a36-a48b-8184062442a0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:09.167854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dd9d81ca-75d8-4a36-a48b-8184062442a0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:09.297232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dd9d81ca-75d8-4a36-a48b-8184062442a0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:09.305644 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dd9d81ca-75d8-4a36-a48b-8184062442a0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150639 May 10 21:34:09.306206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1923/2699] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:09 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:10.006742 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-03821877-d140-496d-9c36-ec30c6c02116 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:10.007423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-03821877-d140-496d-9c36-ec30c6c02116 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:10.013725 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03821877-d140-496d-9c36-ec30c6c02116 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:10.014180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03821877-d140-496d-9c36-ec30c6c02116 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:10.014954 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03821877-d140-496d-9c36-ec30c6c02116 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:10.015417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-03821877-d140-496d-9c36-ec30c6c02116 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:10.143586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-03821877-d140-496d-9c36-ec30c6c02116 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:10.151376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-03821877-d140-496d-9c36-ec30c6c02116 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148571 May 10 21:34:10.151941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1924/2700] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:10 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:10.169556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8f5fe809-afaa-419a-9c81-badf95d640eb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:10.170165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8f5fe809-afaa-419a-9c81-badf95d640eb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:10.176153 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8f5fe809-afaa-419a-9c81-badf95d640eb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:10.176608 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8f5fe809-afaa-419a-9c81-badf95d640eb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:10.177369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8f5fe809-afaa-419a-9c81-badf95d640eb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:10.177808 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8f5fe809-afaa-419a-9c81-badf95d640eb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:10.303368 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8f5fe809-afaa-419a-9c81-badf95d640eb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:10.311227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8f5fe809-afaa-419a-9c81-badf95d640eb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.145190 May 10 21:34:10.311788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1925/2701] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:10 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:10.322886 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2d7ff4c9-6e43-4c2d-bfa9-1812e9d3e046 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:10.323532 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2d7ff4c9-6e43-4c2d-bfa9-1812e9d3e046 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:10.329794 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d7ff4c9-6e43-4c2d-bfa9-1812e9d3e046 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:10.330241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d7ff4c9-6e43-4c2d-bfa9-1812e9d3e046 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:10.331000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d7ff4c9-6e43-4c2d-bfa9-1812e9d3e046 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:10.331470 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d7ff4c9-6e43-4c2d-bfa9-1812e9d3e046 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:10.460833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2d7ff4c9-6e43-4c2d-bfa9-1812e9d3e046 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:10.468581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2d7ff4c9-6e43-4c2d-bfa9-1812e9d3e046 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149235 May 10 21:34:10.469180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1926/2702] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:10 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:11.168851 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ef21f35c-47a3-43db-8297-2cde384c0ffa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:11.169502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ef21f35c-47a3-43db-8297-2cde384c0ffa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:11.176122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ef21f35c-47a3-43db-8297-2cde384c0ffa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:11.176576 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ef21f35c-47a3-43db-8297-2cde384c0ffa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:11.177344 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ef21f35c-47a3-43db-8297-2cde384c0ffa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:11.177784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ef21f35c-47a3-43db-8297-2cde384c0ffa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:11.305031 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ef21f35c-47a3-43db-8297-2cde384c0ffa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:11.312880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ef21f35c-47a3-43db-8297-2cde384c0ffa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148041 May 10 21:34:11.314183 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1927/2703] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:11 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:11.328192 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-02f42a76-33d8-4f21-aa21-b05fb28c4cef tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:11.329440 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-02f42a76-33d8-4f21-aa21-b05fb28c4cef tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:11.335334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-02f42a76-33d8-4f21-aa21-b05fb28c4cef tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:11.335788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-02f42a76-33d8-4f21-aa21-b05fb28c4cef tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:11.336544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-02f42a76-33d8-4f21-aa21-b05fb28c4cef tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:11.336974 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-02f42a76-33d8-4f21-aa21-b05fb28c4cef tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:11.466414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-02f42a76-33d8-4f21-aa21-b05fb28c4cef tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:11.474894 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-02f42a76-33d8-4f21-aa21-b05fb28c4cef tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150245 May 10 21:34:11.475501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1928/2704] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:11 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:11.485644 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-00089162-019c-4dd6-a50f-0d0286a7f14a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:11.486260 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-00089162-019c-4dd6-a50f-0d0286a7f14a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:11.492154 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-00089162-019c-4dd6-a50f-0d0286a7f14a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:11.492613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-00089162-019c-4dd6-a50f-0d0286a7f14a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:11.493385 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-00089162-019c-4dd6-a50f-0d0286a7f14a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:11.493831 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-00089162-019c-4dd6-a50f-0d0286a7f14a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:11.620835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-00089162-019c-4dd6-a50f-0d0286a7f14a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:11.628589 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-00089162-019c-4dd6-a50f-0d0286a7f14a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.146791 May 10 21:34:11.629162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1929/2705] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:11 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:12.329927 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d3f280ae-d3e5-4bc4-9b0c-9e1c6f03951c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:12.330639 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d3f280ae-d3e5-4bc4-9b0c-9e1c6f03951c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:12.337248 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d3f280ae-d3e5-4bc4-9b0c-9e1c6f03951c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:12.337699 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d3f280ae-d3e5-4bc4-9b0c-9e1c6f03951c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:12.338462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d3f280ae-d3e5-4bc4-9b0c-9e1c6f03951c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:12.338900 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d3f280ae-d3e5-4bc4-9b0c-9e1c6f03951c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:12.475019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d3f280ae-d3e5-4bc4-9b0c-9e1c6f03951c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:12.482813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d3f280ae-d3e5-4bc4-9b0c-9e1c6f03951c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.156900 May 10 21:34:12.483415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1930/2706] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:12 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:12.491622 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-14892aa5-b0e9-4f85-a31a-a24a4f2fedbd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:12.492223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-14892aa5-b0e9-4f85-a31a-a24a4f2fedbd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:12.497930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-14892aa5-b0e9-4f85-a31a-a24a4f2fedbd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:12.498374 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-14892aa5-b0e9-4f85-a31a-a24a4f2fedbd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:12.499158 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-14892aa5-b0e9-4f85-a31a-a24a4f2fedbd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:12.499582 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-14892aa5-b0e9-4f85-a31a-a24a4f2fedbd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:12.629116 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-14892aa5-b0e9-4f85-a31a-a24a4f2fedbd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:12.636923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-14892aa5-b0e9-4f85-a31a-a24a4f2fedbd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148883 May 10 21:34:12.637489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1931/2707] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:12 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:12.646179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8f246f77-52a5-4790-921b-cbb72479f5f5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:12.646884 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8f246f77-52a5-4790-921b-cbb72479f5f5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:12.652487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8f246f77-52a5-4790-921b-cbb72479f5f5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:12.652941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8f246f77-52a5-4790-921b-cbb72479f5f5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:12.653702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8f246f77-52a5-4790-921b-cbb72479f5f5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:12.654137 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8f246f77-52a5-4790-921b-cbb72479f5f5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:12.783882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8f246f77-52a5-4790-921b-cbb72479f5f5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:12.791688 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8f246f77-52a5-4790-921b-cbb72479f5f5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150168 May 10 21:34:12.792251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1932/2708] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:12 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:13.500097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-44367153-8033-4b19-a9ad-d406bf6a97da tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:13.500765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-44367153-8033-4b19-a9ad-d406bf6a97da tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:13.508060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44367153-8033-4b19-a9ad-d406bf6a97da tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:13.508510 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44367153-8033-4b19-a9ad-d406bf6a97da tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:13.509277 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44367153-8033-4b19-a9ad-d406bf6a97da tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:13.509718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44367153-8033-4b19-a9ad-d406bf6a97da tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:13.643548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-44367153-8033-4b19-a9ad-d406bf6a97da tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:13.651529 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-44367153-8033-4b19-a9ad-d406bf6a97da tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.155283 May 10 21:34:13.652104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1933/2709] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:13 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:13.656586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fb30441a-eb53-47ce-a0bb-d261c83ed4f5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:13.657192 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fb30441a-eb53-47ce-a0bb-d261c83ed4f5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:13.663080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb30441a-eb53-47ce-a0bb-d261c83ed4f5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:13.663555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb30441a-eb53-47ce-a0bb-d261c83ed4f5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:13.664587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb30441a-eb53-47ce-a0bb-d261c83ed4f5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:13.665035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb30441a-eb53-47ce-a0bb-d261c83ed4f5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:13.792570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fb30441a-eb53-47ce-a0bb-d261c83ed4f5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:13.800953 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fb30441a-eb53-47ce-a0bb-d261c83ed4f5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.147861 May 10 21:34:13.801519 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1934/2710] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:13 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:13.807719 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f1d56e7a-ac10-4530-b498-db8aa0739a67 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:13.808321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f1d56e7a-ac10-4530-b498-db8aa0739a67 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:13.813903 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f1d56e7a-ac10-4530-b498-db8aa0739a67 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:13.815000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f1d56e7a-ac10-4530-b498-db8aa0739a67 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:13.815843 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f1d56e7a-ac10-4530-b498-db8aa0739a67 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:13.816276 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f1d56e7a-ac10-4530-b498-db8aa0739a67 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:13.946325 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f1d56e7a-ac10-4530-b498-db8aa0739a67 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:13.954004 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f1d56e7a-ac10-4530-b498-db8aa0739a67 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149834 May 10 21:34:13.954571 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1935/2711] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:13 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:14.668537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-04eb9926-247d-4c95-90d1-6fd997e1b6c3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:14.669180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-04eb9926-247d-4c95-90d1-6fd997e1b6c3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:14.675767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04eb9926-247d-4c95-90d1-6fd997e1b6c3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:14.676215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04eb9926-247d-4c95-90d1-6fd997e1b6c3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:14.676972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04eb9926-247d-4c95-90d1-6fd997e1b6c3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:14.677405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04eb9926-247d-4c95-90d1-6fd997e1b6c3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:14.804685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-04eb9926-247d-4c95-90d1-6fd997e1b6c3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:14.812605 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-04eb9926-247d-4c95-90d1-6fd997e1b6c3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147930 May 10 21:34:14.813178 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1936/2712] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:14 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:14.818637 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3b5cb72b-52e9-4a8a-adfd-3c5136ecb927 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:14.819419 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3b5cb72b-52e9-4a8a-adfd-3c5136ecb927 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:14.825095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3b5cb72b-52e9-4a8a-adfd-3c5136ecb927 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:14.825541 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3b5cb72b-52e9-4a8a-adfd-3c5136ecb927 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:14.826299 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3b5cb72b-52e9-4a8a-adfd-3c5136ecb927 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:14.826731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3b5cb72b-52e9-4a8a-adfd-3c5136ecb927 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:14.957879 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3b5cb72b-52e9-4a8a-adfd-3c5136ecb927 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:14.965982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3b5cb72b-52e9-4a8a-adfd-3c5136ecb927 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151617 May 10 21:34:14.968749 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1937/2713] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:14 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:14.974272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-58b561bf-63a2-433b-8886-174925e24fff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:14.974887 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-58b561bf-63a2-433b-8886-174925e24fff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:14.980743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-58b561bf-63a2-433b-8886-174925e24fff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:14.984126 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-58b561bf-63a2-433b-8886-174925e24fff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:14.984126 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-58b561bf-63a2-433b-8886-174925e24fff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:14.984126 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-58b561bf-63a2-433b-8886-174925e24fff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:15.113908 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-58b561bf-63a2-433b-8886-174925e24fff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:15.121673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-58b561bf-63a2-433b-8886-174925e24fff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.151751 May 10 21:34:15.122239 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1938/2714] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:14 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:15.828979 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4a60e0dd-7e16-4dfd-8507-7bf5af51b678 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:15.829648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4a60e0dd-7e16-4dfd-8507-7bf5af51b678 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:15.836287 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a60e0dd-7e16-4dfd-8507-7bf5af51b678 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:15.836735 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a60e0dd-7e16-4dfd-8507-7bf5af51b678 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:15.837489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a60e0dd-7e16-4dfd-8507-7bf5af51b678 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:15.837924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a60e0dd-7e16-4dfd-8507-7bf5af51b678 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:15.964695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4a60e0dd-7e16-4dfd-8507-7bf5af51b678 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:15.973086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4a60e0dd-7e16-4dfd-8507-7bf5af51b678 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147969 May 10 21:34:15.973652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1939/2715] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:15 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:15.982363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3421cbf8-e955-4c1f-8aa9-1abcec0e9caf tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:15.983005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3421cbf8-e955-4c1f-8aa9-1abcec0e9caf tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:15.988970 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3421cbf8-e955-4c1f-8aa9-1abcec0e9caf tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:15.989422 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3421cbf8-e955-4c1f-8aa9-1abcec0e9caf tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:15.990223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3421cbf8-e955-4c1f-8aa9-1abcec0e9caf tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:15.990664 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3421cbf8-e955-4c1f-8aa9-1abcec0e9caf tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:16.128126 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3421cbf8-e955-4c1f-8aa9-1abcec0e9caf tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:16.129292 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3421cbf8-e955-4c1f-8aa9-1abcec0e9caf tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150673 May 10 21:34:16.129853 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1940/2716] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:15 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:16.139157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-01b1f8f2-2d2d-4acb-9d74-0d0b59a4e305 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:16.139826 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-01b1f8f2-2d2d-4acb-9d74-0d0b59a4e305 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:16.145684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01b1f8f2-2d2d-4acb-9d74-0d0b59a4e305 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:16.146128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01b1f8f2-2d2d-4acb-9d74-0d0b59a4e305 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:16.146888 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01b1f8f2-2d2d-4acb-9d74-0d0b59a4e305 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:16.147436 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01b1f8f2-2d2d-4acb-9d74-0d0b59a4e305 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:16.273523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-01b1f8f2-2d2d-4acb-9d74-0d0b59a4e305 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:16.281587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-01b1f8f2-2d2d-4acb-9d74-0d0b59a4e305 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.146187 May 10 21:34:16.282160 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1941/2717] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:16 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:16.990512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-06ab1167-3d54-4d85-998d-0aedc0702ec4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:16.991200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-06ab1167-3d54-4d85-998d-0aedc0702ec4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:16.997635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-06ab1167-3d54-4d85-998d-0aedc0702ec4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:16.998081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-06ab1167-3d54-4d85-998d-0aedc0702ec4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:16.998834 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-06ab1167-3d54-4d85-998d-0aedc0702ec4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:16.999307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-06ab1167-3d54-4d85-998d-0aedc0702ec4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:17.128779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-06ab1167-3d54-4d85-998d-0aedc0702ec4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:17.136537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-06ab1167-3d54-4d85-998d-0aedc0702ec4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150696 May 10 21:34:17.137097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1942/2718] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:16 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:17.145758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6f3dbb09-1e59-436e-8792-28efc517920d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:17.146364 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6f3dbb09-1e59-436e-8792-28efc517920d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:17.152032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6f3dbb09-1e59-436e-8792-28efc517920d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:17.152482 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6f3dbb09-1e59-436e-8792-28efc517920d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:17.153241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6f3dbb09-1e59-436e-8792-28efc517920d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:17.153680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6f3dbb09-1e59-436e-8792-28efc517920d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:17.278209 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6f3dbb09-1e59-436e-8792-28efc517920d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:17.286700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6f3dbb09-1e59-436e-8792-28efc517920d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.145047 May 10 21:34:17.287310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1943/2719] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:17 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:17.299796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-112baa18-7d7b-425e-8440-143e67061482 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:17.300403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-112baa18-7d7b-425e-8440-143e67061482 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:17.306263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-112baa18-7d7b-425e-8440-143e67061482 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:17.306705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-112baa18-7d7b-425e-8440-143e67061482 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:17.307476 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-112baa18-7d7b-425e-8440-143e67061482 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:17.307910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-112baa18-7d7b-425e-8440-143e67061482 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:17.435709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-112baa18-7d7b-425e-8440-143e67061482 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:17.443649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-112baa18-7d7b-425e-8440-143e67061482 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148359 May 10 21:34:17.444215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1944/2720] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:17 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:18.154094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9164b1ab-0938-4ce7-9857-95711a951130 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:18.154772 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9164b1ab-0938-4ce7-9857-95711a951130 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:18.162152 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9164b1ab-0938-4ce7-9857-95711a951130 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:18.162602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9164b1ab-0938-4ce7-9857-95711a951130 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:18.163391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9164b1ab-0938-4ce7-9857-95711a951130 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:18.163827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9164b1ab-0938-4ce7-9857-95711a951130 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:18.293993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9164b1ab-0938-4ce7-9857-95711a951130 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:18.301866 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9164b1ab-0938-4ce7-9857-95711a951130 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151589 May 10 21:34:18.302450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1945/2721] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:18 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:18.306815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9d51be3b-4dfb-4b58-8f69-dddc9a594f85 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:18.307538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9d51be3b-4dfb-4b58-8f69-dddc9a594f85 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:18.313031 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9d51be3b-4dfb-4b58-8f69-dddc9a594f85 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:18.313484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9d51be3b-4dfb-4b58-8f69-dddc9a594f85 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:18.314392 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9d51be3b-4dfb-4b58-8f69-dddc9a594f85 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:18.315087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9d51be3b-4dfb-4b58-8f69-dddc9a594f85 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:18.441502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9d51be3b-4dfb-4b58-8f69-dddc9a594f85 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:18.449369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9d51be3b-4dfb-4b58-8f69-dddc9a594f85 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.145988 May 10 21:34:18.449973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1946/2722] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:18 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:18.461161 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8b5247a9-98cc-41dc-9228-ff43887d796d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:18.461764 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8b5247a9-98cc-41dc-9228-ff43887d796d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:18.467497 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8b5247a9-98cc-41dc-9228-ff43887d796d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:18.467939 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8b5247a9-98cc-41dc-9228-ff43887d796d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:18.468689 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8b5247a9-98cc-41dc-9228-ff43887d796d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:18.473378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8b5247a9-98cc-41dc-9228-ff43887d796d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:18.599899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8b5247a9-98cc-41dc-9228-ff43887d796d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:18.607990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8b5247a9-98cc-41dc-9228-ff43887d796d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150688 May 10 21:34:18.608380 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1947/2723] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:18 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:19.317989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-50454848-00f7-4fdb-8b59-4914a75041fb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:19.318657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-50454848-00f7-4fdb-8b59-4914a75041fb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:19.324950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50454848-00f7-4fdb-8b59-4914a75041fb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:19.325400 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50454848-00f7-4fdb-8b59-4914a75041fb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:19.326173 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50454848-00f7-4fdb-8b59-4914a75041fb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:19.326676 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50454848-00f7-4fdb-8b59-4914a75041fb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:19.453442 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-50454848-00f7-4fdb-8b59-4914a75041fb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:19.461442 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-50454848-00f7-4fdb-8b59-4914a75041fb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147619 May 10 21:34:19.462012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1948/2724] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:19 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:19.466359 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1b3ce6c9-941a-4454-acef-2d4c5019ca9d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:19.466954 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1b3ce6c9-941a-4454-acef-2d4c5019ca9d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:19.472982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1b3ce6c9-941a-4454-acef-2d4c5019ca9d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:19.473614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1b3ce6c9-941a-4454-acef-2d4c5019ca9d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:19.474377 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1b3ce6c9-941a-4454-acef-2d4c5019ca9d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:19.474812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1b3ce6c9-941a-4454-acef-2d4c5019ca9d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:19.605228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1b3ce6c9-941a-4454-acef-2d4c5019ca9d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:19.613750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1b3ce6c9-941a-4454-acef-2d4c5019ca9d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150809 May 10 21:34:19.614312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1949/2725] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:19 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:19.623404 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d1166945-93f7-482d-a37a-5bb5630bb8da tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:19.623989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d1166945-93f7-482d-a37a-5bb5630bb8da tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:19.629788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d1166945-93f7-482d-a37a-5bb5630bb8da tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:19.630230 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d1166945-93f7-482d-a37a-5bb5630bb8da tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:19.630990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d1166945-93f7-482d-a37a-5bb5630bb8da tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:19.631444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d1166945-93f7-482d-a37a-5bb5630bb8da tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:19.757411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d1166945-93f7-482d-a37a-5bb5630bb8da tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:19.765133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d1166945-93f7-482d-a37a-5bb5630bb8da tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.145237 May 10 21:34:19.765695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1950/2726] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:19 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:20.477752 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-848604ab-bbc7-45dd-8d89-a4f80581a9b3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:20.478432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-848604ab-bbc7-45dd-8d89-a4f80581a9b3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:20.484828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-848604ab-bbc7-45dd-8d89-a4f80581a9b3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:20.485277 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-848604ab-bbc7-45dd-8d89-a4f80581a9b3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:20.486296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-848604ab-bbc7-45dd-8d89-a4f80581a9b3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:20.486747 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-848604ab-bbc7-45dd-8d89-a4f80581a9b3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:20.615782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-848604ab-bbc7-45dd-8d89-a4f80581a9b3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:20.623636 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-848604ab-bbc7-45dd-8d89-a4f80581a9b3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149762 May 10 21:34:20.624211 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1951/2727] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:20 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:20.629903 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-49d7af02-910b-426b-8ef0-50e65aa2e4bc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:20.630516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-49d7af02-910b-426b-8ef0-50e65aa2e4bc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:20.636117 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-49d7af02-910b-426b-8ef0-50e65aa2e4bc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:20.636580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-49d7af02-910b-426b-8ef0-50e65aa2e4bc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:20.637345 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-49d7af02-910b-426b-8ef0-50e65aa2e4bc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:20.637786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-49d7af02-910b-426b-8ef0-50e65aa2e4bc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:20.771752 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-49d7af02-910b-426b-8ef0-50e65aa2e4bc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:20.779709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-49d7af02-910b-426b-8ef0-50e65aa2e4bc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.153297 May 10 21:34:20.780281 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1952/2728] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:20 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:20.784733 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8012d9d8-fc27-46d1-8847-37166694de63 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:20.785342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8012d9d8-fc27-46d1-8847-37166694de63 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:20.790922 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8012d9d8-fc27-46d1-8847-37166694de63 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:20.791414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8012d9d8-fc27-46d1-8847-37166694de63 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:20.792187 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8012d9d8-fc27-46d1-8847-37166694de63 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:20.792631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8012d9d8-fc27-46d1-8847-37166694de63 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:20.921390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8012d9d8-fc27-46d1-8847-37166694de63 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:20.930303 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8012d9d8-fc27-46d1-8847-37166694de63 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149064 May 10 21:34:20.930973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1953/2729] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:20 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:21.640796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-06a0cca0-7446-4c26-8a32-92691b99b991 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:21.641413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-06a0cca0-7446-4c26-8a32-92691b99b991 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:21.648591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-06a0cca0-7446-4c26-8a32-92691b99b991 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:21.649043 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-06a0cca0-7446-4c26-8a32-92691b99b991 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:21.649804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-06a0cca0-7446-4c26-8a32-92691b99b991 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:21.650240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-06a0cca0-7446-4c26-8a32-92691b99b991 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:21.781136 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-06a0cca0-7446-4c26-8a32-92691b99b991 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:21.789978 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-06a0cca0-7446-4c26-8a32-92691b99b991 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.153031 May 10 21:34:21.790559 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1954/2730] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:21 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:21.795564 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b2a7c8d8-dd91-41b5-913f-276d424c4152 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:21.796194 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b2a7c8d8-dd91-41b5-913f-276d424c4152 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:21.802467 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b2a7c8d8-dd91-41b5-913f-276d424c4152 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:21.802909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b2a7c8d8-dd91-41b5-913f-276d424c4152 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:21.803695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b2a7c8d8-dd91-41b5-913f-276d424c4152 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:21.804130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b2a7c8d8-dd91-41b5-913f-276d424c4152 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:21.931293 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b2a7c8d8-dd91-41b5-913f-276d424c4152 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:21.939024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b2a7c8d8-dd91-41b5-913f-276d424c4152 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.147087 May 10 21:34:21.940017 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1955/2731] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:21 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:21.947829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3d6d038e-e51d-4900-a87a-dea66f554b69 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:21.948447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3d6d038e-e51d-4900-a87a-dea66f554b69 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:21.954166 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d6d038e-e51d-4900-a87a-dea66f554b69 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:21.954619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d6d038e-e51d-4900-a87a-dea66f554b69 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:21.955969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d6d038e-e51d-4900-a87a-dea66f554b69 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:21.956412 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d6d038e-e51d-4900-a87a-dea66f554b69 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:22.085677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3d6d038e-e51d-4900-a87a-dea66f554b69 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:22.093498 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3d6d038e-e51d-4900-a87a-dea66f554b69 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149266 May 10 21:34:22.094066 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1956/2732] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:21 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:22.807213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-509e9a9a-6099-4f7c-93db-23a61fd9e6ab tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:22.807837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-509e9a9a-6099-4f7c-93db-23a61fd9e6ab tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:22.814161 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-509e9a9a-6099-4f7c-93db-23a61fd9e6ab tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:22.815256 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-509e9a9a-6099-4f7c-93db-23a61fd9e6ab tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:22.816019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-509e9a9a-6099-4f7c-93db-23a61fd9e6ab tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:22.816450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-509e9a9a-6099-4f7c-93db-23a61fd9e6ab tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:22.944300 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-509e9a9a-6099-4f7c-93db-23a61fd9e6ab tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:22.952044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-509e9a9a-6099-4f7c-93db-23a61fd9e6ab tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148798 May 10 21:34:22.952603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1957/2733] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:22 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:22.957305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cdcb2692-fd99-43d8-b8d5-ab58e59776c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:22.957940 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cdcb2692-fd99-43d8-b8d5-ab58e59776c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:22.963915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cdcb2692-fd99-43d8-b8d5-ab58e59776c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:22.964363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cdcb2692-fd99-43d8-b8d5-ab58e59776c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:22.965122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cdcb2692-fd99-43d8-b8d5-ab58e59776c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:22.965553 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cdcb2692-fd99-43d8-b8d5-ab58e59776c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:23.095093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cdcb2692-fd99-43d8-b8d5-ab58e59776c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:23.103642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cdcb2692-fd99-43d8-b8d5-ab58e59776c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150099 May 10 21:34:23.104209 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1958/2734] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:22 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:23.110552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3ff1ef25-1e6f-4346-bd63-517b7478d37e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:23.112109 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3ff1ef25-1e6f-4346-bd63-517b7478d37e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:23.117764 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ff1ef25-1e6f-4346-bd63-517b7478d37e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:23.118211 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ff1ef25-1e6f-4346-bd63-517b7478d37e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:23.118960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ff1ef25-1e6f-4346-bd63-517b7478d37e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:23.119416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ff1ef25-1e6f-4346-bd63-517b7478d37e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:23.247271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3ff1ef25-1e6f-4346-bd63-517b7478d37e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:23.255689 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3ff1ef25-1e6f-4346-bd63-517b7478d37e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148611 May 10 21:34:23.256250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1959/2735] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:23 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:23.969803 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7b3c11d1-b26d-49d8-bb0a-6824734ead46 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:23.970995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7b3c11d1-b26d-49d8-bb0a-6824734ead46 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:23.977560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b3c11d1-b26d-49d8-bb0a-6824734ead46 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:23.978006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b3c11d1-b26d-49d8-bb0a-6824734ead46 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:23.978763 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b3c11d1-b26d-49d8-bb0a-6824734ead46 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:23.979224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b3c11d1-b26d-49d8-bb0a-6824734ead46 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:24.108111 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7b3c11d1-b26d-49d8-bb0a-6824734ead46 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:24.116547 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7b3c11d1-b26d-49d8-bb0a-6824734ead46 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150683 May 10 21:34:24.117115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1960/2736] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:23 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:24.121628 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bcfea43e-0bec-4676-bcdd-1d2339539d30 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:24.122236 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bcfea43e-0bec-4676-bcdd-1d2339539d30 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:24.128893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bcfea43e-0bec-4676-bcdd-1d2339539d30 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:24.129342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bcfea43e-0bec-4676-bcdd-1d2339539d30 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:24.130104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bcfea43e-0bec-4676-bcdd-1d2339539d30 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:24.130537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bcfea43e-0bec-4676-bcdd-1d2339539d30 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:24.261106 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bcfea43e-0bec-4676-bcdd-1d2339539d30 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:24.269494 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bcfea43e-0bec-4676-bcdd-1d2339539d30 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151451 May 10 21:34:24.270050 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1961/2737] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:24 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:24.274383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cf990408-82bb-4d47-99f2-a14578183581 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:24.275002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cf990408-82bb-4d47-99f2-a14578183581 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:24.280504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cf990408-82bb-4d47-99f2-a14578183581 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:24.280946 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cf990408-82bb-4d47-99f2-a14578183581 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:24.281706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cf990408-82bb-4d47-99f2-a14578183581 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:24.282345 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cf990408-82bb-4d47-99f2-a14578183581 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:24.412146 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cf990408-82bb-4d47-99f2-a14578183581 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:24.419917 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cf990408-82bb-4d47-99f2-a14578183581 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148913 May 10 21:34:24.420511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1962/2738] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:24 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:25.134253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8be4a185-a126-4d15-93bd-523b2b0ef4ca tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:25.134894 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8be4a185-a126-4d15-93bd-523b2b0ef4ca tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:25.141083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8be4a185-a126-4d15-93bd-523b2b0ef4ca tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:25.141533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8be4a185-a126-4d15-93bd-523b2b0ef4ca tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:25.142443 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8be4a185-a126-4d15-93bd-523b2b0ef4ca tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:25.142890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8be4a185-a126-4d15-93bd-523b2b0ef4ca tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:25.270657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8be4a185-a126-4d15-93bd-523b2b0ef4ca tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:25.278397 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8be4a185-a126-4d15-93bd-523b2b0ef4ca tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148184 May 10 21:34:25.278968 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1963/2739] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:25 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:25.285480 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-10fa01a8-37ac-496b-b338-87199131ce99 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:25.286095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-10fa01a8-37ac-496b-b338-87199131ce99 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:25.291780 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-10fa01a8-37ac-496b-b338-87199131ce99 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:25.292229 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-10fa01a8-37ac-496b-b338-87199131ce99 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:25.292989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-10fa01a8-37ac-496b-b338-87199131ce99 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:25.293428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-10fa01a8-37ac-496b-b338-87199131ce99 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:25.425253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-10fa01a8-37ac-496b-b338-87199131ce99 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:25.433096 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-10fa01a8-37ac-496b-b338-87199131ce99 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151271 May 10 21:34:25.433658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1964/2740] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:25 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:25.438090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ada5ac96-29a1-4b88-a429-593708579656 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:25.438691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ada5ac96-29a1-4b88-a429-593708579656 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:25.445812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ada5ac96-29a1-4b88-a429-593708579656 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:25.447642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ada5ac96-29a1-4b88-a429-593708579656 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:25.447642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ada5ac96-29a1-4b88-a429-593708579656 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:25.447642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ada5ac96-29a1-4b88-a429-593708579656 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:25.575437 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ada5ac96-29a1-4b88-a429-593708579656 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:25.583971 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ada5ac96-29a1-4b88-a429-593708579656 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149382 May 10 21:34:25.584538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1965/2741] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:25 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:26.295945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-16c038ed-46b5-47bb-804d-7c5995ccd1e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:26.296646 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-16c038ed-46b5-47bb-804d-7c5995ccd1e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:26.303817 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-16c038ed-46b5-47bb-804d-7c5995ccd1e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:26.304269 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-16c038ed-46b5-47bb-804d-7c5995ccd1e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:26.305038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-16c038ed-46b5-47bb-804d-7c5995ccd1e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:26.305518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-16c038ed-46b5-47bb-804d-7c5995ccd1e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:26.443740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-16c038ed-46b5-47bb-804d-7c5995ccd1e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:26.451660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-16c038ed-46b5-47bb-804d-7c5995ccd1e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.159807 May 10 21:34:26.452231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1966/2742] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:26 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:26.456787 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b661d19e-b128-46e4-859c-d8cbf964999e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:26.457399 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b661d19e-b128-46e4-859c-d8cbf964999e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:26.463222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b661d19e-b128-46e4-859c-d8cbf964999e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:26.463685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b661d19e-b128-46e4-859c-d8cbf964999e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:26.464461 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b661d19e-b128-46e4-859c-d8cbf964999e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:26.464904 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b661d19e-b128-46e4-859c-d8cbf964999e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:26.594430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b661d19e-b128-46e4-859c-d8cbf964999e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:26.602563 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b661d19e-b128-46e4-859c-d8cbf964999e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149332 May 10 21:34:26.607175 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1967/2743] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:26 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:26.607942 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-82f747b5-0e4e-4891-a278-a0ae94ba44fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:26.608394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-82f747b5-0e4e-4891-a278-a0ae94ba44fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:26.615302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-82f747b5-0e4e-4891-a278-a0ae94ba44fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:26.615972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-82f747b5-0e4e-4891-a278-a0ae94ba44fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:26.616803 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-82f747b5-0e4e-4891-a278-a0ae94ba44fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:26.617244 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-82f747b5-0e4e-4891-a278-a0ae94ba44fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:26.746757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-82f747b5-0e4e-4891-a278-a0ae94ba44fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:26.755029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-82f747b5-0e4e-4891-a278-a0ae94ba44fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150954 May 10 21:34:26.755624 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1968/2744] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:26 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:27.468956 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e4c2145c-1a6e-455d-8c7e-0f8650838887 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:27.469619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e4c2145c-1a6e-455d-8c7e-0f8650838887 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:27.476842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4c2145c-1a6e-455d-8c7e-0f8650838887 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:27.484020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4c2145c-1a6e-455d-8c7e-0f8650838887 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:27.484020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4c2145c-1a6e-455d-8c7e-0f8650838887 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:27.484020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4c2145c-1a6e-455d-8c7e-0f8650838887 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:27.612464 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e4c2145c-1a6e-455d-8c7e-0f8650838887 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:27.620477 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e4c2145c-1a6e-455d-8c7e-0f8650838887 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.155540 May 10 21:34:27.621038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1969/2745] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:27 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:27.625576 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5ecf09da-5f45-4d2a-9db5-68fcd735b8de tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:27.626206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5ecf09da-5f45-4d2a-9db5-68fcd735b8de tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:27.632750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ecf09da-5f45-4d2a-9db5-68fcd735b8de tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:27.633205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ecf09da-5f45-4d2a-9db5-68fcd735b8de tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:27.633967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ecf09da-5f45-4d2a-9db5-68fcd735b8de tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:27.634418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ecf09da-5f45-4d2a-9db5-68fcd735b8de tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:27.763777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5ecf09da-5f45-4d2a-9db5-68fcd735b8de tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:27.772360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5ecf09da-5f45-4d2a-9db5-68fcd735b8de tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150393 May 10 21:34:27.772920 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1970/2746] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:27 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:27.777225 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3f2fea88-56bb-47d6-ac19-7b8946febd12 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:27.777833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3f2fea88-56bb-47d6-ac19-7b8946febd12 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:27.783681 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3f2fea88-56bb-47d6-ac19-7b8946febd12 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:27.784123 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3f2fea88-56bb-47d6-ac19-7b8946febd12 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:27.784883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3f2fea88-56bb-47d6-ac19-7b8946febd12 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:27.785318 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3f2fea88-56bb-47d6-ac19-7b8946febd12 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:27.917312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3f2fea88-56bb-47d6-ac19-7b8946febd12 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:27.925529 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3f2fea88-56bb-47d6-ac19-7b8946febd12 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.151683 May 10 21:34:27.926101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1971/2747] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:27 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:28.637863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-08483efa-d1e5-4d11-92cb-27d19e0db786 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:28.638468 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-08483efa-d1e5-4d11-92cb-27d19e0db786 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:28.644880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-08483efa-d1e5-4d11-92cb-27d19e0db786 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:28.645316 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-08483efa-d1e5-4d11-92cb-27d19e0db786 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:28.646083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-08483efa-d1e5-4d11-92cb-27d19e0db786 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:28.646522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-08483efa-d1e5-4d11-92cb-27d19e0db786 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:28.773878 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-08483efa-d1e5-4d11-92cb-27d19e0db786 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:28.781617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-08483efa-d1e5-4d11-92cb-27d19e0db786 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147675 May 10 21:34:28.782202 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1972/2748] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:28 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:28.788688 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6dc2630a-7e8d-423e-b041-4f37275c5246 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:28.789438 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6dc2630a-7e8d-423e-b041-4f37275c5246 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:28.795299 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6dc2630a-7e8d-423e-b041-4f37275c5246 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:28.795751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6dc2630a-7e8d-423e-b041-4f37275c5246 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:28.796514 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6dc2630a-7e8d-423e-b041-4f37275c5246 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:28.796955 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6dc2630a-7e8d-423e-b041-4f37275c5246 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:28.927856 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6dc2630a-7e8d-423e-b041-4f37275c5246 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:28.936530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6dc2630a-7e8d-423e-b041-4f37275c5246 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150735 May 10 21:34:28.936530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1973/2749] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:28 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:28.942760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-428840b0-48f1-42ed-b169-3c63ce7d247c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:28.943515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-428840b0-48f1-42ed-b169-3c63ce7d247c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:28.949506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-428840b0-48f1-42ed-b169-3c63ce7d247c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:28.951191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-428840b0-48f1-42ed-b169-3c63ce7d247c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:28.951191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-428840b0-48f1-42ed-b169-3c63ce7d247c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:28.951191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-428840b0-48f1-42ed-b169-3c63ce7d247c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:29.079208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-428840b0-48f1-42ed-b169-3c63ce7d247c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:29.087899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-428840b0-48f1-42ed-b169-3c63ce7d247c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149448 May 10 21:34:29.088463 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1974/2750] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:28 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:29.798556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bda2ac3d-1fad-478a-9e2d-05dd956f3846 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:29.799557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bda2ac3d-1fad-478a-9e2d-05dd956f3846 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:29.805714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bda2ac3d-1fad-478a-9e2d-05dd956f3846 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:29.806160 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bda2ac3d-1fad-478a-9e2d-05dd956f3846 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:29.806915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bda2ac3d-1fad-478a-9e2d-05dd956f3846 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:29.807388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bda2ac3d-1fad-478a-9e2d-05dd956f3846 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:29.933914 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bda2ac3d-1fad-478a-9e2d-05dd956f3846 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:29.942314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bda2ac3d-1fad-478a-9e2d-05dd956f3846 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147747 May 10 21:34:29.942881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1975/2751] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:29 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:29.953102 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ecb7f56a-5d88-46ef-b9f0-086ca66f7484 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:29.953718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ecb7f56a-5d88-46ef-b9f0-086ca66f7484 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:29.960666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ecb7f56a-5d88-46ef-b9f0-086ca66f7484 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:29.961118 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ecb7f56a-5d88-46ef-b9f0-086ca66f7484 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:29.961883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ecb7f56a-5d88-46ef-b9f0-086ca66f7484 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:29.962324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ecb7f56a-5d88-46ef-b9f0-086ca66f7484 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:30.089484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ecb7f56a-5d88-46ef-b9f0-086ca66f7484 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:30.097872 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ecb7f56a-5d88-46ef-b9f0-086ca66f7484 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148421 May 10 21:34:30.098432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1976/2752] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:29 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:30.104770 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f1d416e6-a67d-4f94-9537-ce763fed9ef7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:30.105382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f1d416e6-a67d-4f94-9537-ce763fed9ef7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:30.112235 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f1d416e6-a67d-4f94-9537-ce763fed9ef7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:30.112719 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f1d416e6-a67d-4f94-9537-ce763fed9ef7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:30.113484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f1d416e6-a67d-4f94-9537-ce763fed9ef7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:30.113925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f1d416e6-a67d-4f94-9537-ce763fed9ef7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:30.240126 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f1d416e6-a67d-4f94-9537-ce763fed9ef7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:30.248037 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f1d416e6-a67d-4f94-9537-ce763fed9ef7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.146849 May 10 21:34:30.248611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1977/2753] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:30 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:30.959540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-188ed6e1-dd4c-46e8-ad45-0fe128637ccc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:30.960140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-188ed6e1-dd4c-46e8-ad45-0fe128637ccc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:30.966753 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-188ed6e1-dd4c-46e8-ad45-0fe128637ccc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:30.967244 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-188ed6e1-dd4c-46e8-ad45-0fe128637ccc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:30.968012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-188ed6e1-dd4c-46e8-ad45-0fe128637ccc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:30.968456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-188ed6e1-dd4c-46e8-ad45-0fe128637ccc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:31.099220 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-188ed6e1-dd4c-46e8-ad45-0fe128637ccc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:31.107433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-188ed6e1-dd4c-46e8-ad45-0fe128637ccc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151643 May 10 21:34:31.108054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1978/2754] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:30 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:31.114453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fe7b622b-05b2-405b-b0e9-64b567ff5aa7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:31.115068 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fe7b622b-05b2-405b-b0e9-64b567ff5aa7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:31.120948 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fe7b622b-05b2-405b-b0e9-64b567ff5aa7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:31.121407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fe7b622b-05b2-405b-b0e9-64b567ff5aa7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:31.122179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fe7b622b-05b2-405b-b0e9-64b567ff5aa7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:31.122620 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fe7b622b-05b2-405b-b0e9-64b567ff5aa7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:31.254062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fe7b622b-05b2-405b-b0e9-64b567ff5aa7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:31.262128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fe7b622b-05b2-405b-b0e9-64b567ff5aa7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.152046 May 10 21:34:31.262699 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1979/2755] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:31 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:31.267788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-334c4999-dce1-42fc-ae1d-62e972d496a9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:31.268382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-334c4999-dce1-42fc-ae1d-62e972d496a9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:31.274068 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-334c4999-dce1-42fc-ae1d-62e972d496a9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:31.274529 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-334c4999-dce1-42fc-ae1d-62e972d496a9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:31.275301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-334c4999-dce1-42fc-ae1d-62e972d496a9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:31.275735 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-334c4999-dce1-42fc-ae1d-62e972d496a9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:31.416717 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-334c4999-dce1-42fc-ae1d-62e972d496a9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:31.424834 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-334c4999-dce1-42fc-ae1d-62e972d496a9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.161086 May 10 21:34:31.425420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1980/2756] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:31 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:32.124505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0f7d1474-7ac9-4ed1-aa34-3f6bf208cb5d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:32.125185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0f7d1474-7ac9-4ed1-aa34-3f6bf208cb5d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:32.132058 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f7d1474-7ac9-4ed1-aa34-3f6bf208cb5d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:32.132508 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f7d1474-7ac9-4ed1-aa34-3f6bf208cb5d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:32.133299 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f7d1474-7ac9-4ed1-aa34-3f6bf208cb5d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:32.133742 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f7d1474-7ac9-4ed1-aa34-3f6bf208cb5d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:32.259655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0f7d1474-7ac9-4ed1-aa34-3f6bf208cb5d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:32.267578 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0f7d1474-7ac9-4ed1-aa34-3f6bf208cb5d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.146796 May 10 21:34:32.268149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1981/2757] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:32 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:32.278883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-89b510fb-d3d1-40cf-b080-e878e2baa2f6 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:32.279580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-89b510fb-d3d1-40cf-b080-e878e2baa2f6 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:32.285849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89b510fb-d3d1-40cf-b080-e878e2baa2f6 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:32.286296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89b510fb-d3d1-40cf-b080-e878e2baa2f6 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:32.287053 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89b510fb-d3d1-40cf-b080-e878e2baa2f6 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:32.287515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89b510fb-d3d1-40cf-b080-e878e2baa2f6 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:32.413351 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-89b510fb-d3d1-40cf-b080-e878e2baa2f6 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:32.421183 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-89b510fb-d3d1-40cf-b080-e878e2baa2f6 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.145875 May 10 21:34:32.421759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1982/2758] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:32 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:32.443111 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cce1e0e9-be74-4d25-9384-eaac080ad632 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:32.443740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cce1e0e9-be74-4d25-9384-eaac080ad632 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:32.449431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cce1e0e9-be74-4d25-9384-eaac080ad632 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:32.449882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cce1e0e9-be74-4d25-9384-eaac080ad632 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:32.450650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cce1e0e9-be74-4d25-9384-eaac080ad632 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:32.451092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cce1e0e9-be74-4d25-9384-eaac080ad632 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:32.580188 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cce1e0e9-be74-4d25-9384-eaac080ad632 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:32.588171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cce1e0e9-be74-4d25-9384-eaac080ad632 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149020 May 10 21:34:32.588741 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1983/2759] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:32 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:33.285657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cbb0d9e5-f105-4939-86f8-a2627ca51ab3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:33.286276 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cbb0d9e5-f105-4939-86f8-a2627ca51ab3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:33.292580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbb0d9e5-f105-4939-86f8-a2627ca51ab3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:33.293030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbb0d9e5-f105-4939-86f8-a2627ca51ab3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:33.293790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbb0d9e5-f105-4939-86f8-a2627ca51ab3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:33.294227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbb0d9e5-f105-4939-86f8-a2627ca51ab3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:33.422537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cbb0d9e5-f105-4939-86f8-a2627ca51ab3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:33.430865 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cbb0d9e5-f105-4939-86f8-a2627ca51ab3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150135 May 10 21:34:33.431483 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1984/2760] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:33 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:33.437276 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5f78ffa6-053b-48d2-aa10-c4723ffe710f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:33.438127 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5f78ffa6-053b-48d2-aa10-c4723ffe710f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:33.443890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f78ffa6-053b-48d2-aa10-c4723ffe710f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:33.444340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f78ffa6-053b-48d2-aa10-c4723ffe710f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:33.445109 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f78ffa6-053b-48d2-aa10-c4723ffe710f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:33.445548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f78ffa6-053b-48d2-aa10-c4723ffe710f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:33.574948 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5f78ffa6-053b-48d2-aa10-c4723ffe710f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:33.583646 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5f78ffa6-053b-48d2-aa10-c4723ffe710f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149902 May 10 21:34:33.584209 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1985/2761] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:33 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:33.605400 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1d7e08b2-11a0-421a-a077-4080a701013f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:33.606004 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1d7e08b2-11a0-421a-a077-4080a701013f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:33.612026 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d7e08b2-11a0-421a-a077-4080a701013f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:33.612474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d7e08b2-11a0-421a-a077-4080a701013f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:33.613234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d7e08b2-11a0-421a-a077-4080a701013f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:33.613666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d7e08b2-11a0-421a-a077-4080a701013f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:33.739196 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1d7e08b2-11a0-421a-a077-4080a701013f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:33.746919 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1d7e08b2-11a0-421a-a077-4080a701013f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.145207 May 10 21:34:33.747511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1986/2762] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:33 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:34.447370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4ce11af3-5b1f-4f7b-9b84-409d52cae329 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:34.448035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4ce11af3-5b1f-4f7b-9b84-409d52cae329 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:34.454458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4ce11af3-5b1f-4f7b-9b84-409d52cae329 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:34.455749 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4ce11af3-5b1f-4f7b-9b84-409d52cae329 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:34.456528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4ce11af3-5b1f-4f7b-9b84-409d52cae329 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:34.456974 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4ce11af3-5b1f-4f7b-9b84-409d52cae329 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:34.583935 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4ce11af3-5b1f-4f7b-9b84-409d52cae329 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:34.592229 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4ce11af3-5b1f-4f7b-9b84-409d52cae329 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148778 May 10 21:34:34.592810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1987/2763] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:34 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:34.601335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6519b890-6b1d-4f96-9827-f421f8987235 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:34.602069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6519b890-6b1d-4f96-9827-f421f8987235 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:34.608332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6519b890-6b1d-4f96-9827-f421f8987235 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:34.614684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6519b890-6b1d-4f96-9827-f421f8987235 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:34.614684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6519b890-6b1d-4f96-9827-f421f8987235 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:34.614684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6519b890-6b1d-4f96-9827-f421f8987235 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:34.740238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6519b890-6b1d-4f96-9827-f421f8987235 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:34.747962 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6519b890-6b1d-4f96-9827-f421f8987235 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150487 May 10 21:34:34.748575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1988/2764] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:34 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:34.764481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c41867a1-35c0-4607-8a1d-d6d61a310692 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:34.765089 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c41867a1-35c0-4607-8a1d-d6d61a310692 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:34.770895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c41867a1-35c0-4607-8a1d-d6d61a310692 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:34.771387 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c41867a1-35c0-4607-8a1d-d6d61a310692 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:34.772278 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c41867a1-35c0-4607-8a1d-d6d61a310692 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:34.772720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c41867a1-35c0-4607-8a1d-d6d61a310692 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:34.900941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c41867a1-35c0-4607-8a1d-d6d61a310692 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:34.908987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c41867a1-35c0-4607-8a1d-d6d61a310692 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148140 May 10 21:34:34.909556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1989/2765] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:34 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:35.609797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5ac24d9b-6440-4153-8e39-9f57ebf555c4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:35.610401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5ac24d9b-6440-4153-8e39-9f57ebf555c4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:35.617244 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ac24d9b-6440-4153-8e39-9f57ebf555c4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:35.617685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ac24d9b-6440-4153-8e39-9f57ebf555c4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:35.618439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ac24d9b-6440-4153-8e39-9f57ebf555c4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:35.618872 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ac24d9b-6440-4153-8e39-9f57ebf555c4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:35.749557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5ac24d9b-6440-4153-8e39-9f57ebf555c4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:35.757749 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5ac24d9b-6440-4153-8e39-9f57ebf555c4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151745 May 10 21:34:35.758324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1990/2766] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:35 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:35.765109 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2adcfa3c-2440-470b-bf6e-6f966079fff1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:35.765716 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2adcfa3c-2440-470b-bf6e-6f966079fff1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:35.771467 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2adcfa3c-2440-470b-bf6e-6f966079fff1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:35.771918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2adcfa3c-2440-470b-bf6e-6f966079fff1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:35.772706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2adcfa3c-2440-470b-bf6e-6f966079fff1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:35.773141 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2adcfa3c-2440-470b-bf6e-6f966079fff1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:35.901745 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2adcfa3c-2440-470b-bf6e-6f966079fff1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:35.910036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2adcfa3c-2440-470b-bf6e-6f966079fff1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148387 May 10 21:34:35.910596 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1991/2767] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:35 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:35.925864 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8ad73866-6286-4384-993f-5ab68b655f48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:35.926495 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8ad73866-6286-4384-993f-5ab68b655f48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:35.932234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ad73866-6286-4384-993f-5ab68b655f48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:35.932679 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ad73866-6286-4384-993f-5ab68b655f48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:35.933434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ad73866-6286-4384-993f-5ab68b655f48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:35.933868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ad73866-6286-4384-993f-5ab68b655f48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:36.063310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8ad73866-6286-4384-993f-5ab68b655f48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:36.071092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8ad73866-6286-4384-993f-5ab68b655f48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149469 May 10 21:34:36.071696 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1992/2768] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:35 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:36.774277 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c2198398-083b-461c-a8ca-7ebb90ec6530 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:36.774918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c2198398-083b-461c-a8ca-7ebb90ec6530 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:36.781259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c2198398-083b-461c-a8ca-7ebb90ec6530 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:36.781705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c2198398-083b-461c-a8ca-7ebb90ec6530 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:36.782455 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c2198398-083b-461c-a8ca-7ebb90ec6530 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:36.783179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c2198398-083b-461c-a8ca-7ebb90ec6530 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:36.910393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c2198398-083b-461c-a8ca-7ebb90ec6530 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:36.918192 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c2198398-083b-461c-a8ca-7ebb90ec6530 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148070 May 10 21:34:36.918753 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1993/2769] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:36 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:36.927638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e8f9b43f-eff0-4ee1-a4f1-0d0ee271af34 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:36.928249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e8f9b43f-eff0-4ee1-a4f1-0d0ee271af34 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:36.933986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e8f9b43f-eff0-4ee1-a4f1-0d0ee271af34 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:36.934439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e8f9b43f-eff0-4ee1-a4f1-0d0ee271af34 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:36.935234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e8f9b43f-eff0-4ee1-a4f1-0d0ee271af34 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:36.935673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e8f9b43f-eff0-4ee1-a4f1-0d0ee271af34 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:37.060869 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e8f9b43f-eff0-4ee1-a4f1-0d0ee271af34 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:37.068747 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e8f9b43f-eff0-4ee1-a4f1-0d0ee271af34 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.145689 May 10 21:34:37.069313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1994/2770] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:36 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:37.088170 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9c522f98-13c7-47d5-ab65-d06ded86c83f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:37.088773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9c522f98-13c7-47d5-ab65-d06ded86c83f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:37.094413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c522f98-13c7-47d5-ab65-d06ded86c83f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:37.094883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c522f98-13c7-47d5-ab65-d06ded86c83f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:37.096223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c522f98-13c7-47d5-ab65-d06ded86c83f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:37.096666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c522f98-13c7-47d5-ab65-d06ded86c83f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:37.225269 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9c522f98-13c7-47d5-ab65-d06ded86c83f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:37.233056 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9c522f98-13c7-47d5-ab65-d06ded86c83f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148712 May 10 21:34:37.233633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1995/2771] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:37 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:37.934990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-db69af04-e917-4f19-8a4b-adb4eea7f6c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:37.935763 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-db69af04-e917-4f19-8a4b-adb4eea7f6c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:37.942268 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-db69af04-e917-4f19-8a4b-adb4eea7f6c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:37.942719 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-db69af04-e917-4f19-8a4b-adb4eea7f6c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:37.943516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-db69af04-e917-4f19-8a4b-adb4eea7f6c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:37.943957 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-db69af04-e917-4f19-8a4b-adb4eea7f6c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:38.072083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-db69af04-e917-4f19-8a4b-adb4eea7f6c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:38.080512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-db69af04-e917-4f19-8a4b-adb4eea7f6c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149440 May 10 21:34:38.081082 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1996/2772] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:37 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:38.086080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c233c516-34cc-49df-8f30-5c2ce9516924 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:38.086681 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c233c516-34cc-49df-8f30-5c2ce9516924 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:38.092302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c233c516-34cc-49df-8f30-5c2ce9516924 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:38.092755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c233c516-34cc-49df-8f30-5c2ce9516924 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:38.093511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c233c516-34cc-49df-8f30-5c2ce9516924 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:38.093954 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c233c516-34cc-49df-8f30-5c2ce9516924 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:38.225411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c233c516-34cc-49df-8f30-5c2ce9516924 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:38.233182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c233c516-34cc-49df-8f30-5c2ce9516924 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150807 May 10 21:34:38.233762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1997/2773] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:38 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:38.249160 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b6929a8e-edfc-4211-bba9-81f47206ae6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:38.249766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b6929a8e-edfc-4211-bba9-81f47206ae6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:38.256069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b6929a8e-edfc-4211-bba9-81f47206ae6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:38.256516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b6929a8e-edfc-4211-bba9-81f47206ae6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:38.257272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b6929a8e-edfc-4211-bba9-81f47206ae6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:38.257709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b6929a8e-edfc-4211-bba9-81f47206ae6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:38.383600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b6929a8e-edfc-4211-bba9-81f47206ae6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:38.391352 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b6929a8e-edfc-4211-bba9-81f47206ae6a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.145680 May 10 21:34:38.391938 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1998/2774] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:38 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:39.098322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5000b843-8d2c-461b-a92e-cdaed1445f4b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:39.098981 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5000b843-8d2c-461b-a92e-cdaed1445f4b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:39.105288 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5000b843-8d2c-461b-a92e-cdaed1445f4b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:39.105740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5000b843-8d2c-461b-a92e-cdaed1445f4b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:39.106502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5000b843-8d2c-461b-a92e-cdaed1445f4b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:39.106936 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5000b843-8d2c-461b-a92e-cdaed1445f4b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:39.235218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5000b843-8d2c-461b-a92e-cdaed1445f4b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:39.242980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5000b843-8d2c-461b-a92e-cdaed1445f4b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149416 May 10 21:34:39.243602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 1999/2775] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:39 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:39.249402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f2d2574e-57f3-4839-91a8-7c4697c343b0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:39.250051 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f2d2574e-57f3-4839-91a8-7c4697c343b0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:39.255742 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2d2574e-57f3-4839-91a8-7c4697c343b0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:39.256199 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2d2574e-57f3-4839-91a8-7c4697c343b0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:39.256966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2d2574e-57f3-4839-91a8-7c4697c343b0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:39.257406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2d2574e-57f3-4839-91a8-7c4697c343b0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:39.387180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f2d2574e-57f3-4839-91a8-7c4697c343b0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:39.396018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f2d2574e-57f3-4839-91a8-7c4697c343b0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150290 May 10 21:34:39.396580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2000/2776] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:39 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:39.409396 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-01abb41e-866f-424f-98c5-bbef477acd35 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:39.410006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-01abb41e-866f-424f-98c5-bbef477acd35 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:39.415855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01abb41e-866f-424f-98c5-bbef477acd35 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:39.416427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01abb41e-866f-424f-98c5-bbef477acd35 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:39.417344 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01abb41e-866f-424f-98c5-bbef477acd35 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:39.417848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01abb41e-866f-424f-98c5-bbef477acd35 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:39.544424 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-01abb41e-866f-424f-98c5-bbef477acd35 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:39.552854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-01abb41e-866f-424f-98c5-bbef477acd35 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.147844 May 10 21:34:39.553414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2001/2777] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:39 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:40.260218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f0934a98-bb1a-485c-80db-c63fa7991d54 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:40.260905 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f0934a98-bb1a-485c-80db-c63fa7991d54 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:40.267194 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0934a98-bb1a-485c-80db-c63fa7991d54 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:40.268487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0934a98-bb1a-485c-80db-c63fa7991d54 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:40.269253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0934a98-bb1a-485c-80db-c63fa7991d54 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:40.269691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0934a98-bb1a-485c-80db-c63fa7991d54 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:40.398258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f0934a98-bb1a-485c-80db-c63fa7991d54 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:40.406065 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f0934a98-bb1a-485c-80db-c63fa7991d54 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149782 May 10 21:34:40.406619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2002/2778] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:40 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:40.412807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-78422830-e215-4c67-8b6e-3b0c5cfd2855 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:40.413406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-78422830-e215-4c67-8b6e-3b0c5cfd2855 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:40.419015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-78422830-e215-4c67-8b6e-3b0c5cfd2855 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:40.419561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-78422830-e215-4c67-8b6e-3b0c5cfd2855 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:40.420312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-78422830-e215-4c67-8b6e-3b0c5cfd2855 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:40.420748 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-78422830-e215-4c67-8b6e-3b0c5cfd2855 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:40.546958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-78422830-e215-4c67-8b6e-3b0c5cfd2855 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:40.554861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-78422830-e215-4c67-8b6e-3b0c5cfd2855 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.145501 May 10 21:34:40.556047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2003/2779] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:40 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:40.570149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-88da66c8-adac-420b-b97b-f341dfaeff64 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:40.570761 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-88da66c8-adac-420b-b97b-f341dfaeff64 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:40.576587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-88da66c8-adac-420b-b97b-f341dfaeff64 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:40.577035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-88da66c8-adac-420b-b97b-f341dfaeff64 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:40.577798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-88da66c8-adac-420b-b97b-f341dfaeff64 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:40.578234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-88da66c8-adac-420b-b97b-f341dfaeff64 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:40.707713 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-88da66c8-adac-420b-b97b-f341dfaeff64 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:40.715763 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-88da66c8-adac-420b-b97b-f341dfaeff64 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149340 May 10 21:34:40.716314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2004/2780] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:40 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:41.424024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8cc07172-8803-4f97-91ed-32fbfb593ebc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:41.424753 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8cc07172-8803-4f97-91ed-32fbfb593ebc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:41.431210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8cc07172-8803-4f97-91ed-32fbfb593ebc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:41.431667 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8cc07172-8803-4f97-91ed-32fbfb593ebc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:41.432436 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8cc07172-8803-4f97-91ed-32fbfb593ebc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:41.432897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8cc07172-8803-4f97-91ed-32fbfb593ebc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:41.557914 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8cc07172-8803-4f97-91ed-32fbfb593ebc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:41.566372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8cc07172-8803-4f97-91ed-32fbfb593ebc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.146724 May 10 21:34:41.566935 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2005/2781] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:41 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:41.572504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d0e28deb-dfc3-4396-9614-60e8e7d4f067 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:41.573110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d0e28deb-dfc3-4396-9614-60e8e7d4f067 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:41.578730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0e28deb-dfc3-4396-9614-60e8e7d4f067 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:41.579213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0e28deb-dfc3-4396-9614-60e8e7d4f067 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:41.580046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0e28deb-dfc3-4396-9614-60e8e7d4f067 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:41.580489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0e28deb-dfc3-4396-9614-60e8e7d4f067 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:41.705071 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d0e28deb-dfc3-4396-9614-60e8e7d4f067 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:41.713108 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d0e28deb-dfc3-4396-9614-60e8e7d4f067 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.144236 May 10 21:34:41.713671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2006/2782] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:41 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:41.732790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f2ee8a13-4705-4871-abd7-385820de8ce1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:41.733397 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f2ee8a13-4705-4871-abd7-385820de8ce1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:41.739760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2ee8a13-4705-4871-abd7-385820de8ce1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:41.740217 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2ee8a13-4705-4871-abd7-385820de8ce1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:41.740987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2ee8a13-4705-4871-abd7-385820de8ce1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:41.741432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2ee8a13-4705-4871-abd7-385820de8ce1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:41.871366 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f2ee8a13-4705-4871-abd7-385820de8ce1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:41.879282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f2ee8a13-4705-4871-abd7-385820de8ce1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150089 May 10 21:34:41.879847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2007/2783] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:41 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:42.583727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e3fdb0de-5b12-464b-bfc4-c85c96736317 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:42.584424 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e3fdb0de-5b12-464b-bfc4-c85c96736317 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:42.590861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e3fdb0de-5b12-464b-bfc4-c85c96736317 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:42.591360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e3fdb0de-5b12-464b-bfc4-c85c96736317 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:42.592112 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e3fdb0de-5b12-464b-bfc4-c85c96736317 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:42.592547 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e3fdb0de-5b12-464b-bfc4-c85c96736317 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:42.717805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e3fdb0de-5b12-464b-bfc4-c85c96736317 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:42.725922 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e3fdb0de-5b12-464b-bfc4-c85c96736317 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.146559 May 10 21:34:42.726523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2008/2784] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:42 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:42.730989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f2fd8546-8ae4-45bb-8424-d56b70c7dcb9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:42.731613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f2fd8546-8ae4-45bb-8424-d56b70c7dcb9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:42.737336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2fd8546-8ae4-45bb-8424-d56b70c7dcb9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:42.737781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2fd8546-8ae4-45bb-8424-d56b70c7dcb9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:42.738531 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2fd8546-8ae4-45bb-8424-d56b70c7dcb9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:42.738960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2fd8546-8ae4-45bb-8424-d56b70c7dcb9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:42.875730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f2fd8546-8ae4-45bb-8424-d56b70c7dcb9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:42.883465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f2fd8546-8ae4-45bb-8424-d56b70c7dcb9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.155940 May 10 21:34:42.884031 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2009/2785] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:42 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:42.896863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cd0d2c23-dfde-4774-b1af-e64342d887e2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:42.897511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cd0d2c23-dfde-4774-b1af-e64342d887e2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:42.903580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd0d2c23-dfde-4774-b1af-e64342d887e2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:42.904027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd0d2c23-dfde-4774-b1af-e64342d887e2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:42.904786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd0d2c23-dfde-4774-b1af-e64342d887e2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:42.905247 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd0d2c23-dfde-4774-b1af-e64342d887e2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:43.032277 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cd0d2c23-dfde-4774-b1af-e64342d887e2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:43.040625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cd0d2c23-dfde-4774-b1af-e64342d887e2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148382 May 10 21:34:43.041185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2010/2786] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:42 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:43.742301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7be06c74-41a1-464e-a515-5229300a6ba2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:43.742914 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7be06c74-41a1-464e-a515-5229300a6ba2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:43.748992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7be06c74-41a1-464e-a515-5229300a6ba2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:43.749437 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7be06c74-41a1-464e-a515-5229300a6ba2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:43.750193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7be06c74-41a1-464e-a515-5229300a6ba2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:43.750631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7be06c74-41a1-464e-a515-5229300a6ba2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:43.879279 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7be06c74-41a1-464e-a515-5229300a6ba2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:43.886955 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7be06c74-41a1-464e-a515-5229300a6ba2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148627 May 10 21:34:43.887543 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2011/2787] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:43 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:43.900156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-58271b6b-c74c-4846-9d72-0da17d4fa234 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:43.900767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-58271b6b-c74c-4846-9d72-0da17d4fa234 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:43.906511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-58271b6b-c74c-4846-9d72-0da17d4fa234 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:43.907000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-58271b6b-c74c-4846-9d72-0da17d4fa234 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:43.907839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-58271b6b-c74c-4846-9d72-0da17d4fa234 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:43.908396 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-58271b6b-c74c-4846-9d72-0da17d4fa234 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:44.037495 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-58271b6b-c74c-4846-9d72-0da17d4fa234 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:44.045296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-58271b6b-c74c-4846-9d72-0da17d4fa234 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148718 May 10 21:34:44.045868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2012/2788] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:43 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:44.056441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-922c0b91-a145-4d0e-95b1-4611d28fde70 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:44.057056 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-922c0b91-a145-4d0e-95b1-4611d28fde70 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:44.062757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-922c0b91-a145-4d0e-95b1-4611d28fde70 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:44.063257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-922c0b91-a145-4d0e-95b1-4611d28fde70 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:44.064054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-922c0b91-a145-4d0e-95b1-4611d28fde70 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:44.064501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-922c0b91-a145-4d0e-95b1-4611d28fde70 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:44.189967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-922c0b91-a145-4d0e-95b1-4611d28fde70 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:44.197697 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-922c0b91-a145-4d0e-95b1-4611d28fde70 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.144857 May 10 21:34:44.198257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2013/2789] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:44 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:44.902890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-354421ff-046b-4ae0-be9f-2fa257afbcde tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:44.903588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-354421ff-046b-4ae0-be9f-2fa257afbcde tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:44.910002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-354421ff-046b-4ae0-be9f-2fa257afbcde tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:44.910445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-354421ff-046b-4ae0-be9f-2fa257afbcde tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:44.911246 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-354421ff-046b-4ae0-be9f-2fa257afbcde tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:44.911681 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-354421ff-046b-4ae0-be9f-2fa257afbcde tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:45.282044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-354421ff-046b-4ae0-be9f-2fa257afbcde tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:45.290098 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-354421ff-046b-4ae0-be9f-2fa257afbcde tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.391046 May 10 21:34:45.290658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2014/2790] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:44 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:45.295022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ed085a9b-53a8-4dae-9a86-b19e16e693f4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:45.295633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ed085a9b-53a8-4dae-9a86-b19e16e693f4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:45.301647 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed085a9b-53a8-4dae-9a86-b19e16e693f4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:45.302095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed085a9b-53a8-4dae-9a86-b19e16e693f4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:45.302840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed085a9b-53a8-4dae-9a86-b19e16e693f4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:45.303319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed085a9b-53a8-4dae-9a86-b19e16e693f4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:45.430985 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ed085a9b-53a8-4dae-9a86-b19e16e693f4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:45.439147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ed085a9b-53a8-4dae-9a86-b19e16e693f4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.147520 May 10 21:34:45.440641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2015/2791] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:45 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:45.444958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-65b2c3ee-ea00-47d7-842a-e6deb1b8ad71 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:45.445559 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-65b2c3ee-ea00-47d7-842a-e6deb1b8ad71 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:45.451596 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65b2c3ee-ea00-47d7-842a-e6deb1b8ad71 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:45.458177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65b2c3ee-ea00-47d7-842a-e6deb1b8ad71 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:45.458177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65b2c3ee-ea00-47d7-842a-e6deb1b8ad71 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:45.458177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65b2c3ee-ea00-47d7-842a-e6deb1b8ad71 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:45.582063 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-65b2c3ee-ea00-47d7-842a-e6deb1b8ad71 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:45.590041 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-65b2c3ee-ea00-47d7-842a-e6deb1b8ad71 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148588 May 10 21:34:45.590597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2016/2792] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:45 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:46.307518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d59e743d-4dbf-44f7-a315-1ff1085b8585 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:46.308214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d59e743d-4dbf-44f7-a315-1ff1085b8585 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:46.314732 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d59e743d-4dbf-44f7-a315-1ff1085b8585 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:46.315201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d59e743d-4dbf-44f7-a315-1ff1085b8585 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:46.315961 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d59e743d-4dbf-44f7-a315-1ff1085b8585 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:46.316392 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d59e743d-4dbf-44f7-a315-1ff1085b8585 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:46.443710 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d59e743d-4dbf-44f7-a315-1ff1085b8585 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:46.451543 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d59e743d-4dbf-44f7-a315-1ff1085b8585 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147877 May 10 21:34:46.452123 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2017/2793] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:46 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:46.456687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dc1fa47e-1f71-4c5a-aee1-e4b2f3f77c53 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:46.457289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dc1fa47e-1f71-4c5a-aee1-e4b2f3f77c53 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:46.463145 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dc1fa47e-1f71-4c5a-aee1-e4b2f3f77c53 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:46.463593 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dc1fa47e-1f71-4c5a-aee1-e4b2f3f77c53 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:46.464355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dc1fa47e-1f71-4c5a-aee1-e4b2f3f77c53 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:46.464795 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dc1fa47e-1f71-4c5a-aee1-e4b2f3f77c53 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:46.590430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dc1fa47e-1f71-4c5a-aee1-e4b2f3f77c53 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:46.599157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dc1fa47e-1f71-4c5a-aee1-e4b2f3f77c53 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.145846 May 10 21:34:46.599744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2018/2794] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:46 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:46.610923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2ac314ec-7c1e-48de-bf44-dc460d2b02f6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:46.611805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2ac314ec-7c1e-48de-bf44-dc460d2b02f6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:46.617673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ac314ec-7c1e-48de-bf44-dc460d2b02f6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:46.618127 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ac314ec-7c1e-48de-bf44-dc460d2b02f6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:46.618930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ac314ec-7c1e-48de-bf44-dc460d2b02f6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:46.619398 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ac314ec-7c1e-48de-bf44-dc460d2b02f6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:46.747538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2ac314ec-7c1e-48de-bf44-dc460d2b02f6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:46.756052 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2ac314ec-7c1e-48de-bf44-dc460d2b02f6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148902 May 10 21:34:46.756619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2019/2795] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:46 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:47.468881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c75582a6-97f7-4dd6-b708-50b7f853d2f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:47.469585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c75582a6-97f7-4dd6-b708-50b7f853d2f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:47.475889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c75582a6-97f7-4dd6-b708-50b7f853d2f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:47.476338 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c75582a6-97f7-4dd6-b708-50b7f853d2f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:47.477091 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c75582a6-97f7-4dd6-b708-50b7f853d2f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:47.477525 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c75582a6-97f7-4dd6-b708-50b7f853d2f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:47.602953 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c75582a6-97f7-4dd6-b708-50b7f853d2f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:47.610998 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c75582a6-97f7-4dd6-b708-50b7f853d2f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.145918 May 10 21:34:47.612280 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2020/2796] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:47 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:47.616933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-efb7383d-c7d1-4f59-90b9-9399bfd4d0e5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:47.617546 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-efb7383d-c7d1-4f59-90b9-9399bfd4d0e5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:47.623320 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-efb7383d-c7d1-4f59-90b9-9399bfd4d0e5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:47.623777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-efb7383d-c7d1-4f59-90b9-9399bfd4d0e5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:47.624546 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-efb7383d-c7d1-4f59-90b9-9399bfd4d0e5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:47.624990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-efb7383d-c7d1-4f59-90b9-9399bfd4d0e5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:47.752225 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-efb7383d-c7d1-4f59-90b9-9399bfd4d0e5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:47.759908 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-efb7383d-c7d1-4f59-90b9-9399bfd4d0e5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.146538 May 10 21:34:47.760473 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2021/2797] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:47 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:47.773214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ce7a1cea-4cd4-4b66-a4a8-618144788e1c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:47.773831 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ce7a1cea-4cd4-4b66-a4a8-618144788e1c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:47.779555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ce7a1cea-4cd4-4b66-a4a8-618144788e1c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:47.780005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ce7a1cea-4cd4-4b66-a4a8-618144788e1c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:47.780766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ce7a1cea-4cd4-4b66-a4a8-618144788e1c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:47.781200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ce7a1cea-4cd4-4b66-a4a8-618144788e1c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:47.905646 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ce7a1cea-4cd4-4b66-a4a8-618144788e1c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:47.914301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ce7a1cea-4cd4-4b66-a4a8-618144788e1c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.144668 May 10 21:34:47.914877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2022/2798] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:47 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:48.629243 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8e2896a6-a9be-41d4-98b4-0a7284d6b399 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:48.629854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8e2896a6-a9be-41d4-98b4-0a7284d6b399 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:48.636229 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e2896a6-a9be-41d4-98b4-0a7284d6b399 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:48.636683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e2896a6-a9be-41d4-98b4-0a7284d6b399 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:48.637450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e2896a6-a9be-41d4-98b4-0a7284d6b399 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:48.637886 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e2896a6-a9be-41d4-98b4-0a7284d6b399 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:48.769388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8e2896a6-a9be-41d4-98b4-0a7284d6b399 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:48.777288 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8e2896a6-a9be-41d4-98b4-0a7284d6b399 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.152433 May 10 21:34:48.778423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2023/2799] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:48 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:48.782393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-167c138e-242b-4b37-85b2-81c61d057a6e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:48.783012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-167c138e-242b-4b37-85b2-81c61d057a6e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:48.789029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-167c138e-242b-4b37-85b2-81c61d057a6e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:48.789469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-167c138e-242b-4b37-85b2-81c61d057a6e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:48.790233 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-167c138e-242b-4b37-85b2-81c61d057a6e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:48.790673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-167c138e-242b-4b37-85b2-81c61d057a6e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:48.916895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-167c138e-242b-4b37-85b2-81c61d057a6e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:48.925688 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-167c138e-242b-4b37-85b2-81c61d057a6e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.146761 May 10 21:34:48.926275 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2024/2800] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:48 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:48.931417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-14e8b0a2-c02a-4111-8618-38973eea1162 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:48.932028 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-14e8b0a2-c02a-4111-8618-38973eea1162 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:48.937607 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-14e8b0a2-c02a-4111-8618-38973eea1162 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:48.938053 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-14e8b0a2-c02a-4111-8618-38973eea1162 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:48.938807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-14e8b0a2-c02a-4111-8618-38973eea1162 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:48.939881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-14e8b0a2-c02a-4111-8618-38973eea1162 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:49.068958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-14e8b0a2-c02a-4111-8618-38973eea1162 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:49.076825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-14e8b0a2-c02a-4111-8618-38973eea1162 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148856 May 10 21:34:49.077388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2025/2801] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:48 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:49.794305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-00cae979-3209-4512-b083-9894c4971729 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:49.794912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-00cae979-3209-4512-b083-9894c4971729 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:49.802367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-00cae979-3209-4512-b083-9894c4971729 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:49.802818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-00cae979-3209-4512-b083-9894c4971729 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:49.803636 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-00cae979-3209-4512-b083-9894c4971729 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:49.804076 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-00cae979-3209-4512-b083-9894c4971729 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:49.933807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-00cae979-3209-4512-b083-9894c4971729 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:49.942202 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-00cae979-3209-4512-b083-9894c4971729 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151826 May 10 21:34:49.942767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2026/2802] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:49 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:49.947064 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7f1fd23a-e47f-48b2-89ab-e8c52cc680c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:49.947686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7f1fd23a-e47f-48b2-89ab-e8c52cc680c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:49.953111 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7f1fd23a-e47f-48b2-89ab-e8c52cc680c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:49.953553 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7f1fd23a-e47f-48b2-89ab-e8c52cc680c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:49.954303 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7f1fd23a-e47f-48b2-89ab-e8c52cc680c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:49.954795 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7f1fd23a-e47f-48b2-89ab-e8c52cc680c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:50.082469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7f1fd23a-e47f-48b2-89ab-e8c52cc680c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:50.090661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7f1fd23a-e47f-48b2-89ab-e8c52cc680c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.146899 May 10 21:34:50.091260 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2027/2803] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:49 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:50.095663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0e7b9b30-9d33-401e-80a4-281adce40e97 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:50.096268 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0e7b9b30-9d33-401e-80a4-281adce40e97 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:50.101947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0e7b9b30-9d33-401e-80a4-281adce40e97 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:50.102397 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0e7b9b30-9d33-401e-80a4-281adce40e97 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:50.103212 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0e7b9b30-9d33-401e-80a4-281adce40e97 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:50.103685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0e7b9b30-9d33-401e-80a4-281adce40e97 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:50.231414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0e7b9b30-9d33-401e-80a4-281adce40e97 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:50.239401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0e7b9b30-9d33-401e-80a4-281adce40e97 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.147174 May 10 21:34:50.239968 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2028/2804] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:50 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:50.959609 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fde6114e-295c-44c1-bbd0-4758471a1dc4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:50.960225 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fde6114e-295c-44c1-bbd0-4758471a1dc4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:50.966959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fde6114e-295c-44c1-bbd0-4758471a1dc4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:50.967441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fde6114e-295c-44c1-bbd0-4758471a1dc4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:50.968210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fde6114e-295c-44c1-bbd0-4758471a1dc4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:50.968650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fde6114e-295c-44c1-bbd0-4758471a1dc4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:51.099798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fde6114e-295c-44c1-bbd0-4758471a1dc4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:51.108506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fde6114e-295c-44c1-bbd0-4758471a1dc4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.153262 May 10 21:34:51.109077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2029/2805] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:50 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:51.114194 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-af9dc254-8f5b-4a82-bc0a-7cedb4665120 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:51.114814 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-af9dc254-8f5b-4a82-bc0a-7cedb4665120 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:51.120536 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af9dc254-8f5b-4a82-bc0a-7cedb4665120 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:51.120989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af9dc254-8f5b-4a82-bc0a-7cedb4665120 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:51.121756 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af9dc254-8f5b-4a82-bc0a-7cedb4665120 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:51.122190 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af9dc254-8f5b-4a82-bc0a-7cedb4665120 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:51.252725 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-af9dc254-8f5b-4a82-bc0a-7cedb4665120 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:51.260930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-af9dc254-8f5b-4a82-bc0a-7cedb4665120 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150908 May 10 21:34:51.261486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2030/2806] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:51 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:51.265823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-000513dc-223d-4d60-92df-0772b75a4935 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:51.266417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-000513dc-223d-4d60-92df-0772b75a4935 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:51.271970 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-000513dc-223d-4d60-92df-0772b75a4935 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:51.272415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-000513dc-223d-4d60-92df-0772b75a4935 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:51.273165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-000513dc-223d-4d60-92df-0772b75a4935 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:51.273596 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-000513dc-223d-4d60-92df-0772b75a4935 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:51.401548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-000513dc-223d-4d60-92df-0772b75a4935 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:51.409263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-000513dc-223d-4d60-92df-0772b75a4935 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.146854 May 10 21:34:51.409828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2031/2807] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:51 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:52.125917 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cbfd1a60-2a4a-43fd-8949-de430ef7af52 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:52.126676 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cbfd1a60-2a4a-43fd-8949-de430ef7af52 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:52.134409 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbfd1a60-2a4a-43fd-8949-de430ef7af52 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:52.134852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbfd1a60-2a4a-43fd-8949-de430ef7af52 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:52.135642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbfd1a60-2a4a-43fd-8949-de430ef7af52 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:52.136080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbfd1a60-2a4a-43fd-8949-de430ef7af52 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:52.262142 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cbfd1a60-2a4a-43fd-8949-de430ef7af52 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:52.270246 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cbfd1a60-2a4a-43fd-8949-de430ef7af52 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148196 May 10 21:34:52.270814 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2032/2808] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:52 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:52.278064 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-920bb6dd-27d2-4953-9007-97fcf0d438a3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:52.278666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-920bb6dd-27d2-4953-9007-97fcf0d438a3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:52.288840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-920bb6dd-27d2-4953-9007-97fcf0d438a3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:52.289293 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-920bb6dd-27d2-4953-9007-97fcf0d438a3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:52.290065 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-920bb6dd-27d2-4953-9007-97fcf0d438a3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:52.290505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-920bb6dd-27d2-4953-9007-97fcf0d438a3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:52.419481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-920bb6dd-27d2-4953-9007-97fcf0d438a3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:52.428551 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-920bb6dd-27d2-4953-9007-97fcf0d438a3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.153917 May 10 21:34:52.429139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2033/2809] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:52 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:52.433531 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-21c1cc97-ff3a-46fa-8e3b-2c38c685f5aa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:52.434134 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-21c1cc97-ff3a-46fa-8e3b-2c38c685f5aa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:52.440048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21c1cc97-ff3a-46fa-8e3b-2c38c685f5aa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:52.440505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21c1cc97-ff3a-46fa-8e3b-2c38c685f5aa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:52.441290 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21c1cc97-ff3a-46fa-8e3b-2c38c685f5aa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:52.441731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21c1cc97-ff3a-46fa-8e3b-2c38c685f5aa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:52.570648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-21c1cc97-ff3a-46fa-8e3b-2c38c685f5aa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:52.578540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-21c1cc97-ff3a-46fa-8e3b-2c38c685f5aa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148453 May 10 21:34:52.579114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2034/2810] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:52 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:53.287295 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5b018a3a-e9f0-4d7b-a84a-818c4f4d8dce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:53.287933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5b018a3a-e9f0-4d7b-a84a-818c4f4d8dce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:53.294120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b018a3a-e9f0-4d7b-a84a-818c4f4d8dce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:53.294565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b018a3a-e9f0-4d7b-a84a-818c4f4d8dce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:53.295357 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b018a3a-e9f0-4d7b-a84a-818c4f4d8dce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:53.295788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b018a3a-e9f0-4d7b-a84a-818c4f4d8dce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:53.427782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5b018a3a-e9f0-4d7b-a84a-818c4f4d8dce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:53.435565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5b018a3a-e9f0-4d7b-a84a-818c4f4d8dce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.152239 May 10 21:34:53.436136 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2035/2811] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:53 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:53.445918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-73d4ab96-0ef3-4ac6-87f8-d24bb153da43 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:53.446528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-73d4ab96-0ef3-4ac6-87f8-d24bb153da43 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:53.452149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-73d4ab96-0ef3-4ac6-87f8-d24bb153da43 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:53.452633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-73d4ab96-0ef3-4ac6-87f8-d24bb153da43 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:53.453393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-73d4ab96-0ef3-4ac6-87f8-d24bb153da43 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:53.453833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-73d4ab96-0ef3-4ac6-87f8-d24bb153da43 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:53.580561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-73d4ab96-0ef3-4ac6-87f8-d24bb153da43 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:53.588585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-73d4ab96-0ef3-4ac6-87f8-d24bb153da43 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.146391 May 10 21:34:53.589151 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2036/2812] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:53 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:53.596702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d63f066f-5d49-4c97-be60-7b4a2209fc5d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:53.597306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d63f066f-5d49-4c97-be60-7b4a2209fc5d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:53.603834 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d63f066f-5d49-4c97-be60-7b4a2209fc5d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:53.604282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d63f066f-5d49-4c97-be60-7b4a2209fc5d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:53.605046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d63f066f-5d49-4c97-be60-7b4a2209fc5d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:53.605479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d63f066f-5d49-4c97-be60-7b4a2209fc5d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:53.731115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d63f066f-5d49-4c97-be60-7b4a2209fc5d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:53.739709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d63f066f-5d49-4c97-be60-7b4a2209fc5d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.147067 May 10 21:34:53.740268 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2037/2813] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:53 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:54.453133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1f37d88e-59f4-423c-9150-24750c4068c2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:54.453875 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1f37d88e-59f4-423c-9150-24750c4068c2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:54.460947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1f37d88e-59f4-423c-9150-24750c4068c2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:54.461396 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1f37d88e-59f4-423c-9150-24750c4068c2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:54.462153 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1f37d88e-59f4-423c-9150-24750c4068c2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:54.462584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1f37d88e-59f4-423c-9150-24750c4068c2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:54.593703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1f37d88e-59f4-423c-9150-24750c4068c2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:54.601922 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1f37d88e-59f4-423c-9150-24750c4068c2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.152558 May 10 21:34:54.608207 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2038/2814] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:54 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:54.612641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0a862b05-6902-4548-ba02-1c49c1d62ede tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:54.613258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0a862b05-6902-4548-ba02-1c49c1d62ede tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:54.619542 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0a862b05-6902-4548-ba02-1c49c1d62ede tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:54.627265 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0a862b05-6902-4548-ba02-1c49c1d62ede tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:54.627265 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0a862b05-6902-4548-ba02-1c49c1d62ede tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:54.627265 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0a862b05-6902-4548-ba02-1c49c1d62ede tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:54.749486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0a862b05-6902-4548-ba02-1c49c1d62ede tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:54.758040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0a862b05-6902-4548-ba02-1c49c1d62ede tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149264 May 10 21:34:54.758644 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2039/2815] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:54 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:54.763156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-260dd85f-a065-451b-89b5-edd670725e5a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:54.763762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-260dd85f-a065-451b-89b5-edd670725e5a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:54.770124 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-260dd85f-a065-451b-89b5-edd670725e5a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:54.770576 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-260dd85f-a065-451b-89b5-edd670725e5a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:54.771377 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-260dd85f-a065-451b-89b5-edd670725e5a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:54.771820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-260dd85f-a065-451b-89b5-edd670725e5a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:54.907270 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-260dd85f-a065-451b-89b5-edd670725e5a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:54.916299 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-260dd85f-a065-451b-89b5-edd670725e5a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.156601 May 10 21:34:54.916868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2040/2816] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:54 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:55.618481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-87bf8e3e-f4e5-48b3-844c-e50a1166fe6e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:55.619101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-87bf8e3e-f4e5-48b3-844c-e50a1166fe6e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:55.625468 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87bf8e3e-f4e5-48b3-844c-e50a1166fe6e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:55.625915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87bf8e3e-f4e5-48b3-844c-e50a1166fe6e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:55.627355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87bf8e3e-f4e5-48b3-844c-e50a1166fe6e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:55.627987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87bf8e3e-f4e5-48b3-844c-e50a1166fe6e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:55.755643 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-87bf8e3e-f4e5-48b3-844c-e50a1166fe6e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:55.763597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-87bf8e3e-f4e5-48b3-844c-e50a1166fe6e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148989 May 10 21:34:55.764165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2041/2817] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:55 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:55.775711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-167b9300-933e-403f-8d46-a9f7147e2a2e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:55.776311 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-167b9300-933e-403f-8d46-a9f7147e2a2e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:55.781986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-167b9300-933e-403f-8d46-a9f7147e2a2e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:55.782434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-167b9300-933e-403f-8d46-a9f7147e2a2e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:55.783221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-167b9300-933e-403f-8d46-a9f7147e2a2e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:55.783653 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-167b9300-933e-403f-8d46-a9f7147e2a2e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:55.910763 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-167b9300-933e-403f-8d46-a9f7147e2a2e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:55.918549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-167b9300-933e-403f-8d46-a9f7147e2a2e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.146363 May 10 21:34:55.919113 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2042/2818] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:55 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:55.933248 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f7badbf8-49bf-4d3d-ba89-b0ccd56536e2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:55.933843 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f7badbf8-49bf-4d3d-ba89-b0ccd56536e2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:55.940334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f7badbf8-49bf-4d3d-ba89-b0ccd56536e2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:55.940779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f7badbf8-49bf-4d3d-ba89-b0ccd56536e2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:55.941533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f7badbf8-49bf-4d3d-ba89-b0ccd56536e2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:55.941965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f7badbf8-49bf-4d3d-ba89-b0ccd56536e2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:56.070700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f7badbf8-49bf-4d3d-ba89-b0ccd56536e2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:56.078420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f7badbf8-49bf-4d3d-ba89-b0ccd56536e2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148712 May 10 21:34:56.078977 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2043/2819] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:55 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:56.780795 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-34203113-7a95-4e35-bee4-ee1416958085 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:56.781436 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-34203113-7a95-4e35-bee4-ee1416958085 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:56.787873 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-34203113-7a95-4e35-bee4-ee1416958085 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:56.788327 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-34203113-7a95-4e35-bee4-ee1416958085 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:56.789098 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-34203113-7a95-4e35-bee4-ee1416958085 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:56.789543 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-34203113-7a95-4e35-bee4-ee1416958085 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:56.917558 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-34203113-7a95-4e35-bee4-ee1416958085 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:56.925752 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-34203113-7a95-4e35-bee4-ee1416958085 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148874 May 10 21:34:56.926326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2044/2820] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:56 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:56.935365 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7fc5ae45-e286-4614-9d2d-bbf25a69856d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:56.935973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7fc5ae45-e286-4614-9d2d-bbf25a69856d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:56.942375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7fc5ae45-e286-4614-9d2d-bbf25a69856d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:56.942873 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7fc5ae45-e286-4614-9d2d-bbf25a69856d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:56.943696 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7fc5ae45-e286-4614-9d2d-bbf25a69856d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:56.944137 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7fc5ae45-e286-4614-9d2d-bbf25a69856d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:57.076144 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7fc5ae45-e286-4614-9d2d-bbf25a69856d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:57.083859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7fc5ae45-e286-4614-9d2d-bbf25a69856d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.152132 May 10 21:34:57.084417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2045/2821] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:56 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:57.095426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f51de678-a325-4cfa-b039-b019c1db0e0f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:57.096310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f51de678-a325-4cfa-b039-b019c1db0e0f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:57.102474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f51de678-a325-4cfa-b039-b019c1db0e0f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:57.102928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f51de678-a325-4cfa-b039-b019c1db0e0f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:57.103741 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f51de678-a325-4cfa-b039-b019c1db0e0f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:57.104184 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f51de678-a325-4cfa-b039-b019c1db0e0f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:57.236385 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f51de678-a325-4cfa-b039-b019c1db0e0f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:57.244290 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f51de678-a325-4cfa-b039-b019c1db0e0f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.152518 May 10 21:34:57.244867 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2046/2822] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:57 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:57.942544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-106b9884-1bba-4375-b446-07db1ebfc63a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:57.943246 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-106b9884-1bba-4375-b446-07db1ebfc63a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:57.949524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-106b9884-1bba-4375-b446-07db1ebfc63a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:57.949976 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-106b9884-1bba-4375-b446-07db1ebfc63a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:57.950736 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-106b9884-1bba-4375-b446-07db1ebfc63a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:57.951203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-106b9884-1bba-4375-b446-07db1ebfc63a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:58.079054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-106b9884-1bba-4375-b446-07db1ebfc63a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:58.087688 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-106b9884-1bba-4375-b446-07db1ebfc63a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149833 May 10 21:34:58.088250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2047/2823] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:57 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:58.102234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-55a8410a-d9ee-44cf-9c6b-d9d93103abd1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:58.102840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-55a8410a-d9ee-44cf-9c6b-d9d93103abd1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:58.108580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-55a8410a-d9ee-44cf-9c6b-d9d93103abd1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:58.109028 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-55a8410a-d9ee-44cf-9c6b-d9d93103abd1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:58.109794 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-55a8410a-d9ee-44cf-9c6b-d9d93103abd1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:58.110233 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-55a8410a-d9ee-44cf-9c6b-d9d93103abd1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:58.239102 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-55a8410a-d9ee-44cf-9c6b-d9d93103abd1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:58.247162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-55a8410a-d9ee-44cf-9c6b-d9d93103abd1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148502 May 10 21:34:58.247721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2048/2824] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:58 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:58.261650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4d618d86-a8aa-4e5d-a310-6284896a2739 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:58.262373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4d618d86-a8aa-4e5d-a310-6284896a2739 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:58.268923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4d618d86-a8aa-4e5d-a310-6284896a2739 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:58.269368 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4d618d86-a8aa-4e5d-a310-6284896a2739 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:58.270122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4d618d86-a8aa-4e5d-a310-6284896a2739 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:58.270555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4d618d86-a8aa-4e5d-a310-6284896a2739 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:58.396692 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4d618d86-a8aa-4e5d-a310-6284896a2739 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:58.404415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4d618d86-a8aa-4e5d-a310-6284896a2739 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.146832 May 10 21:34:58.404971 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2049/2825] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:58 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:59.105191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b001b9db-87f9-4689-a7b0-90fddcba1312 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:59.105861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b001b9db-87f9-4689-a7b0-90fddcba1312 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:59.113069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b001b9db-87f9-4689-a7b0-90fddcba1312 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:59.113522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b001b9db-87f9-4689-a7b0-90fddcba1312 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:59.114295 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b001b9db-87f9-4689-a7b0-90fddcba1312 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:59.114738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b001b9db-87f9-4689-a7b0-90fddcba1312 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:59.251707 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b001b9db-87f9-4689-a7b0-90fddcba1312 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:59.259476 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b001b9db-87f9-4689-a7b0-90fddcba1312 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.158182 May 10 21:34:59.260043 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2050/2826] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:59 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:34:59.264342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-27089f74-a3dc-4b80-9838-89392a75afc8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:59.264942 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-27089f74-a3dc-4b80-9838-89392a75afc8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:59.270559 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27089f74-a3dc-4b80-9838-89392a75afc8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:59.271010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27089f74-a3dc-4b80-9838-89392a75afc8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:59.271793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27089f74-a3dc-4b80-9838-89392a75afc8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:59.272225 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27089f74-a3dc-4b80-9838-89392a75afc8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:59.397683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-27089f74-a3dc-4b80-9838-89392a75afc8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:59.405539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-27089f74-a3dc-4b80-9838-89392a75afc8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.144552 May 10 21:34:59.406110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2051/2827] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:59 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:34:59.421067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-01094dd9-359f-4f2e-885e-fdf45470a26b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:34:59.421707 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-01094dd9-359f-4f2e-885e-fdf45470a26b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:34:59.428406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01094dd9-359f-4f2e-885e-fdf45470a26b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:59.428858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01094dd9-359f-4f2e-885e-fdf45470a26b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:59.429623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01094dd9-359f-4f2e-885e-fdf45470a26b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:34:59.430060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01094dd9-359f-4f2e-885e-fdf45470a26b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:34:59.560637 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-01094dd9-359f-4f2e-885e-fdf45470a26b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:34:59.568966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-01094dd9-359f-4f2e-885e-fdf45470a26b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.151629 May 10 21:34:59.569530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2052/2828] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:34:59 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:00.276156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-703f1f6a-fc7f-4044-8c3d-a471ed9d9648 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:00.276847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-703f1f6a-fc7f-4044-8c3d-a471ed9d9648 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:00.283696 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-703f1f6a-fc7f-4044-8c3d-a471ed9d9648 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:00.284153 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-703f1f6a-fc7f-4044-8c3d-a471ed9d9648 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:00.284913 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-703f1f6a-fc7f-4044-8c3d-a471ed9d9648 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:00.285348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-703f1f6a-fc7f-4044-8c3d-a471ed9d9648 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:00.412642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-703f1f6a-fc7f-4044-8c3d-a471ed9d9648 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:00.420390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-703f1f6a-fc7f-4044-8c3d-a471ed9d9648 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148060 May 10 21:35:00.421750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2053/2829] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:00 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:00.425734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3e493196-4dff-46da-af6f-dc86448f0cc4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:00.426332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3e493196-4dff-46da-af6f-dc86448f0cc4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:00.431978 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3e493196-4dff-46da-af6f-dc86448f0cc4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:00.432458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3e493196-4dff-46da-af6f-dc86448f0cc4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:00.433367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3e493196-4dff-46da-af6f-dc86448f0cc4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:00.433786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3e493196-4dff-46da-af6f-dc86448f0cc4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:00.564807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3e493196-4dff-46da-af6f-dc86448f0cc4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:00.572634 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3e493196-4dff-46da-af6f-dc86448f0cc4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150771 May 10 21:35:00.573226 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2054/2830] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:00 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:00.586232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-de878b66-393f-49cd-acd1-88d022553e13 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:00.586875 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-de878b66-393f-49cd-acd1-88d022553e13 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:00.592674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de878b66-393f-49cd-acd1-88d022553e13 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:00.593129 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de878b66-393f-49cd-acd1-88d022553e13 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:00.593891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de878b66-393f-49cd-acd1-88d022553e13 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:00.594331 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de878b66-393f-49cd-acd1-88d022553e13 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:00.723549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-de878b66-393f-49cd-acd1-88d022553e13 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:00.731285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-de878b66-393f-49cd-acd1-88d022553e13 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148925 May 10 21:35:00.731854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2055/2831] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:00 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:01.437443 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-02bae606-7e52-46bc-9dea-718fcfe8f78d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:01.438123 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-02bae606-7e52-46bc-9dea-718fcfe8f78d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:01.444456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-02bae606-7e52-46bc-9dea-718fcfe8f78d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:01.444896 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-02bae606-7e52-46bc-9dea-718fcfe8f78d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:01.445651 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-02bae606-7e52-46bc-9dea-718fcfe8f78d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:01.446081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-02bae606-7e52-46bc-9dea-718fcfe8f78d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:01.571921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-02bae606-7e52-46bc-9dea-718fcfe8f78d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:01.579663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-02bae606-7e52-46bc-9dea-718fcfe8f78d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.146065 May 10 21:35:01.581136 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2056/2832] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:01 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:01.589558 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c6b9326d-b7fc-4c4b-9a10-abb78ac4f4ba tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:01.590169 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c6b9326d-b7fc-4c4b-9a10-abb78ac4f4ba tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:01.596549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c6b9326d-b7fc-4c4b-9a10-abb78ac4f4ba tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:01.597005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c6b9326d-b7fc-4c4b-9a10-abb78ac4f4ba tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:01.597776 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c6b9326d-b7fc-4c4b-9a10-abb78ac4f4ba tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:01.598222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c6b9326d-b7fc-4c4b-9a10-abb78ac4f4ba tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:01.727517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c6b9326d-b7fc-4c4b-9a10-abb78ac4f4ba tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:01.735279 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c6b9326d-b7fc-4c4b-9a10-abb78ac4f4ba tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149549 May 10 21:35:01.735843 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2057/2833] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:01 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:01.748029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-66235ee5-4167-45e8-ab94-9988454795ef tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:01.748635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-66235ee5-4167-45e8-ab94-9988454795ef tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:01.754373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-66235ee5-4167-45e8-ab94-9988454795ef tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:01.754823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-66235ee5-4167-45e8-ab94-9988454795ef tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:01.755621 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-66235ee5-4167-45e8-ab94-9988454795ef tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:01.756057 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-66235ee5-4167-45e8-ab94-9988454795ef tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:01.882884 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-66235ee5-4167-45e8-ab94-9988454795ef tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:01.891007 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-66235ee5-4167-45e8-ab94-9988454795ef tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.146644 May 10 21:35:01.891606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2058/2834] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:01 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:02.598231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b5bc6745-ac84-4c8c-a639-1c78a0813dce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:02.598935 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b5bc6745-ac84-4c8c-a639-1c78a0813dce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:02.605604 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5bc6745-ac84-4c8c-a639-1c78a0813dce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:02.606056 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5bc6745-ac84-4c8c-a639-1c78a0813dce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:02.606832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5bc6745-ac84-4c8c-a639-1c78a0813dce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:02.607307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5bc6745-ac84-4c8c-a639-1c78a0813dce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:02.738034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b5bc6745-ac84-4c8c-a639-1c78a0813dce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:02.745847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b5bc6745-ac84-4c8c-a639-1c78a0813dce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.152253 May 10 21:35:02.746416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2059/2835] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:02 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:02.752400 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-306b674e-cbd5-40df-ac74-470e2c660689 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:02.753004 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-306b674e-cbd5-40df-ac74-470e2c660689 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:02.758679 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-306b674e-cbd5-40df-ac74-470e2c660689 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:02.759157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-306b674e-cbd5-40df-ac74-470e2c660689 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:02.759921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-306b674e-cbd5-40df-ac74-470e2c660689 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:02.760361 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-306b674e-cbd5-40df-ac74-470e2c660689 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:02.886726 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-306b674e-cbd5-40df-ac74-470e2c660689 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:02.895341 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-306b674e-cbd5-40df-ac74-470e2c660689 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.147006 May 10 21:35:02.895907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2060/2836] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:02 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:02.908550 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c47e50b0-5e98-43d8-83e0-4b4fe992ecdc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:02.909270 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c47e50b0-5e98-43d8-83e0-4b4fe992ecdc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:02.915164 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c47e50b0-5e98-43d8-83e0-4b4fe992ecdc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:02.915630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c47e50b0-5e98-43d8-83e0-4b4fe992ecdc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:02.916395 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c47e50b0-5e98-43d8-83e0-4b4fe992ecdc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:02.916839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c47e50b0-5e98-43d8-83e0-4b4fe992ecdc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:03.045140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c47e50b0-5e98-43d8-83e0-4b4fe992ecdc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:03.053116 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c47e50b0-5e98-43d8-83e0-4b4fe992ecdc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148335 May 10 21:35:03.053687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2061/2837] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:02 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:03.763361 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9056935c-9b6b-4148-a8a0-4042949076d8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:03.764030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9056935c-9b6b-4148-a8a0-4042949076d8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:03.770436 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9056935c-9b6b-4148-a8a0-4042949076d8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:03.770881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9056935c-9b6b-4148-a8a0-4042949076d8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:03.771662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9056935c-9b6b-4148-a8a0-4042949076d8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:03.772091 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9056935c-9b6b-4148-a8a0-4042949076d8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:03.904224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9056935c-9b6b-4148-a8a0-4042949076d8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:03.912583 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9056935c-9b6b-4148-a8a0-4042949076d8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.153073 May 10 21:35:03.913150 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2062/2838] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:03 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:03.917512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-72f66b32-4422-4584-8147-5cdf9a81f477 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:03.918117 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-72f66b32-4422-4584-8147-5cdf9a81f477 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:03.923848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-72f66b32-4422-4584-8147-5cdf9a81f477 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:03.924446 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-72f66b32-4422-4584-8147-5cdf9a81f477 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:03.925213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-72f66b32-4422-4584-8147-5cdf9a81f477 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:03.925650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-72f66b32-4422-4584-8147-5cdf9a81f477 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:04.051405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-72f66b32-4422-4584-8147-5cdf9a81f477 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:04.059146 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-72f66b32-4422-4584-8147-5cdf9a81f477 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.145058 May 10 21:35:04.059720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2063/2839] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:03 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:04.069347 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7d656575-4dab-483b-ab3b-8217f81206f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:04.069962 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7d656575-4dab-483b-ab3b-8217f81206f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:04.076043 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7d656575-4dab-483b-ab3b-8217f81206f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:04.076516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7d656575-4dab-483b-ab3b-8217f81206f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:04.077389 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7d656575-4dab-483b-ab3b-8217f81206f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:04.077826 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7d656575-4dab-483b-ab3b-8217f81206f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:04.207497 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7d656575-4dab-483b-ab3b-8217f81206f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:04.215656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7d656575-4dab-483b-ab3b-8217f81206f8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149926 May 10 21:35:04.216225 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2064/2840] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:04 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:04.929811 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-27d6dc5d-b964-4e49-ad3c-fd20078b3b2b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:04.930440 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-27d6dc5d-b964-4e49-ad3c-fd20078b3b2b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:04.936774 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27d6dc5d-b964-4e49-ad3c-fd20078b3b2b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:04.937224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27d6dc5d-b964-4e49-ad3c-fd20078b3b2b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:04.937986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27d6dc5d-b964-4e49-ad3c-fd20078b3b2b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:04.938427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27d6dc5d-b964-4e49-ad3c-fd20078b3b2b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:05.069191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-27d6dc5d-b964-4e49-ad3c-fd20078b3b2b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:05.077232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-27d6dc5d-b964-4e49-ad3c-fd20078b3b2b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151779 May 10 21:35:05.077809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2065/2841] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:04 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:05.082913 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e89e1233-652d-44e4-894b-289c6faffa04 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:05.083549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e89e1233-652d-44e4-894b-289c6faffa04 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:05.089441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e89e1233-652d-44e4-894b-289c6faffa04 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:05.089904 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e89e1233-652d-44e4-894b-289c6faffa04 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:05.090673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e89e1233-652d-44e4-894b-289c6faffa04 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:05.091131 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e89e1233-652d-44e4-894b-289c6faffa04 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:05.217500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e89e1233-652d-44e4-894b-289c6faffa04 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:05.225405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e89e1233-652d-44e4-894b-289c6faffa04 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.146566 May 10 21:35:05.226311 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2066/2842] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:05 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:05.236282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c9a34e85-b50e-4380-a9f4-e24addfcd678 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:05.237458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c9a34e85-b50e-4380-a9f4-e24addfcd678 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:05.245330 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9a34e85-b50e-4380-a9f4-e24addfcd678 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:05.245771 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9a34e85-b50e-4380-a9f4-e24addfcd678 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:05.246520 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9a34e85-b50e-4380-a9f4-e24addfcd678 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:05.246952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9a34e85-b50e-4380-a9f4-e24addfcd678 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:05.376699 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c9a34e85-b50e-4380-a9f4-e24addfcd678 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:05.385566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c9a34e85-b50e-4380-a9f4-e24addfcd678 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.156602 May 10 21:35:05.386126 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2067/2843] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:05 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:06.095079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-569bf7c1-5294-4fb0-8618-cbd471fa0394 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:06.095797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-569bf7c1-5294-4fb0-8618-cbd471fa0394 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:06.103020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-569bf7c1-5294-4fb0-8618-cbd471fa0394 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:06.103504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-569bf7c1-5294-4fb0-8618-cbd471fa0394 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:06.104269 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-569bf7c1-5294-4fb0-8618-cbd471fa0394 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:06.104701 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-569bf7c1-5294-4fb0-8618-cbd471fa0394 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:06.233009 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-569bf7c1-5294-4fb0-8618-cbd471fa0394 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:06.241563 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-569bf7c1-5294-4fb0-8618-cbd471fa0394 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150268 May 10 21:35:06.242143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2068/2844] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:06 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:06.249922 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bc556a08-4247-4810-9d69-bd2740e53fcc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:06.250523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bc556a08-4247-4810-9d69-bd2740e53fcc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:06.256869 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bc556a08-4247-4810-9d69-bd2740e53fcc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:06.257329 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bc556a08-4247-4810-9d69-bd2740e53fcc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:06.258094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bc556a08-4247-4810-9d69-bd2740e53fcc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:06.258533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bc556a08-4247-4810-9d69-bd2740e53fcc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:06.390038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bc556a08-4247-4810-9d69-bd2740e53fcc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:06.398278 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bc556a08-4247-4810-9d69-bd2740e53fcc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.152082 May 10 21:35:06.398872 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2069/2845] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:06 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:06.403223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f8944765-a996-4a6b-aa78-7da7c8f4f33c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:06.403823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f8944765-a996-4a6b-aa78-7da7c8f4f33c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:06.410024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f8944765-a996-4a6b-aa78-7da7c8f4f33c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:06.410638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f8944765-a996-4a6b-aa78-7da7c8f4f33c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:06.411432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f8944765-a996-4a6b-aa78-7da7c8f4f33c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:06.411871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f8944765-a996-4a6b-aa78-7da7c8f4f33c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:06.537971 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f8944765-a996-4a6b-aa78-7da7c8f4f33c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:06.545708 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f8944765-a996-4a6b-aa78-7da7c8f4f33c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.145882 May 10 21:35:06.546283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2070/2846] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:06 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:07.258669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-486be436-ca54-4a4c-b53f-4bc86a65660b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:07.259484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-486be436-ca54-4a4c-b53f-4bc86a65660b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:07.265741 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-486be436-ca54-4a4c-b53f-4bc86a65660b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:07.266190 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-486be436-ca54-4a4c-b53f-4bc86a65660b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:07.266955 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-486be436-ca54-4a4c-b53f-4bc86a65660b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:07.267494 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-486be436-ca54-4a4c-b53f-4bc86a65660b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:07.399574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-486be436-ca54-4a4c-b53f-4bc86a65660b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:07.407349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-486be436-ca54-4a4c-b53f-4bc86a65660b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.152628 May 10 21:35:07.408699 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2071/2847] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:07 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:07.414783 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-728cc995-10cf-41b9-a3f9-2e567c850017 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:07.415534 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-728cc995-10cf-41b9-a3f9-2e567c850017 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:07.421310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-728cc995-10cf-41b9-a3f9-2e567c850017 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:07.421754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-728cc995-10cf-41b9-a3f9-2e567c850017 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:07.422511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-728cc995-10cf-41b9-a3f9-2e567c850017 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:07.422943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-728cc995-10cf-41b9-a3f9-2e567c850017 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:07.552224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-728cc995-10cf-41b9-a3f9-2e567c850017 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:07.560092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-728cc995-10cf-41b9-a3f9-2e567c850017 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148992 May 10 21:35:07.560719 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2072/2848] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:07 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:07.566950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-204da9d2-5ed7-45c8-958f-3db8ef6d6a7c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:07.567612 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-204da9d2-5ed7-45c8-958f-3db8ef6d6a7c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:07.573265 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-204da9d2-5ed7-45c8-958f-3db8ef6d6a7c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:07.573712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-204da9d2-5ed7-45c8-958f-3db8ef6d6a7c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:07.574463 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-204da9d2-5ed7-45c8-958f-3db8ef6d6a7c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:07.574896 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-204da9d2-5ed7-45c8-958f-3db8ef6d6a7c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:07.701193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-204da9d2-5ed7-45c8-958f-3db8ef6d6a7c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:07.709535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-204da9d2-5ed7-45c8-958f-3db8ef6d6a7c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.146285 May 10 21:35:07.710102 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2073/2849] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:07 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:08.426014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5ef1c264-10a3-4a6d-aa60-30d23067281e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:08.426823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5ef1c264-10a3-4a6d-aa60-30d23067281e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:08.433520 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ef1c264-10a3-4a6d-aa60-30d23067281e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:08.433964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ef1c264-10a3-4a6d-aa60-30d23067281e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:08.434721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ef1c264-10a3-4a6d-aa60-30d23067281e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:08.435183 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ef1c264-10a3-4a6d-aa60-30d23067281e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:08.568208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5ef1c264-10a3-4a6d-aa60-30d23067281e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:08.576079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5ef1c264-10a3-4a6d-aa60-30d23067281e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.154555 May 10 21:35:08.576642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2074/2850] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:08 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:08.580977 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3e9ab92f-3355-4a93-8d49-334f199c6d4a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:08.582707 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3e9ab92f-3355-4a93-8d49-334f199c6d4a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:08.588578 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3e9ab92f-3355-4a93-8d49-334f199c6d4a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:08.589025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3e9ab92f-3355-4a93-8d49-334f199c6d4a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:08.589788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3e9ab92f-3355-4a93-8d49-334f199c6d4a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:08.590236 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3e9ab92f-3355-4a93-8d49-334f199c6d4a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:08.717760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3e9ab92f-3355-4a93-8d49-334f199c6d4a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:08.725842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3e9ab92f-3355-4a93-8d49-334f199c6d4a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148267 May 10 21:35:08.726399 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2075/2851] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:08 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:08.730717 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cbbcd078-0b28-46ef-8f8f-8b9066695763 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:08.731346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cbbcd078-0b28-46ef-8f8f-8b9066695763 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:08.736752 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbbcd078-0b28-46ef-8f8f-8b9066695763 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:08.737200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbbcd078-0b28-46ef-8f8f-8b9066695763 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:08.737991 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbbcd078-0b28-46ef-8f8f-8b9066695763 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:08.738573 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbbcd078-0b28-46ef-8f8f-8b9066695763 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:08.867433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cbbcd078-0b28-46ef-8f8f-8b9066695763 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:08.875090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cbbcd078-0b28-46ef-8f8f-8b9066695763 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.147774 May 10 21:35:08.875680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2076/2852] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:08 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:09.593356 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2d38c386-abe3-436a-a207-63b2caaf7f55 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:09.594035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2d38c386-abe3-436a-a207-63b2caaf7f55 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:09.601170 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d38c386-abe3-436a-a207-63b2caaf7f55 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:09.601616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d38c386-abe3-436a-a207-63b2caaf7f55 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:09.602382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d38c386-abe3-436a-a207-63b2caaf7f55 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:09.602815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d38c386-abe3-436a-a207-63b2caaf7f55 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:09.731271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2d38c386-abe3-436a-a207-63b2caaf7f55 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:09.739790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2d38c386-abe3-436a-a207-63b2caaf7f55 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150357 May 10 21:35:09.740352 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2077/2853] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:09 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:09.744659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-91a042cf-4451-4c24-b668-7eba42d18a6f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:09.745257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-91a042cf-4451-4c24-b668-7eba42d18a6f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:09.750744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91a042cf-4451-4c24-b668-7eba42d18a6f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:09.751224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91a042cf-4451-4c24-b668-7eba42d18a6f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:09.751977 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91a042cf-4451-4c24-b668-7eba42d18a6f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:09.752411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91a042cf-4451-4c24-b668-7eba42d18a6f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:09.879762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-91a042cf-4451-4c24-b668-7eba42d18a6f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:09.887782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-91a042cf-4451-4c24-b668-7eba42d18a6f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.146501 May 10 21:35:09.888341 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2078/2854] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:09 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:09.892668 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-293f73a0-7f54-4bc8-a9d6-0c066e86bb3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:09.893300 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-293f73a0-7f54-4bc8-a9d6-0c066e86bb3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:09.899570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-293f73a0-7f54-4bc8-a9d6-0c066e86bb3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:09.900017 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-293f73a0-7f54-4bc8-a9d6-0c066e86bb3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:09.900763 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-293f73a0-7f54-4bc8-a9d6-0c066e86bb3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:09.901194 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-293f73a0-7f54-4bc8-a9d6-0c066e86bb3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:10.032982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-293f73a0-7f54-4bc8-a9d6-0c066e86bb3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:10.041530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-293f73a0-7f54-4bc8-a9d6-0c066e86bb3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.152247 May 10 21:35:10.042101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2079/2855] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:09 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:10.756465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b77ef0f0-7dec-4fc0-af94-030b5f2a7e59 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:10.757091 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b77ef0f0-7dec-4fc0-af94-030b5f2a7e59 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:10.763459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b77ef0f0-7dec-4fc0-af94-030b5f2a7e59 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:10.763917 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b77ef0f0-7dec-4fc0-af94-030b5f2a7e59 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:10.764682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b77ef0f0-7dec-4fc0-af94-030b5f2a7e59 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:10.765139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b77ef0f0-7dec-4fc0-af94-030b5f2a7e59 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:10.892900 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b77ef0f0-7dec-4fc0-af94-030b5f2a7e59 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:10.901224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b77ef0f0-7dec-4fc0-af94-030b5f2a7e59 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149376 May 10 21:35:10.901787 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2080/2856] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:10 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:10.906222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-403f6a22-d395-4e92-8e87-3933149fd16d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:10.906816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-403f6a22-d395-4e92-8e87-3933149fd16d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:10.913373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-403f6a22-d395-4e92-8e87-3933149fd16d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:10.913819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-403f6a22-d395-4e92-8e87-3933149fd16d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:10.914572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-403f6a22-d395-4e92-8e87-3933149fd16d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:10.915005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-403f6a22-d395-4e92-8e87-3933149fd16d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:11.046531 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-403f6a22-d395-4e92-8e87-3933149fd16d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:11.054346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-403f6a22-d395-4e92-8e87-3933149fd16d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151632 May 10 21:35:11.054909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2081/2857] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:10 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:11.059350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6860c3a1-2c8c-4ebb-a10c-ab24af5c5245 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:11.059951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6860c3a1-2c8c-4ebb-a10c-ab24af5c5245 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:11.065488 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6860c3a1-2c8c-4ebb-a10c-ab24af5c5245 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:11.066487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6860c3a1-2c8c-4ebb-a10c-ab24af5c5245 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:11.067231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6860c3a1-2c8c-4ebb-a10c-ab24af5c5245 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:11.067664 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6860c3a1-2c8c-4ebb-a10c-ab24af5c5245 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:11.195919 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6860c3a1-2c8c-4ebb-a10c-ab24af5c5245 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:11.203910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6860c3a1-2c8c-4ebb-a10c-ab24af5c5245 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.147996 May 10 21:35:11.204484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2082/2858] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:11 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:11.919104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0eed1390-ca8d-41f1-ac78-1f02847339b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:11.919766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0eed1390-ca8d-41f1-ac78-1f02847339b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:11.926005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0eed1390-ca8d-41f1-ac78-1f02847339b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:11.927094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0eed1390-ca8d-41f1-ac78-1f02847339b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:11.927885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0eed1390-ca8d-41f1-ac78-1f02847339b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:11.928324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0eed1390-ca8d-41f1-ac78-1f02847339b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:12.057326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0eed1390-ca8d-41f1-ac78-1f02847339b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:12.065172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0eed1390-ca8d-41f1-ac78-1f02847339b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149994 May 10 21:35:12.065649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2083/2859] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:11 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:12.071414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-668a205a-f5af-450e-832a-75a62e3a3a2b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:12.072019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-668a205a-f5af-450e-832a-75a62e3a3a2b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:12.077659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-668a205a-f5af-450e-832a-75a62e3a3a2b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:12.078119 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-668a205a-f5af-450e-832a-75a62e3a3a2b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:12.078881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-668a205a-f5af-450e-832a-75a62e3a3a2b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:12.079346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-668a205a-f5af-450e-832a-75a62e3a3a2b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:12.204125 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-668a205a-f5af-450e-832a-75a62e3a3a2b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:12.212698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-668a205a-f5af-450e-832a-75a62e3a3a2b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.144766 May 10 21:35:12.213271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2084/2860] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:12 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:12.221229 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-839e263e-df20-45b7-a16b-ac72df733788 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:12.221833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-839e263e-df20-45b7-a16b-ac72df733788 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:12.228433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-839e263e-df20-45b7-a16b-ac72df733788 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:12.228881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-839e263e-df20-45b7-a16b-ac72df733788 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:12.229631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-839e263e-df20-45b7-a16b-ac72df733788 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:12.230061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-839e263e-df20-45b7-a16b-ac72df733788 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:12.355589 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-839e263e-df20-45b7-a16b-ac72df733788 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:12.363406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-839e263e-df20-45b7-a16b-ac72df733788 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.145726 May 10 21:35:12.363968 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2085/2861] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:12 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:13.082829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1e04e22d-ac79-4543-ae6d-42e60d71a327 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:13.083482 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1e04e22d-ac79-4543-ae6d-42e60d71a327 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:13.090748 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1e04e22d-ac79-4543-ae6d-42e60d71a327 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:13.091232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1e04e22d-ac79-4543-ae6d-42e60d71a327 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:13.091989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1e04e22d-ac79-4543-ae6d-42e60d71a327 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:13.092425 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1e04e22d-ac79-4543-ae6d-42e60d71a327 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:13.233634 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1e04e22d-ac79-4543-ae6d-42e60d71a327 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:13.241861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1e04e22d-ac79-4543-ae6d-42e60d71a327 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.162955 May 10 21:35:13.242432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2086/2862] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:13 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:13.246750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ca442287-a53c-4bbc-917c-98cb64a22bc1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:13.247407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ca442287-a53c-4bbc-917c-98cb64a22bc1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:13.252893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ca442287-a53c-4bbc-917c-98cb64a22bc1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:13.253344 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ca442287-a53c-4bbc-917c-98cb64a22bc1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:13.254113 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ca442287-a53c-4bbc-917c-98cb64a22bc1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:13.254552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ca442287-a53c-4bbc-917c-98cb64a22bc1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:13.384475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ca442287-a53c-4bbc-917c-98cb64a22bc1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:13.392331 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ca442287-a53c-4bbc-917c-98cb64a22bc1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148918 May 10 21:35:13.392900 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2087/2863] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:13 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:13.397877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-346eed00-1f18-4ffd-b958-b163a176c2f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:13.398479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-346eed00-1f18-4ffd-b958-b163a176c2f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:13.403946 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-346eed00-1f18-4ffd-b958-b163a176c2f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:13.404397 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-346eed00-1f18-4ffd-b958-b163a176c2f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:13.405156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-346eed00-1f18-4ffd-b958-b163a176c2f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:13.405595 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-346eed00-1f18-4ffd-b958-b163a176c2f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:13.534152 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-346eed00-1f18-4ffd-b958-b163a176c2f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:13.542333 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-346eed00-1f18-4ffd-b958-b163a176c2f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148466 May 10 21:35:13.544889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2088/2864] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:13 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:14.258627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cbf696a7-0477-4215-bce6-febe6fafdf8b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:14.259344 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cbf696a7-0477-4215-bce6-febe6fafdf8b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:14.265401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbf696a7-0477-4215-bce6-febe6fafdf8b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:14.265853 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbf696a7-0477-4215-bce6-febe6fafdf8b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:14.266619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbf696a7-0477-4215-bce6-febe6fafdf8b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:14.267062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbf696a7-0477-4215-bce6-febe6fafdf8b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:14.394405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cbf696a7-0477-4215-bce6-febe6fafdf8b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:14.403715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cbf696a7-0477-4215-bce6-febe6fafdf8b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148452 May 10 21:35:14.404358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2089/2865] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:14 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:14.409333 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-21cca4d4-28f1-4e02-ab6e-f76643c9ccb9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:14.409940 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-21cca4d4-28f1-4e02-ab6e-f76643c9ccb9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:14.416264 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21cca4d4-28f1-4e02-ab6e-f76643c9ccb9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:14.416715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21cca4d4-28f1-4e02-ab6e-f76643c9ccb9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:14.417481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21cca4d4-28f1-4e02-ab6e-f76643c9ccb9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:14.417925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21cca4d4-28f1-4e02-ab6e-f76643c9ccb9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:14.552201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-21cca4d4-28f1-4e02-ab6e-f76643c9ccb9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:14.560128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-21cca4d4-28f1-4e02-ab6e-f76643c9ccb9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.154243 May 10 21:35:14.560910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2090/2866] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:14 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:14.566906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-be9847ee-73f9-4652-8fc1-50ac0cfe957d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:14.567555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-be9847ee-73f9-4652-8fc1-50ac0cfe957d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:14.573583 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be9847ee-73f9-4652-8fc1-50ac0cfe957d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:14.574014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be9847ee-73f9-4652-8fc1-50ac0cfe957d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:14.574768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be9847ee-73f9-4652-8fc1-50ac0cfe957d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:14.575236 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be9847ee-73f9-4652-8fc1-50ac0cfe957d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:14.705105 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-be9847ee-73f9-4652-8fc1-50ac0cfe957d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:14.713683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-be9847ee-73f9-4652-8fc1-50ac0cfe957d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150500 May 10 21:35:14.714244 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2091/2867] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:14 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:15.421367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7b590cd0-fc80-4859-8368-70aca14b030e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:15.422167 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7b590cd0-fc80-4859-8368-70aca14b030e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:15.429045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b590cd0-fc80-4859-8368-70aca14b030e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:15.429487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b590cd0-fc80-4859-8368-70aca14b030e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:15.430238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b590cd0-fc80-4859-8368-70aca14b030e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:15.430672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b590cd0-fc80-4859-8368-70aca14b030e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:15.559895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7b590cd0-fc80-4859-8368-70aca14b030e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:15.567735 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7b590cd0-fc80-4859-8368-70aca14b030e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150350 May 10 21:35:15.568549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2092/2868] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:15 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:15.576832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d58d4838-7f99-46ea-84b6-91b895b1a721 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:15.577439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d58d4838-7f99-46ea-84b6-91b895b1a721 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:15.583050 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d58d4838-7f99-46ea-84b6-91b895b1a721 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:15.583535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d58d4838-7f99-46ea-84b6-91b895b1a721 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:15.584329 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d58d4838-7f99-46ea-84b6-91b895b1a721 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:15.584845 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d58d4838-7f99-46ea-84b6-91b895b1a721 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:15.714367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d58d4838-7f99-46ea-84b6-91b895b1a721 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:15.722108 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d58d4838-7f99-46ea-84b6-91b895b1a721 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148841 May 10 21:35:15.722674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2093/2869] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:15 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:15.730825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2095b080-4fa2-4546-a3ca-214722f302af tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:15.731466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2095b080-4fa2-4546-a3ca-214722f302af tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:15.737232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2095b080-4fa2-4546-a3ca-214722f302af tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:15.737684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2095b080-4fa2-4546-a3ca-214722f302af tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:15.738432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2095b080-4fa2-4546-a3ca-214722f302af tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:15.738863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2095b080-4fa2-4546-a3ca-214722f302af tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:15.866224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2095b080-4fa2-4546-a3ca-214722f302af tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:15.874016 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2095b080-4fa2-4546-a3ca-214722f302af tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.146775 May 10 21:35:15.874574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2094/2870] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:15 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:16.585603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e42b4e0a-05e2-4ae3-b7a9-5f8e02e686fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:16.586531 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e42b4e0a-05e2-4ae3-b7a9-5f8e02e686fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:16.592894 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e42b4e0a-05e2-4ae3-b7a9-5f8e02e686fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:16.593354 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e42b4e0a-05e2-4ae3-b7a9-5f8e02e686fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:16.594120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e42b4e0a-05e2-4ae3-b7a9-5f8e02e686fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:16.594562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e42b4e0a-05e2-4ae3-b7a9-5f8e02e686fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:16.724658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e42b4e0a-05e2-4ae3-b7a9-5f8e02e686fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:16.732744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e42b4e0a-05e2-4ae3-b7a9-5f8e02e686fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150965 May 10 21:35:16.733332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2095/2871] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:16 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:16.739160 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-382b9e51-d4d6-4df8-8543-bf2283044313 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:16.739773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-382b9e51-d4d6-4df8-8543-bf2283044313 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:16.745885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-382b9e51-d4d6-4df8-8543-bf2283044313 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:16.746339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-382b9e51-d4d6-4df8-8543-bf2283044313 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:16.747102 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-382b9e51-d4d6-4df8-8543-bf2283044313 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:16.747572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-382b9e51-d4d6-4df8-8543-bf2283044313 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:16.873344 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-382b9e51-d4d6-4df8-8543-bf2283044313 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:16.881077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-382b9e51-d4d6-4df8-8543-bf2283044313 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.145429 May 10 21:35:16.882230 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2096/2872] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:16 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:16.890966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c4c722e0-fd73-4bd1-a2c4-d7d9c0ebbc8d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:16.891690 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c4c722e0-fd73-4bd1-a2c4-d7d9c0ebbc8d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:16.897931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4c722e0-fd73-4bd1-a2c4-d7d9c0ebbc8d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:16.898382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4c722e0-fd73-4bd1-a2c4-d7d9c0ebbc8d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:16.899238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4c722e0-fd73-4bd1-a2c4-d7d9c0ebbc8d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:16.899686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4c722e0-fd73-4bd1-a2c4-d7d9c0ebbc8d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:17.026560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c4c722e0-fd73-4bd1-a2c4-d7d9c0ebbc8d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:17.034260 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c4c722e0-fd73-4bd1-a2c4-d7d9c0ebbc8d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.146788 May 10 21:35:17.034821 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2097/2873] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:16 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:17.750388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c373b75a-70ab-41df-80e0-0b2256fc7f4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:17.750978 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c373b75a-70ab-41df-80e0-0b2256fc7f4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:17.757358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c373b75a-70ab-41df-80e0-0b2256fc7f4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:17.757816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c373b75a-70ab-41df-80e0-0b2256fc7f4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:17.758573 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c373b75a-70ab-41df-80e0-0b2256fc7f4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:17.759003 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c373b75a-70ab-41df-80e0-0b2256fc7f4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:17.890082 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c373b75a-70ab-41df-80e0-0b2256fc7f4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:17.897936 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c373b75a-70ab-41df-80e0-0b2256fc7f4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151415 May 10 21:35:17.898507 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2098/2874] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:17 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:17.902862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c8c470d0-8192-48d6-9167-1a9a57295157 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:17.903654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c8c470d0-8192-48d6-9167-1a9a57295157 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:17.909271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c8c470d0-8192-48d6-9167-1a9a57295157 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:17.909727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c8c470d0-8192-48d6-9167-1a9a57295157 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:17.910498 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c8c470d0-8192-48d6-9167-1a9a57295157 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:17.910937 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c8c470d0-8192-48d6-9167-1a9a57295157 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:18.196767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c8c470d0-8192-48d6-9167-1a9a57295157 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:18.204492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c8c470d0-8192-48d6-9167-1a9a57295157 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.305059 May 10 21:35:18.205052 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2099/2875] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:17 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:18.209826 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-22521317-c5ec-4476-ac2e-ff12964e9125 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:18.210543 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-22521317-c5ec-4476-ac2e-ff12964e9125 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:18.216153 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-22521317-c5ec-4476-ac2e-ff12964e9125 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:18.216606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-22521317-c5ec-4476-ac2e-ff12964e9125 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:18.217370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-22521317-c5ec-4476-ac2e-ff12964e9125 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:18.217799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-22521317-c5ec-4476-ac2e-ff12964e9125 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:18.345656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-22521317-c5ec-4476-ac2e-ff12964e9125 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:18.353376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-22521317-c5ec-4476-ac2e-ff12964e9125 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.147398 May 10 21:35:18.353931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2100/2876] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:18 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:18.915548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5ca2179c-39f2-49e4-b923-5935b41bf14a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:18.916249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5ca2179c-39f2-49e4-b923-5935b41bf14a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:18.922962 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ca2179c-39f2-49e4-b923-5935b41bf14a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:18.923469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ca2179c-39f2-49e4-b923-5935b41bf14a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:18.924247 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ca2179c-39f2-49e4-b923-5935b41bf14a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:18.924686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ca2179c-39f2-49e4-b923-5935b41bf14a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:19.136879 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5ca2179c-39f2-49e4-b923-5935b41bf14a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:19.144819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5ca2179c-39f2-49e4-b923-5935b41bf14a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.234282 May 10 21:35:19.145381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2101/2877] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:18 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:19.222245 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-20ee9f9b-8db5-42c3-a0c2-bff03edd6be4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:19.222861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-20ee9f9b-8db5-42c3-a0c2-bff03edd6be4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:19.229761 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20ee9f9b-8db5-42c3-a0c2-bff03edd6be4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:19.230211 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20ee9f9b-8db5-42c3-a0c2-bff03edd6be4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:19.230981 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20ee9f9b-8db5-42c3-a0c2-bff03edd6be4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:19.231464 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20ee9f9b-8db5-42c3-a0c2-bff03edd6be4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:19.450196 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-20ee9f9b-8db5-42c3-a0c2-bff03edd6be4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:19.458491 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-20ee9f9b-8db5-42c3-a0c2-bff03edd6be4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.240123 May 10 21:35:19.459048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2102/2878] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:19 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:19.464334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d8aa7a9e-0742-4b35-968e-18143860416d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:19.465206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d8aa7a9e-0742-4b35-968e-18143860416d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:19.470645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d8aa7a9e-0742-4b35-968e-18143860416d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:19.471075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d8aa7a9e-0742-4b35-968e-18143860416d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:19.471862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d8aa7a9e-0742-4b35-968e-18143860416d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:19.472301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d8aa7a9e-0742-4b35-968e-18143860416d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:19.598195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d8aa7a9e-0742-4b35-968e-18143860416d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:19.607327 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d8aa7a9e-0742-4b35-968e-18143860416d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.146706 May 10 21:35:19.608078 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2103/2879] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:19 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:20.161310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ba14d3f0-44e4-4fb9-8605-9f8d68c85ccc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:20.161990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ba14d3f0-44e4-4fb9-8605-9f8d68c85ccc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:20.168520 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ba14d3f0-44e4-4fb9-8605-9f8d68c85ccc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:20.168966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ba14d3f0-44e4-4fb9-8605-9f8d68c85ccc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:20.169723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ba14d3f0-44e4-4fb9-8605-9f8d68c85ccc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:20.170156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ba14d3f0-44e4-4fb9-8605-9f8d68c85ccc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:20.298063 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ba14d3f0-44e4-4fb9-8605-9f8d68c85ccc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:20.306347 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ba14d3f0-44e4-4fb9-8605-9f8d68c85ccc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148954 May 10 21:35:20.306906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2104/2880] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:20 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:20.476346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1f343407-43a7-4853-be2f-0572e2595283 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:20.476891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1f343407-43a7-4853-be2f-0572e2595283 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:20.482799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1f343407-43a7-4853-be2f-0572e2595283 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:20.483293 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1f343407-43a7-4853-be2f-0572e2595283 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:20.484097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1f343407-43a7-4853-be2f-0572e2595283 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:20.484542 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1f343407-43a7-4853-be2f-0572e2595283 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:20.613774 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1f343407-43a7-4853-be2f-0572e2595283 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:20.622406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1f343407-43a7-4853-be2f-0572e2595283 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150005 May 10 21:35:20.622993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2105/2881] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:20 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:20.627329 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-79c7feea-6791-446e-9c92-797dc818692e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:20.627929 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-79c7feea-6791-446e-9c92-797dc818692e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:20.633517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-79c7feea-6791-446e-9c92-797dc818692e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:20.633966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-79c7feea-6791-446e-9c92-797dc818692e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:20.634726 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-79c7feea-6791-446e-9c92-797dc818692e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:20.635182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-79c7feea-6791-446e-9c92-797dc818692e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:20.758485 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-79c7feea-6791-446e-9c92-797dc818692e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:20.766337 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-79c7feea-6791-446e-9c92-797dc818692e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.142397 May 10 21:35:20.766888 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2106/2882] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:20 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:21.323281 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3ca7ba3f-24b4-46ed-bfef-cf4ee1033d55 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:21.323991 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3ca7ba3f-24b4-46ed-bfef-cf4ee1033d55 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:21.330194 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ca7ba3f-24b4-46ed-bfef-cf4ee1033d55 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:21.330647 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ca7ba3f-24b4-46ed-bfef-cf4ee1033d55 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:21.331447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ca7ba3f-24b4-46ed-bfef-cf4ee1033d55 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:21.331892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ca7ba3f-24b4-46ed-bfef-cf4ee1033d55 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:21.462700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3ca7ba3f-24b4-46ed-bfef-cf4ee1033d55 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:21.470477 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3ca7ba3f-24b4-46ed-bfef-cf4ee1033d55 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151559 May 10 21:35:21.471033 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2107/2883] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:21 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:21.639676 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9ea47106-319f-4bc3-a195-62a90b968a68 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:21.640290 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9ea47106-319f-4bc3-a195-62a90b968a68 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:21.646155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ea47106-319f-4bc3-a195-62a90b968a68 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:21.646600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ea47106-319f-4bc3-a195-62a90b968a68 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:21.648093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ea47106-319f-4bc3-a195-62a90b968a68 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:21.648524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ea47106-319f-4bc3-a195-62a90b968a68 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:21.777593 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9ea47106-319f-4bc3-a195-62a90b968a68 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:21.785442 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9ea47106-319f-4bc3-a195-62a90b968a68 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149616 May 10 21:35:21.785997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2108/2884] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:21 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:21.790521 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-47242e30-140a-4788-bee4-2e4ed6c6e63d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:21.791138 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-47242e30-140a-4788-bee4-2e4ed6c6e63d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:21.796636 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47242e30-140a-4788-bee4-2e4ed6c6e63d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:21.797076 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47242e30-140a-4788-bee4-2e4ed6c6e63d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:21.797828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47242e30-140a-4788-bee4-2e4ed6c6e63d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:21.798258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47242e30-140a-4788-bee4-2e4ed6c6e63d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:21.930990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-47242e30-140a-4788-bee4-2e4ed6c6e63d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:21.938801 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-47242e30-140a-4788-bee4-2e4ed6c6e63d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.151818 May 10 21:35:21.939408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2109/2885] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:21 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:22.487678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-778fd2a7-75de-4e9f-aef3-4ab385f369a0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:22.488339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-778fd2a7-75de-4e9f-aef3-4ab385f369a0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:22.494867 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-778fd2a7-75de-4e9f-aef3-4ab385f369a0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:22.498983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-778fd2a7-75de-4e9f-aef3-4ab385f369a0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:22.498983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-778fd2a7-75de-4e9f-aef3-4ab385f369a0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:22.498983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-778fd2a7-75de-4e9f-aef3-4ab385f369a0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:22.624463 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-778fd2a7-75de-4e9f-aef3-4ab385f369a0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:22.632471 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-778fd2a7-75de-4e9f-aef3-4ab385f369a0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148611 May 10 21:35:22.633028 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2110/2886] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:22 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:22.801729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5e83301c-f331-4fdf-8a0b-eb258975ae4c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:22.802253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5e83301c-f331-4fdf-8a0b-eb258975ae4c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:22.808729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5e83301c-f331-4fdf-8a0b-eb258975ae4c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:22.809177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5e83301c-f331-4fdf-8a0b-eb258975ae4c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:22.809931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5e83301c-f331-4fdf-8a0b-eb258975ae4c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:22.810396 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5e83301c-f331-4fdf-8a0b-eb258975ae4c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:22.936684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5e83301c-f331-4fdf-8a0b-eb258975ae4c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:22.945164 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5e83301c-f331-4fdf-8a0b-eb258975ae4c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.147401 May 10 21:35:22.945718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2111/2887] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:22 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:22.955610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-776a4d9d-7162-482e-83ba-03c5b2887b5c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:22.956217 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-776a4d9d-7162-482e-83ba-03c5b2887b5c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:22.962880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-776a4d9d-7162-482e-83ba-03c5b2887b5c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:22.963373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-776a4d9d-7162-482e-83ba-03c5b2887b5c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:22.964143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-776a4d9d-7162-482e-83ba-03c5b2887b5c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:22.964581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-776a4d9d-7162-482e-83ba-03c5b2887b5c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:23.093489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-776a4d9d-7162-482e-83ba-03c5b2887b5c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:23.101814 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-776a4d9d-7162-482e-83ba-03c5b2887b5c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149769 May 10 21:35:23.102360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2112/2888] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:22 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:23.649901 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-752eaaf5-abc1-45ce-9a84-b8c3f4bdc1ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:23.650497 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-752eaaf5-abc1-45ce-9a84-b8c3f4bdc1ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:23.656910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-752eaaf5-abc1-45ce-9a84-b8c3f4bdc1ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:23.657359 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-752eaaf5-abc1-45ce-9a84-b8c3f4bdc1ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:23.658118 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-752eaaf5-abc1-45ce-9a84-b8c3f4bdc1ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:23.658556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-752eaaf5-abc1-45ce-9a84-b8c3f4bdc1ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:23.783312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-752eaaf5-abc1-45ce-9a84-b8c3f4bdc1ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:23.791820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-752eaaf5-abc1-45ce-9a84-b8c3f4bdc1ea tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.146371 May 10 21:35:23.792373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2113/2889] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:23 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:23.963036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-27d74047-6de5-4302-875d-94dcca0804a4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:23.963594 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-27d74047-6de5-4302-875d-94dcca0804a4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:23.969439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27d74047-6de5-4302-875d-94dcca0804a4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:23.969891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27d74047-6de5-4302-875d-94dcca0804a4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:23.970645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27d74047-6de5-4302-875d-94dcca0804a4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:23.971076 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-27d74047-6de5-4302-875d-94dcca0804a4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:24.101493 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-27d74047-6de5-4302-875d-94dcca0804a4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:24.109287 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-27d74047-6de5-4302-875d-94dcca0804a4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151168 May 10 21:35:24.109851 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2114/2890] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:23 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:24.118479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-28f793af-b085-47ff-ad89-f7288fd6853e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:24.119194 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-28f793af-b085-47ff-ad89-f7288fd6853e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:24.125150 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28f793af-b085-47ff-ad89-f7288fd6853e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:24.125575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28f793af-b085-47ff-ad89-f7288fd6853e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:24.126335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28f793af-b085-47ff-ad89-f7288fd6853e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:24.126769 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-28f793af-b085-47ff-ad89-f7288fd6853e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:24.254864 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-28f793af-b085-47ff-ad89-f7288fd6853e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:24.263800 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-28f793af-b085-47ff-ad89-f7288fd6853e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149460 May 10 21:35:24.264355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2115/2891] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:24 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:24.809484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-845cf34f-7dd1-406d-999b-e174f8bd2c93 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:24.810190 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-845cf34f-7dd1-406d-999b-e174f8bd2c93 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:24.821086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-845cf34f-7dd1-406d-999b-e174f8bd2c93 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:24.821546 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-845cf34f-7dd1-406d-999b-e174f8bd2c93 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:24.822345 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-845cf34f-7dd1-406d-999b-e174f8bd2c93 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:24.822790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-845cf34f-7dd1-406d-999b-e174f8bd2c93 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:24.960397 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-845cf34f-7dd1-406d-999b-e174f8bd2c93 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:24.968480 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-845cf34f-7dd1-406d-999b-e174f8bd2c93 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.163397 May 10 21:35:24.969031 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2116/2892] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:24 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:25.127575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-982d7593-8db7-4b27-93a2-d8ee9ad0b4ca tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:25.128278 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-982d7593-8db7-4b27-93a2-d8ee9ad0b4ca tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:25.135225 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-982d7593-8db7-4b27-93a2-d8ee9ad0b4ca tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:25.135679 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-982d7593-8db7-4b27-93a2-d8ee9ad0b4ca tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:25.136484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-982d7593-8db7-4b27-93a2-d8ee9ad0b4ca tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:25.136961 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-982d7593-8db7-4b27-93a2-d8ee9ad0b4ca tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:25.525599 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-982d7593-8db7-4b27-93a2-d8ee9ad0b4ca tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:25.533469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-982d7593-8db7-4b27-93a2-d8ee9ad0b4ca tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.409827 May 10 21:35:25.534033 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2117/2893] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:25 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:25.539164 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a8985d30-c16a-4547-8ad4-718444a528de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:25.539779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a8985d30-c16a-4547-8ad4-718444a528de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:25.545701 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a8985d30-c16a-4547-8ad4-718444a528de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:25.546155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a8985d30-c16a-4547-8ad4-718444a528de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:25.546928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a8985d30-c16a-4547-8ad4-718444a528de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:25.547394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a8985d30-c16a-4547-8ad4-718444a528de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:25.675631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a8985d30-c16a-4547-8ad4-718444a528de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:25.684321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a8985d30-c16a-4547-8ad4-718444a528de tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149320 May 10 21:35:25.684890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2118/2894] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:25 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:25.985801 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-520cc1db-bb53-4464-b7f2-28673c5fe9b0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:25.986502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-520cc1db-bb53-4464-b7f2-28673c5fe9b0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:25.993204 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-520cc1db-bb53-4464-b7f2-28673c5fe9b0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:25.993659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-520cc1db-bb53-4464-b7f2-28673c5fe9b0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:25.994434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-520cc1db-bb53-4464-b7f2-28673c5fe9b0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:25.994872 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-520cc1db-bb53-4464-b7f2-28673c5fe9b0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:26.122930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-520cc1db-bb53-4464-b7f2-28673c5fe9b0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:26.130632 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-520cc1db-bb53-4464-b7f2-28673c5fe9b0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148727 May 10 21:35:26.132025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2119/2895] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:25 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:26.551326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1d1cf7ff-9161-4913-9c33-66ae5d303df7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:26.551932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1d1cf7ff-9161-4913-9c33-66ae5d303df7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:26.558157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d1cf7ff-9161-4913-9c33-66ae5d303df7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:26.558604 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d1cf7ff-9161-4913-9c33-66ae5d303df7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:26.559386 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d1cf7ff-9161-4913-9c33-66ae5d303df7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:26.559826 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d1cf7ff-9161-4913-9c33-66ae5d303df7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:26.690449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1d1cf7ff-9161-4913-9c33-66ae5d303df7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:26.699438 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1d1cf7ff-9161-4913-9c33-66ae5d303df7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151984 May 10 21:35:26.700001 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2120/2896] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:26 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:26.704342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-55afce66-cae4-46f6-8cb8-30f61c203af8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:26.704936 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-55afce66-cae4-46f6-8cb8-30f61c203af8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:26.711518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-55afce66-cae4-46f6-8cb8-30f61c203af8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:26.711968 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-55afce66-cae4-46f6-8cb8-30f61c203af8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:26.712724 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-55afce66-cae4-46f6-8cb8-30f61c203af8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:26.713158 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-55afce66-cae4-46f6-8cb8-30f61c203af8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:26.841263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-55afce66-cae4-46f6-8cb8-30f61c203af8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:26.849102 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-55afce66-cae4-46f6-8cb8-30f61c203af8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148168 May 10 21:35:26.849670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2121/2897] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:26 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:27.147234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b3e2733c-c446-4912-baec-9df72dabf663 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:27.147910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b3e2733c-c446-4912-baec-9df72dabf663 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:27.154302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3e2733c-c446-4912-baec-9df72dabf663 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:27.154753 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3e2733c-c446-4912-baec-9df72dabf663 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:27.155547 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3e2733c-c446-4912-baec-9df72dabf663 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:27.155993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3e2733c-c446-4912-baec-9df72dabf663 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:27.282751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b3e2733c-c446-4912-baec-9df72dabf663 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:27.290987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b3e2733c-c446-4912-baec-9df72dabf663 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147765 May 10 21:35:27.291587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2122/2898] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:27 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:27.716363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2896611d-0bd8-45d4-8f72-0f7c8c2de354 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:27.716991 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2896611d-0bd8-45d4-8f72-0f7c8c2de354 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:27.722919 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2896611d-0bd8-45d4-8f72-0f7c8c2de354 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:27.723412 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2896611d-0bd8-45d4-8f72-0f7c8c2de354 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:27.724169 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2896611d-0bd8-45d4-8f72-0f7c8c2de354 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:27.724604 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2896611d-0bd8-45d4-8f72-0f7c8c2de354 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:27.853523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2896611d-0bd8-45d4-8f72-0f7c8c2de354 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:27.861702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2896611d-0bd8-45d4-8f72-0f7c8c2de354 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149193 May 10 21:35:27.862266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2123/2899] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:27 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:27.867263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3b27671a-9243-4e45-9b6e-951844389c2f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:27.867870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3b27671a-9243-4e45-9b6e-951844389c2f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:27.873402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3b27671a-9243-4e45-9b6e-951844389c2f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:27.873849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3b27671a-9243-4e45-9b6e-951844389c2f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:27.874607 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3b27671a-9243-4e45-9b6e-951844389c2f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:27.875047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3b27671a-9243-4e45-9b6e-951844389c2f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:28.001133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3b27671a-9243-4e45-9b6e-951844389c2f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:28.009786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3b27671a-9243-4e45-9b6e-951844389c2f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.146586 May 10 21:35:28.010355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2124/2900] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:27 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:28.308422 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6d120bd5-1058-4b08-b53d-a3b2ba76dc5e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:28.309101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6d120bd5-1058-4b08-b53d-a3b2ba76dc5e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:28.315282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6d120bd5-1058-4b08-b53d-a3b2ba76dc5e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:28.315730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6d120bd5-1058-4b08-b53d-a3b2ba76dc5e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:28.316512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6d120bd5-1058-4b08-b53d-a3b2ba76dc5e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:28.316933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6d120bd5-1058-4b08-b53d-a3b2ba76dc5e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:28.441608 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6d120bd5-1058-4b08-b53d-a3b2ba76dc5e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:28.450049 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6d120bd5-1058-4b08-b53d-a3b2ba76dc5e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.145505 May 10 21:35:28.450613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2125/2901] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:28 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:28.879023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f85e623a-bd21-4745-900e-b6ecc8bd8a47 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:28.879695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f85e623a-bd21-4745-900e-b6ecc8bd8a47 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:28.886292 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f85e623a-bd21-4745-900e-b6ecc8bd8a47 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:28.886742 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f85e623a-bd21-4745-900e-b6ecc8bd8a47 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:28.887616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f85e623a-bd21-4745-900e-b6ecc8bd8a47 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:28.888080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f85e623a-bd21-4745-900e-b6ecc8bd8a47 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:29.021520 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f85e623a-bd21-4745-900e-b6ecc8bd8a47 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:29.029913 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f85e623a-bd21-4745-900e-b6ecc8bd8a47 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.154983 May 10 21:35:29.030474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2126/2902] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:28 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:29.034814 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ef8cbdc4-1306-46cb-ab00-1c8190b98172 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:29.035436 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ef8cbdc4-1306-46cb-ab00-1c8190b98172 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:29.041338 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ef8cbdc4-1306-46cb-ab00-1c8190b98172 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:29.041793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ef8cbdc4-1306-46cb-ab00-1c8190b98172 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:29.042549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ef8cbdc4-1306-46cb-ab00-1c8190b98172 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:29.042986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ef8cbdc4-1306-46cb-ab00-1c8190b98172 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:29.169306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ef8cbdc4-1306-46cb-ab00-1c8190b98172 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:29.177127 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ef8cbdc4-1306-46cb-ab00-1c8190b98172 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.145720 May 10 21:35:29.177694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2127/2903] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:29 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:29.467642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-854cb535-a9b1-4148-96b3-aaf63e3f387a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:29.468263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-854cb535-a9b1-4148-96b3-aaf63e3f387a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:29.474568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-854cb535-a9b1-4148-96b3-aaf63e3f387a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:29.475263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-854cb535-a9b1-4148-96b3-aaf63e3f387a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:29.476145 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-854cb535-a9b1-4148-96b3-aaf63e3f387a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:29.476591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-854cb535-a9b1-4148-96b3-aaf63e3f387a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:29.606826 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-854cb535-a9b1-4148-96b3-aaf63e3f387a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:29.614708 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-854cb535-a9b1-4148-96b3-aaf63e3f387a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150981 May 10 21:35:29.615294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2128/2904] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:29 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:30.047696 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-75cd86a1-c809-492b-820a-2c7b09324b21 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:30.048303 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-75cd86a1-c809-492b-820a-2c7b09324b21 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:30.054417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-75cd86a1-c809-492b-820a-2c7b09324b21 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:30.054864 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-75cd86a1-c809-492b-820a-2c7b09324b21 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:30.055661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-75cd86a1-c809-492b-820a-2c7b09324b21 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:30.056106 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-75cd86a1-c809-492b-820a-2c7b09324b21 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:30.180749 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-75cd86a1-c809-492b-820a-2c7b09324b21 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:30.188574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-75cd86a1-c809-492b-820a-2c7b09324b21 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.144664 May 10 21:35:30.189070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2129/2905] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:30 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:30.193866 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1186c1d8-d487-43f1-877d-50d8f41abbc0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:30.194472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1186c1d8-d487-43f1-877d-50d8f41abbc0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:30.200029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1186c1d8-d487-43f1-877d-50d8f41abbc0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:30.200500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1186c1d8-d487-43f1-877d-50d8f41abbc0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:30.201245 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1186c1d8-d487-43f1-877d-50d8f41abbc0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:30.201691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1186c1d8-d487-43f1-877d-50d8f41abbc0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:30.327561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1186c1d8-d487-43f1-877d-50d8f41abbc0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:30.337328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1186c1d8-d487-43f1-877d-50d8f41abbc0 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.147327 May 10 21:35:30.337896 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2130/2906] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:30 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:30.635189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dfdba8e9-2c61-40cd-988d-00171f311f9e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:30.636103 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dfdba8e9-2c61-40cd-988d-00171f311f9e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:30.642430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dfdba8e9-2c61-40cd-988d-00171f311f9e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:30.642880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dfdba8e9-2c61-40cd-988d-00171f311f9e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:30.643679 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dfdba8e9-2c61-40cd-988d-00171f311f9e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:30.644113 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dfdba8e9-2c61-40cd-988d-00171f311f9e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:30.773202 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dfdba8e9-2c61-40cd-988d-00171f311f9e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:30.781015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dfdba8e9-2c61-40cd-988d-00171f311f9e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150302 May 10 21:35:30.781583 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2131/2907] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:30 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:31.205582 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d954a0e9-07f6-4deb-9067-e66aed391548 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:31.206114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d954a0e9-07f6-4deb-9067-e66aed391548 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:31.212669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d954a0e9-07f6-4deb-9067-e66aed391548 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:31.213121 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d954a0e9-07f6-4deb-9067-e66aed391548 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:31.213880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d954a0e9-07f6-4deb-9067-e66aed391548 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:31.214319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d954a0e9-07f6-4deb-9067-e66aed391548 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:31.347540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d954a0e9-07f6-4deb-9067-e66aed391548 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:31.356287 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d954a0e9-07f6-4deb-9067-e66aed391548 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.154734 May 10 21:35:31.356859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2132/2908] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:31 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:31.362198 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-609f5cba-5ae7-4a2a-a791-03416da76205 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:31.362811 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-609f5cba-5ae7-4a2a-a791-03416da76205 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:31.369598 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-609f5cba-5ae7-4a2a-a791-03416da76205 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:31.370048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-609f5cba-5ae7-4a2a-a791-03416da76205 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:31.370828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-609f5cba-5ae7-4a2a-a791-03416da76205 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:31.371310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-609f5cba-5ae7-4a2a-a791-03416da76205 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:31.518905 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-609f5cba-5ae7-4a2a-a791-03416da76205 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:31.527581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-609f5cba-5ae7-4a2a-a791-03416da76205 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.169739 May 10 21:35:31.528148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2133/2909] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:31 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:31.798633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b029281a-d8a5-40da-9e0f-645f410711cf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:31.799331 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b029281a-d8a5-40da-9e0f-645f410711cf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:31.805961 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b029281a-d8a5-40da-9e0f-645f410711cf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:31.806413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b029281a-d8a5-40da-9e0f-645f410711cf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:31.807251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b029281a-d8a5-40da-9e0f-645f410711cf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:31.807773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b029281a-d8a5-40da-9e0f-645f410711cf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:31.940432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b029281a-d8a5-40da-9e0f-645f410711cf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:31.949372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b029281a-d8a5-40da-9e0f-645f410711cf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.154703 May 10 21:35:31.949940 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2134/2910] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:31 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:32.374437 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-aa8ac5c2-48a0-4e91-8e36-be588173194d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:32.375058 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-aa8ac5c2-48a0-4e91-8e36-be588173194d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:32.382420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aa8ac5c2-48a0-4e91-8e36-be588173194d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:32.382885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aa8ac5c2-48a0-4e91-8e36-be588173194d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:32.383720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aa8ac5c2-48a0-4e91-8e36-be588173194d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:32.384163 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aa8ac5c2-48a0-4e91-8e36-be588173194d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:32.513781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-aa8ac5c2-48a0-4e91-8e36-be588173194d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:32.521433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-aa8ac5c2-48a0-4e91-8e36-be588173194d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150863 May 10 21:35:32.521985 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2135/2911] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:32 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:32.545085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-895ad307-4e2d-49f5-8678-40b90026ec37 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:32.545669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-895ad307-4e2d-49f5-8678-40b90026ec37 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:32.551309 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-895ad307-4e2d-49f5-8678-40b90026ec37 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:32.551761 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-895ad307-4e2d-49f5-8678-40b90026ec37 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:32.552518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-895ad307-4e2d-49f5-8678-40b90026ec37 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:32.553504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-895ad307-4e2d-49f5-8678-40b90026ec37 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:32.681713 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-895ad307-4e2d-49f5-8678-40b90026ec37 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:32.689431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-895ad307-4e2d-49f5-8678-40b90026ec37 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.147805 May 10 21:35:32.689993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2136/2912] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:32 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:32.966449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c1ddedb4-a210-4557-af77-cd2932667419 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:32.967065 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c1ddedb4-a210-4557-af77-cd2932667419 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:32.973417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c1ddedb4-a210-4557-af77-cd2932667419 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:32.973874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c1ddedb4-a210-4557-af77-cd2932667419 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:32.974633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c1ddedb4-a210-4557-af77-cd2932667419 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:32.976285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c1ddedb4-a210-4557-af77-cd2932667419 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:33.102682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c1ddedb4-a210-4557-af77-cd2932667419 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:33.110494 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c1ddedb4-a210-4557-af77-cd2932667419 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147977 May 10 21:35:33.111055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2137/2913] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:32 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:33.539331 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e15ea120-106a-488c-9248-0e50a908ac90 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:33.539939 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e15ea120-106a-488c-9248-0e50a908ac90 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:33.545840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e15ea120-106a-488c-9248-0e50a908ac90 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:33.546291 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e15ea120-106a-488c-9248-0e50a908ac90 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:33.547052 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e15ea120-106a-488c-9248-0e50a908ac90 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:33.547518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e15ea120-106a-488c-9248-0e50a908ac90 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:33.678575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e15ea120-106a-488c-9248-0e50a908ac90 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:33.686255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e15ea120-106a-488c-9248-0e50a908ac90 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151592 May 10 21:35:33.686819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2138/2914] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:33 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:33.705207 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9597ad59-f2ba-48e2-87db-f8084cef921b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:33.705815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9597ad59-f2ba-48e2-87db-f8084cef921b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:33.712308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9597ad59-f2ba-48e2-87db-f8084cef921b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:33.712757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9597ad59-f2ba-48e2-87db-f8084cef921b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:33.713520 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9597ad59-f2ba-48e2-87db-f8084cef921b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:33.713959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9597ad59-f2ba-48e2-87db-f8084cef921b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:33.838933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9597ad59-f2ba-48e2-87db-f8084cef921b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:33.846691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9597ad59-f2ba-48e2-87db-f8084cef921b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.145043 May 10 21:35:33.847284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2139/2915] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:33 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:34.127925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-770a8be1-e5af-49a5-8e86-61ebfc9b8b2b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:34.128681 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-770a8be1-e5af-49a5-8e86-61ebfc9b8b2b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:34.135369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-770a8be1-e5af-49a5-8e86-61ebfc9b8b2b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:34.135828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-770a8be1-e5af-49a5-8e86-61ebfc9b8b2b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:34.136594 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-770a8be1-e5af-49a5-8e86-61ebfc9b8b2b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:34.137031 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-770a8be1-e5af-49a5-8e86-61ebfc9b8b2b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:34.267500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-770a8be1-e5af-49a5-8e86-61ebfc9b8b2b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:34.275959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-770a8be1-e5af-49a5-8e86-61ebfc9b8b2b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151861 May 10 21:35:34.276520 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2140/2916] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:34 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:34.703300 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a0ee9f59-ee58-4e67-af95-e6abe5787b41 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:34.703914 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a0ee9f59-ee58-4e67-af95-e6abe5787b41 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:34.710587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0ee9f59-ee58-4e67-af95-e6abe5787b41 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:34.711033 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0ee9f59-ee58-4e67-af95-e6abe5787b41 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:34.712077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0ee9f59-ee58-4e67-af95-e6abe5787b41 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:34.712515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a0ee9f59-ee58-4e67-af95-e6abe5787b41 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:34.917630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a0ee9f59-ee58-4e67-af95-e6abe5787b41 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:34.925524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a0ee9f59-ee58-4e67-af95-e6abe5787b41 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.226062 May 10 21:35:34.926273 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2141/2917] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:34 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:34.930611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bfff9615-93f1-465f-9632-2d9450679c30 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:34.931249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bfff9615-93f1-465f-9632-2d9450679c30 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:34.937200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfff9615-93f1-465f-9632-2d9450679c30 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:34.937648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfff9615-93f1-465f-9632-2d9450679c30 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:34.938408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfff9615-93f1-465f-9632-2d9450679c30 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:34.938842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfff9615-93f1-465f-9632-2d9450679c30 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:35.069302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bfff9615-93f1-465f-9632-2d9450679c30 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:35.077197 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bfff9615-93f1-465f-9632-2d9450679c30 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150159 May 10 21:35:35.077759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2142/2918] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:34 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:35.292915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-07e9e13a-2380-4631-b6c6-5ca98988b127 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:35.293543 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-07e9e13a-2380-4631-b6c6-5ca98988b127 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:35.299789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07e9e13a-2380-4631-b6c6-5ca98988b127 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:35.300249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07e9e13a-2380-4631-b6c6-5ca98988b127 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:35.301026 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07e9e13a-2380-4631-b6c6-5ca98988b127 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:35.301471 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07e9e13a-2380-4631-b6c6-5ca98988b127 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:35.432410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-07e9e13a-2380-4631-b6c6-5ca98988b127 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:35.440281 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-07e9e13a-2380-4631-b6c6-5ca98988b127 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151263 May 10 21:35:35.440842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2143/2919] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:35 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:35.941839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-07ce211e-b93c-4217-8914-26f9889e03f4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:35.942369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-07ce211e-b93c-4217-8914-26f9889e03f4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:35.949006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07ce211e-b93c-4217-8914-26f9889e03f4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:35.949456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07ce211e-b93c-4217-8914-26f9889e03f4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:35.950213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07ce211e-b93c-4217-8914-26f9889e03f4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:35.950648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07ce211e-b93c-4217-8914-26f9889e03f4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:36.076924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-07ce211e-b93c-4217-8914-26f9889e03f4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:36.084790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-07ce211e-b93c-4217-8914-26f9889e03f4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.146828 May 10 21:35:36.085350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2144/2920] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:35 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:36.094617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2c7502bf-9166-4b98-bba1-07d1f09ba2ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:36.095247 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2c7502bf-9166-4b98-bba1-07d1f09ba2ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:36.101015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c7502bf-9166-4b98-bba1-07d1f09ba2ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:36.101465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c7502bf-9166-4b98-bba1-07d1f09ba2ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:36.102222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c7502bf-9166-4b98-bba1-07d1f09ba2ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:36.102656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c7502bf-9166-4b98-bba1-07d1f09ba2ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:36.233012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2c7502bf-9166-4b98-bba1-07d1f09ba2ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:36.241549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2c7502bf-9166-4b98-bba1-07d1f09ba2ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150324 May 10 21:35:36.242105 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2145/2921] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:36 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:36.457390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-95d3cc3c-b3cb-4d0a-b1eb-fc6816bc938d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:36.458065 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-95d3cc3c-b3cb-4d0a-b1eb-fc6816bc938d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:36.464964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-95d3cc3c-b3cb-4d0a-b1eb-fc6816bc938d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:36.465413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-95d3cc3c-b3cb-4d0a-b1eb-fc6816bc938d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:36.466183 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-95d3cc3c-b3cb-4d0a-b1eb-fc6816bc938d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:36.466625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-95d3cc3c-b3cb-4d0a-b1eb-fc6816bc938d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:36.594185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-95d3cc3c-b3cb-4d0a-b1eb-fc6816bc938d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:36.602588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-95d3cc3c-b3cb-4d0a-b1eb-fc6816bc938d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149078 May 10 21:35:36.603434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2146/2922] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:36 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:37.102468 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-642af115-e374-43b3-b4e3-441ccb0cd6a8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:37.103077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-642af115-e374-43b3-b4e3-441ccb0cd6a8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:37.109189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-642af115-e374-43b3-b4e3-441ccb0cd6a8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:37.109652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-642af115-e374-43b3-b4e3-441ccb0cd6a8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:37.110429 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-642af115-e374-43b3-b4e3-441ccb0cd6a8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:37.110873 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-642af115-e374-43b3-b4e3-441ccb0cd6a8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:37.242410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-642af115-e374-43b3-b4e3-441ccb0cd6a8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:37.250181 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-642af115-e374-43b3-b4e3-441ccb0cd6a8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.152329 May 10 21:35:37.250742 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2147/2923] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:37 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:37.257844 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d52fa21c-3c49-43f2-b3b7-74ff50a57edd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:37.258442 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d52fa21c-3c49-43f2-b3b7-74ff50a57edd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:37.264020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d52fa21c-3c49-43f2-b3b7-74ff50a57edd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:37.264475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d52fa21c-3c49-43f2-b3b7-74ff50a57edd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:37.265238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d52fa21c-3c49-43f2-b3b7-74ff50a57edd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:37.265676 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d52fa21c-3c49-43f2-b3b7-74ff50a57edd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:37.392908 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d52fa21c-3c49-43f2-b3b7-74ff50a57edd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:37.400657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d52fa21c-3c49-43f2-b3b7-74ff50a57edd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.146838 May 10 21:35:37.401221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2148/2924] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:37 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:37.618657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-089e6cb0-c0f1-449c-babf-d0337b079b51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:37.619315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-089e6cb0-c0f1-449c-babf-d0337b079b51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:37.625650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-089e6cb0-c0f1-449c-babf-d0337b079b51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:37.626109 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-089e6cb0-c0f1-449c-babf-d0337b079b51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:37.626881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-089e6cb0-c0f1-449c-babf-d0337b079b51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:37.627371 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-089e6cb0-c0f1-449c-babf-d0337b079b51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:37.753243 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-089e6cb0-c0f1-449c-babf-d0337b079b51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:37.761315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-089e6cb0-c0f1-449c-babf-d0337b079b51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.146622 May 10 21:35:37.761874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2149/2925] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:37 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:38.268287 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-60028a86-d8ae-426d-bb3a-2684bb487142 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:38.268890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-60028a86-d8ae-426d-bb3a-2684bb487142 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:38.275278 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-60028a86-d8ae-426d-bb3a-2684bb487142 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:38.275726 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-60028a86-d8ae-426d-bb3a-2684bb487142 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:38.276485 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-60028a86-d8ae-426d-bb3a-2684bb487142 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:38.276923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-60028a86-d8ae-426d-bb3a-2684bb487142 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:38.406686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-60028a86-d8ae-426d-bb3a-2684bb487142 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:38.414528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-60028a86-d8ae-426d-bb3a-2684bb487142 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150133 May 10 21:35:38.415093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2150/2926] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:38 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:38.422438 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3b1fca83-ef21-431b-93ae-6ac4560cb33d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:38.423037 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3b1fca83-ef21-431b-93ae-6ac4560cb33d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:38.429193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3b1fca83-ef21-431b-93ae-6ac4560cb33d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:38.429631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3b1fca83-ef21-431b-93ae-6ac4560cb33d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:38.430386 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3b1fca83-ef21-431b-93ae-6ac4560cb33d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:38.430824 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3b1fca83-ef21-431b-93ae-6ac4560cb33d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:38.556563 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3b1fca83-ef21-431b-93ae-6ac4560cb33d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:38.564397 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3b1fca83-ef21-431b-93ae-6ac4560cb33d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.145514 May 10 21:35:38.564970 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2151/2927] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:38 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:38.777977 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-710e754d-c026-4d66-b0cf-e8ca9e7e9894 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:38.778605 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-710e754d-c026-4d66-b0cf-e8ca9e7e9894 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:38.784990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-710e754d-c026-4d66-b0cf-e8ca9e7e9894 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:38.785444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-710e754d-c026-4d66-b0cf-e8ca9e7e9894 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:38.786210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-710e754d-c026-4d66-b0cf-e8ca9e7e9894 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:38.786663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-710e754d-c026-4d66-b0cf-e8ca9e7e9894 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:38.938531 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-710e754d-c026-4d66-b0cf-e8ca9e7e9894 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:38.949649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-710e754d-c026-4d66-b0cf-e8ca9e7e9894 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.175443 May 10 21:35:38.960921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2152/2928] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:38 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:39.432044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-14414f9f-18c9-4d49-8934-d32a1c450228 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:39.432666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-14414f9f-18c9-4d49-8934-d32a1c450228 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:39.438510 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-14414f9f-18c9-4d49-8934-d32a1c450228 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:39.438965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-14414f9f-18c9-4d49-8934-d32a1c450228 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:39.439771 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-14414f9f-18c9-4d49-8934-d32a1c450228 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:39.440214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-14414f9f-18c9-4d49-8934-d32a1c450228 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:39.568369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-14414f9f-18c9-4d49-8934-d32a1c450228 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:39.576339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-14414f9f-18c9-4d49-8934-d32a1c450228 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148715 May 10 21:35:39.576893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2153/2929] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:39 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:39.581264 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7dda0fdc-5b46-4730-a728-2fcd9dcf2d58 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:39.581875 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7dda0fdc-5b46-4730-a728-2fcd9dcf2d58 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:39.588240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7dda0fdc-5b46-4730-a728-2fcd9dcf2d58 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:39.588691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7dda0fdc-5b46-4730-a728-2fcd9dcf2d58 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:39.589452 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7dda0fdc-5b46-4730-a728-2fcd9dcf2d58 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:39.589889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7dda0fdc-5b46-4730-a728-2fcd9dcf2d58 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:39.718916 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7dda0fdc-5b46-4730-a728-2fcd9dcf2d58 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:39.727351 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7dda0fdc-5b46-4730-a728-2fcd9dcf2d58 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149436 May 10 21:35:39.727903 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2154/2930] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:39 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:39.968320 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1b1e3e69-f0d4-49e0-a148-1a9d535197bc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:39.969021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1b1e3e69-f0d4-49e0-a148-1a9d535197bc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:39.975263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1b1e3e69-f0d4-49e0-a148-1a9d535197bc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:39.975720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1b1e3e69-f0d4-49e0-a148-1a9d535197bc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:39.976677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1b1e3e69-f0d4-49e0-a148-1a9d535197bc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:39.977122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1b1e3e69-f0d4-49e0-a148-1a9d535197bc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:40.111258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1b1e3e69-f0d4-49e0-a148-1a9d535197bc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:40.120215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1b1e3e69-f0d4-49e0-a148-1a9d535197bc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.155949 May 10 21:35:40.121875 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2155/2931] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:39 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:40.593721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-766da147-9230-43b3-a717-34bc6d76fcf0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:40.594357 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-766da147-9230-43b3-a717-34bc6d76fcf0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:40.600248 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-766da147-9230-43b3-a717-34bc6d76fcf0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:40.600723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-766da147-9230-43b3-a717-34bc6d76fcf0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:40.601506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-766da147-9230-43b3-a717-34bc6d76fcf0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:40.601936 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-766da147-9230-43b3-a717-34bc6d76fcf0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:40.730282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-766da147-9230-43b3-a717-34bc6d76fcf0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:40.738109 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-766da147-9230-43b3-a717-34bc6d76fcf0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148272 May 10 21:35:40.738677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2156/2932] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:40 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:40.744882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-11dea289-6e26-4d8b-ba9b-49d325c93afc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:40.745485 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-11dea289-6e26-4d8b-ba9b-49d325c93afc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:40.751322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-11dea289-6e26-4d8b-ba9b-49d325c93afc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:40.751780 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-11dea289-6e26-4d8b-ba9b-49d325c93afc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:40.752549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-11dea289-6e26-4d8b-ba9b-49d325c93afc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:40.752992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-11dea289-6e26-4d8b-ba9b-49d325c93afc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:40.884033 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-11dea289-6e26-4d8b-ba9b-49d325c93afc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:40.891752 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-11dea289-6e26-4d8b-ba9b-49d325c93afc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.151114 May 10 21:35:40.892331 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2157/2933] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:40 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:41.137282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3654badb-0809-49f1-a258-46c034d57cfb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:41.137917 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3654badb-0809-49f1-a258-46c034d57cfb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:41.144106 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3654badb-0809-49f1-a258-46c034d57cfb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:41.144562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3654badb-0809-49f1-a258-46c034d57cfb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:41.145328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3654badb-0809-49f1-a258-46c034d57cfb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:41.145802 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3654badb-0809-49f1-a258-46c034d57cfb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:41.274130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3654badb-0809-49f1-a258-46c034d57cfb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:41.281895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3654badb-0809-49f1-a258-46c034d57cfb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148618 May 10 21:35:41.282453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2158/2934] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:41 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:41.755889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9c43ad15-71ab-454d-8279-c1e3c87701d7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:41.756502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9c43ad15-71ab-454d-8279-c1e3c87701d7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:41.763093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c43ad15-71ab-454d-8279-c1e3c87701d7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:41.763578 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c43ad15-71ab-454d-8279-c1e3c87701d7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:41.764355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c43ad15-71ab-454d-8279-c1e3c87701d7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:41.764796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c43ad15-71ab-454d-8279-c1e3c87701d7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:41.896583 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9c43ad15-71ab-454d-8279-c1e3c87701d7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:41.905080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9c43ad15-71ab-454d-8279-c1e3c87701d7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.153032 May 10 21:35:41.905652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2159/2935] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:41 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:41.910046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0863df7f-c314-4f3c-bd4b-4b51b7919e3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:41.910683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0863df7f-c314-4f3c-bd4b-4b51b7919e3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:41.917031 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0863df7f-c314-4f3c-bd4b-4b51b7919e3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:41.917482 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0863df7f-c314-4f3c-bd4b-4b51b7919e3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:41.918243 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0863df7f-c314-4f3c-bd4b-4b51b7919e3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:41.918678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0863df7f-c314-4f3c-bd4b-4b51b7919e3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:42.047486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0863df7f-c314-4f3c-bd4b-4b51b7919e3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:42.055378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0863df7f-c314-4f3c-bd4b-4b51b7919e3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148762 May 10 21:35:42.055937 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2160/2936] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:41 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:42.299552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1bdff30c-a1a2-41c9-b597-d92a980705d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:42.300207 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1bdff30c-a1a2-41c9-b597-d92a980705d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:42.306445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1bdff30c-a1a2-41c9-b597-d92a980705d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:42.306905 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1bdff30c-a1a2-41c9-b597-d92a980705d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:42.307700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1bdff30c-a1a2-41c9-b597-d92a980705d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:42.308147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1bdff30c-a1a2-41c9-b597-d92a980705d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:42.436456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1bdff30c-a1a2-41c9-b597-d92a980705d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:42.444230 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1bdff30c-a1a2-41c9-b597-d92a980705d6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148687 May 10 21:35:42.445401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2161/2937] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:42 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:42.923025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0b3bd482-3821-4977-b01e-0cebf7f92f35 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:42.923593 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0b3bd482-3821-4977-b01e-0cebf7f92f35 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:42.929945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0b3bd482-3821-4977-b01e-0cebf7f92f35 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:42.930394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0b3bd482-3821-4977-b01e-0cebf7f92f35 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:42.931171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0b3bd482-3821-4977-b01e-0cebf7f92f35 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:42.931613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0b3bd482-3821-4977-b01e-0cebf7f92f35 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:43.062907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0b3bd482-3821-4977-b01e-0cebf7f92f35 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:43.071047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0b3bd482-3821-4977-b01e-0cebf7f92f35 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151841 May 10 21:35:43.071648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2162/2938] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:42 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:43.076023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c10b869f-c527-42b8-b7ab-cf729951cae9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:43.076635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c10b869f-c527-42b8-b7ab-cf729951cae9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:43.082204 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c10b869f-c527-42b8-b7ab-cf729951cae9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:43.082660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c10b869f-c527-42b8-b7ab-cf729951cae9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:43.083458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c10b869f-c527-42b8-b7ab-cf729951cae9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:43.083902 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c10b869f-c527-42b8-b7ab-cf729951cae9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:43.211065 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c10b869f-c527-42b8-b7ab-cf729951cae9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:43.219085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c10b869f-c527-42b8-b7ab-cf729951cae9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.146506 May 10 21:35:43.219679 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2163/2939] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:43 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:43.461777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-59217d1b-19fe-433d-92a3-8a5adb9084f9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:43.462421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-59217d1b-19fe-433d-92a3-8a5adb9084f9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:43.468558 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-59217d1b-19fe-433d-92a3-8a5adb9084f9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:43.469038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-59217d1b-19fe-433d-92a3-8a5adb9084f9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:43.469797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-59217d1b-19fe-433d-92a3-8a5adb9084f9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:43.470233 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-59217d1b-19fe-433d-92a3-8a5adb9084f9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:43.601764 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-59217d1b-19fe-433d-92a3-8a5adb9084f9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:43.609752 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-59217d1b-19fe-433d-92a3-8a5adb9084f9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.152075 May 10 21:35:43.610316 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2164/2940] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:43 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:44.088402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-20012f80-b74a-4977-bf7d-a43853ad98dc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:44.089023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-20012f80-b74a-4977-bf7d-a43853ad98dc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:44.095150 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20012f80-b74a-4977-bf7d-a43853ad98dc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:44.095628 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20012f80-b74a-4977-bf7d-a43853ad98dc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:44.096417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20012f80-b74a-4977-bf7d-a43853ad98dc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:44.096864 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20012f80-b74a-4977-bf7d-a43853ad98dc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:44.224271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-20012f80-b74a-4977-bf7d-a43853ad98dc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:44.232964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-20012f80-b74a-4977-bf7d-a43853ad98dc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148739 May 10 21:35:44.233541 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2165/2941] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:44 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:44.237957 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1a9da4b9-0de9-44a6-8290-66ef2725ecda tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:44.238563 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1a9da4b9-0de9-44a6-8290-66ef2725ecda tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:44.244372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1a9da4b9-0de9-44a6-8290-66ef2725ecda tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:44.244835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1a9da4b9-0de9-44a6-8290-66ef2725ecda tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:44.245645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1a9da4b9-0de9-44a6-8290-66ef2725ecda tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:44.246085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1a9da4b9-0de9-44a6-8290-66ef2725ecda tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:44.371165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1a9da4b9-0de9-44a6-8290-66ef2725ecda tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:44.378808 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1a9da4b9-0de9-44a6-8290-66ef2725ecda tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.144344 May 10 21:35:44.379400 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2166/2942] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:44 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:44.627828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bb53030f-319a-4168-84bf-34a0367cde52 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:44.628387 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bb53030f-319a-4168-84bf-34a0367cde52 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:44.635192 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bb53030f-319a-4168-84bf-34a0367cde52 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:44.635651 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bb53030f-319a-4168-84bf-34a0367cde52 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:44.636424 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bb53030f-319a-4168-84bf-34a0367cde52 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:44.636865 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bb53030f-319a-4168-84bf-34a0367cde52 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:44.767077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bb53030f-319a-4168-84bf-34a0367cde52 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:44.775596 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bb53030f-319a-4168-84bf-34a0367cde52 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151635 May 10 21:35:44.776168 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2167/2943] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:44 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:45.249985 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7a64dce9-c814-4d38-a660-5bdfed11f532 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:45.250524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7a64dce9-c814-4d38-a660-5bdfed11f532 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:45.256936 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7a64dce9-c814-4d38-a660-5bdfed11f532 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:45.257400 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7a64dce9-c814-4d38-a660-5bdfed11f532 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:45.258188 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7a64dce9-c814-4d38-a660-5bdfed11f532 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:45.259812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7a64dce9-c814-4d38-a660-5bdfed11f532 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:45.386477 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7a64dce9-c814-4d38-a660-5bdfed11f532 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:45.394474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7a64dce9-c814-4d38-a660-5bdfed11f532 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148368 May 10 21:35:45.395045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2168/2944] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:45 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:45.399689 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-eb81f1e3-dcd4-43ac-964c-6367fb0c5314 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:45.400224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-eb81f1e3-dcd4-43ac-964c-6367fb0c5314 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:45.405683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eb81f1e3-dcd4-43ac-964c-6367fb0c5314 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:45.406133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eb81f1e3-dcd4-43ac-964c-6367fb0c5314 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:45.406902 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eb81f1e3-dcd4-43ac-964c-6367fb0c5314 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:45.407419 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eb81f1e3-dcd4-43ac-964c-6367fb0c5314 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:45.547899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-eb81f1e3-dcd4-43ac-964c-6367fb0c5314 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:45.556758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-eb81f1e3-dcd4-43ac-964c-6367fb0c5314 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.159708 May 10 21:35:45.557516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2169/2945] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:45 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:45.793020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-522630f3-6932-4a02-85e8-c20f86b1e3d9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:45.793701 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-522630f3-6932-4a02-85e8-c20f86b1e3d9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:45.799580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-522630f3-6932-4a02-85e8-c20f86b1e3d9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:45.799965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-522630f3-6932-4a02-85e8-c20f86b1e3d9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:45.800720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-522630f3-6932-4a02-85e8-c20f86b1e3d9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:45.801152 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-522630f3-6932-4a02-85e8-c20f86b1e3d9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:45.927528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-522630f3-6932-4a02-85e8-c20f86b1e3d9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:45.935467 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-522630f3-6932-4a02-85e8-c20f86b1e3d9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147138 May 10 21:35:45.936027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2170/2946] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:45 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:46.411069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-60c3031e-8121-417e-9151-b4035c13f32e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:46.411705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-60c3031e-8121-417e-9151-b4035c13f32e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:46.418096 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-60c3031e-8121-417e-9151-b4035c13f32e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:46.418542 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-60c3031e-8121-417e-9151-b4035c13f32e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:46.419333 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-60c3031e-8121-417e-9151-b4035c13f32e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:46.419768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-60c3031e-8121-417e-9151-b4035c13f32e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:46.551773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-60c3031e-8121-417e-9151-b4035c13f32e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:46.560256 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-60c3031e-8121-417e-9151-b4035c13f32e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.153055 May 10 21:35:46.560811 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2171/2947] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:46 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:46.573915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2ffbf411-c990-4691-baad-1560fc3372a3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:46.574516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2ffbf411-c990-4691-baad-1560fc3372a3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:46.580236 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ffbf411-c990-4691-baad-1560fc3372a3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:46.580672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ffbf411-c990-4691-baad-1560fc3372a3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:46.581457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ffbf411-c990-4691-baad-1560fc3372a3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:46.581890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ffbf411-c990-4691-baad-1560fc3372a3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:46.708467 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2ffbf411-c990-4691-baad-1560fc3372a3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:46.716689 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2ffbf411-c990-4691-baad-1560fc3372a3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.146968 May 10 21:35:46.717250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2172/2948] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:46 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:46.952381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6be86c03-2cdb-46df-9f42-90e116215f12 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:46.952989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6be86c03-2cdb-46df-9f42-90e116215f12 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:46.958807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6be86c03-2cdb-46df-9f42-90e116215f12 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:46.959293 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6be86c03-2cdb-46df-9f42-90e116215f12 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:46.960053 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6be86c03-2cdb-46df-9f42-90e116215f12 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:46.960488 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6be86c03-2cdb-46df-9f42-90e116215f12 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:47.097289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6be86c03-2cdb-46df-9f42-90e116215f12 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:47.105067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6be86c03-2cdb-46df-9f42-90e116215f12 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.156778 May 10 21:35:47.105710 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2173/2949] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:46 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:47.576805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-49f20c89-fbcc-45f0-aa45-0374b8751624 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:47.577421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-49f20c89-fbcc-45f0-aa45-0374b8751624 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:47.583863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-49f20c89-fbcc-45f0-aa45-0374b8751624 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:47.584318 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-49f20c89-fbcc-45f0-aa45-0374b8751624 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:47.585081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-49f20c89-fbcc-45f0-aa45-0374b8751624 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:47.585517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-49f20c89-fbcc-45f0-aa45-0374b8751624 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:47.720425 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-49f20c89-fbcc-45f0-aa45-0374b8751624 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:47.730194 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-49f20c89-fbcc-45f0-aa45-0374b8751624 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.157267 May 10 21:35:47.730758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2174/2950] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:47 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:47.735111 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2910527b-af24-4275-87ac-1556f335b490 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:47.735734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2910527b-af24-4275-87ac-1556f335b490 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:47.741221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2910527b-af24-4275-87ac-1556f335b490 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:47.741665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2910527b-af24-4275-87ac-1556f335b490 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:47.742424 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2910527b-af24-4275-87ac-1556f335b490 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:47.742950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2910527b-af24-4275-87ac-1556f335b490 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:47.870067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2910527b-af24-4275-87ac-1556f335b490 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:47.877851 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2910527b-af24-4275-87ac-1556f335b490 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.146136 May 10 21:35:47.878421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2175/2951] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:47 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:48.122186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8fcafc76-f587-4687-81ca-cd633e96c03c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:48.122829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8fcafc76-f587-4687-81ca-cd633e96c03c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:48.128644 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8fcafc76-f587-4687-81ca-cd633e96c03c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:48.129092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8fcafc76-f587-4687-81ca-cd633e96c03c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:48.129848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8fcafc76-f587-4687-81ca-cd633e96c03c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:48.130284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8fcafc76-f587-4687-81ca-cd633e96c03c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:48.259904 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8fcafc76-f587-4687-81ca-cd633e96c03c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:48.267626 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8fcafc76-f587-4687-81ca-cd633e96c03c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149357 May 10 21:35:48.268189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2176/2952] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:48 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:48.747979 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f2e7b4a2-f083-4e35-b289-7bd9b9be9ff7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:48.748623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f2e7b4a2-f083-4e35-b289-7bd9b9be9ff7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:48.755084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2e7b4a2-f083-4e35-b289-7bd9b9be9ff7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:48.755575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2e7b4a2-f083-4e35-b289-7bd9b9be9ff7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:48.756346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2e7b4a2-f083-4e35-b289-7bd9b9be9ff7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:48.756790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2e7b4a2-f083-4e35-b289-7bd9b9be9ff7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:48.886561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f2e7b4a2-f083-4e35-b289-7bd9b9be9ff7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:48.894731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f2e7b4a2-f083-4e35-b289-7bd9b9be9ff7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150562 May 10 21:35:48.895343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2177/2953] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:48 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:48.899874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1efe4921-326f-4f1a-b1f7-9d2d393c6395 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:48.900466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1efe4921-326f-4f1a-b1f7-9d2d393c6395 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:48.905907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1efe4921-326f-4f1a-b1f7-9d2d393c6395 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:48.906352 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1efe4921-326f-4f1a-b1f7-9d2d393c6395 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:48.907110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1efe4921-326f-4f1a-b1f7-9d2d393c6395 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:48.907568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1efe4921-326f-4f1a-b1f7-9d2d393c6395 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:49.033047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1efe4921-326f-4f1a-b1f7-9d2d393c6395 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:49.041646 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1efe4921-326f-4f1a-b1f7-9d2d393c6395 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.145310 May 10 21:35:49.042203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2178/2954] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:48 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:49.284710 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6b2e647f-c752-4e9f-b301-c6af8fb6ad5c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:49.285347 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6b2e647f-c752-4e9f-b301-c6af8fb6ad5c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:49.291387 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6b2e647f-c752-4e9f-b301-c6af8fb6ad5c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:49.291837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6b2e647f-c752-4e9f-b301-c6af8fb6ad5c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:49.292592 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6b2e647f-c752-4e9f-b301-c6af8fb6ad5c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:49.293029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6b2e647f-c752-4e9f-b301-c6af8fb6ad5c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:49.423896 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6b2e647f-c752-4e9f-b301-c6af8fb6ad5c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:49.432588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6b2e647f-c752-4e9f-b301-c6af8fb6ad5c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151784 May 10 21:35:49.433155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2179/2955] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:49 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:49.912124 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1c893fe5-4325-4395-827e-0f02d88ea430 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:49.920830 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1c893fe5-4325-4395-827e-0f02d88ea430 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:49.920830 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1c893fe5-4325-4395-827e-0f02d88ea430 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:49.920830 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1c893fe5-4325-4395-827e-0f02d88ea430 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:49.920830 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1c893fe5-4325-4395-827e-0f02d88ea430 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:49.921253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1c893fe5-4325-4395-827e-0f02d88ea430 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:50.048986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1c893fe5-4325-4395-827e-0f02d88ea430 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:50.057043 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1c893fe5-4325-4395-827e-0f02d88ea430 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148788 May 10 21:35:50.057614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2180/2956] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:49 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:50.062117 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f1fbc02a-0a2c-40df-95e9-0f9091d9f97c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:50.062885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f1fbc02a-0a2c-40df-95e9-0f9091d9f97c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:50.068634 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f1fbc02a-0a2c-40df-95e9-0f9091d9f97c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:50.069093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f1fbc02a-0a2c-40df-95e9-0f9091d9f97c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:50.069868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f1fbc02a-0a2c-40df-95e9-0f9091d9f97c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:50.070315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f1fbc02a-0a2c-40df-95e9-0f9091d9f97c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:50.203873 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f1fbc02a-0a2c-40df-95e9-0f9091d9f97c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:50.212349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f1fbc02a-0a2c-40df-95e9-0f9091d9f97c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.153009 May 10 21:35:50.213168 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2181/2957] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:50 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:50.449681 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f2c27656-08be-4787-90e4-57eab6f753c6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:50.450350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f2c27656-08be-4787-90e4-57eab6f753c6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:50.456370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2c27656-08be-4787-90e4-57eab6f753c6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:50.456760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2c27656-08be-4787-90e4-57eab6f753c6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:50.457595 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2c27656-08be-4787-90e4-57eab6f753c6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:50.457975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2c27656-08be-4787-90e4-57eab6f753c6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:50.589636 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f2c27656-08be-4787-90e4-57eab6f753c6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:50.597504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f2c27656-08be-4787-90e4-57eab6f753c6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.152133 May 10 21:35:50.598294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2182/2958] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:50 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:51.074292 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8750d569-6181-4662-afc4-b54289ff65bd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:51.074903 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8750d569-6181-4662-afc4-b54289ff65bd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:51.081262 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8750d569-6181-4662-afc4-b54289ff65bd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:51.081706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8750d569-6181-4662-afc4-b54289ff65bd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:51.082464 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8750d569-6181-4662-afc4-b54289ff65bd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:51.082899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8750d569-6181-4662-afc4-b54289ff65bd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:51.216782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8750d569-6181-4662-afc4-b54289ff65bd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:51.224901 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8750d569-6181-4662-afc4-b54289ff65bd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.154998 May 10 21:35:51.225474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2183/2959] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:51 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:51.229954 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-98726dfa-abd7-41b4-ac1f-8a3de1f63243 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:51.230594 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-98726dfa-abd7-41b4-ac1f-8a3de1f63243 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:51.236288 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-98726dfa-abd7-41b4-ac1f-8a3de1f63243 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:51.236747 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-98726dfa-abd7-41b4-ac1f-8a3de1f63243 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:51.237519 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-98726dfa-abd7-41b4-ac1f-8a3de1f63243 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:51.237964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-98726dfa-abd7-41b4-ac1f-8a3de1f63243 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:51.366472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-98726dfa-abd7-41b4-ac1f-8a3de1f63243 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:51.374867 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-98726dfa-abd7-41b4-ac1f-8a3de1f63243 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148456 May 10 21:35:51.375465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2184/2960] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:51 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:51.615464 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ca0c4005-19e9-457e-83d8-2f3d4108c5e6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:51.616073 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ca0c4005-19e9-457e-83d8-2f3d4108c5e6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:51.624307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ca0c4005-19e9-457e-83d8-2f3d4108c5e6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:51.624753 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ca0c4005-19e9-457e-83d8-2f3d4108c5e6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:51.625510 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ca0c4005-19e9-457e-83d8-2f3d4108c5e6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:51.625945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ca0c4005-19e9-457e-83d8-2f3d4108c5e6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:51.750731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ca0c4005-19e9-457e-83d8-2f3d4108c5e6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:51.758551 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ca0c4005-19e9-457e-83d8-2f3d4108c5e6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.146864 May 10 21:35:51.759113 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2185/2961] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:51 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:52.242528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-74c45325-1902-4b19-917d-f75f4a6f3beb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:52.243492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-74c45325-1902-4b19-917d-f75f4a6f3beb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:52.249858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74c45325-1902-4b19-917d-f75f4a6f3beb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:52.250312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74c45325-1902-4b19-917d-f75f4a6f3beb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:52.251074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74c45325-1902-4b19-917d-f75f4a6f3beb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:52.251540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74c45325-1902-4b19-917d-f75f4a6f3beb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:52.382800 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-74c45325-1902-4b19-917d-f75f4a6f3beb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:52.391239 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-74c45325-1902-4b19-917d-f75f4a6f3beb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.152519 May 10 21:35:52.391808 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2186/2962] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:52 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:52.396161 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-84c27fca-280d-44bb-b7f6-7a2433bc3e96 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:52.396763 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-84c27fca-280d-44bb-b7f6-7a2433bc3e96 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:52.402729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-84c27fca-280d-44bb-b7f6-7a2433bc3e96 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:52.403215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-84c27fca-280d-44bb-b7f6-7a2433bc3e96 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:52.404009 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-84c27fca-280d-44bb-b7f6-7a2433bc3e96 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:52.404450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-84c27fca-280d-44bb-b7f6-7a2433bc3e96 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:52.541264 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-84c27fca-280d-44bb-b7f6-7a2433bc3e96 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:52.549011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-84c27fca-280d-44bb-b7f6-7a2433bc3e96 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.156276 May 10 21:35:52.549573 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2187/2963] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:52 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:52.775352 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4346cc21-f9e9-4442-affb-ccfb78d90061 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:52.775978 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4346cc21-f9e9-4442-affb-ccfb78d90061 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:52.782002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4346cc21-f9e9-4442-affb-ccfb78d90061 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:52.782447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4346cc21-f9e9-4442-affb-ccfb78d90061 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:52.783276 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4346cc21-f9e9-4442-affb-ccfb78d90061 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:52.783711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4346cc21-f9e9-4442-affb-ccfb78d90061 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:52.915136 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4346cc21-f9e9-4442-affb-ccfb78d90061 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:52.923251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4346cc21-f9e9-4442-affb-ccfb78d90061 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.152298 May 10 21:35:52.923815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2188/2964] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:52 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:53.408526 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fda62f29-fa73-483b-a20a-7cc9683c6e9f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:53.409136 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fda62f29-fa73-483b-a20a-7cc9683c6e9f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:53.416432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fda62f29-fa73-483b-a20a-7cc9683c6e9f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:53.416880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fda62f29-fa73-483b-a20a-7cc9683c6e9f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:53.417636 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fda62f29-fa73-483b-a20a-7cc9683c6e9f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:53.418067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fda62f29-fa73-483b-a20a-7cc9683c6e9f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:53.544434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fda62f29-fa73-483b-a20a-7cc9683c6e9f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:53.552319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fda62f29-fa73-483b-a20a-7cc9683c6e9f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.147681 May 10 21:35:53.552885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2189/2965] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:53 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:53.565625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f796e8a3-8b09-4572-bd28-64e4da4e904f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:53.566316 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f796e8a3-8b09-4572-bd28-64e4da4e904f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:53.573325 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f796e8a3-8b09-4572-bd28-64e4da4e904f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:53.573782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f796e8a3-8b09-4572-bd28-64e4da4e904f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:53.574556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f796e8a3-8b09-4572-bd28-64e4da4e904f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:53.575001 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f796e8a3-8b09-4572-bd28-64e4da4e904f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:53.701165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f796e8a3-8b09-4572-bd28-64e4da4e904f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:53.708918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f796e8a3-8b09-4572-bd28-64e4da4e904f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.146963 May 10 21:35:53.709500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2190/2966] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:53 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:53.940845 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cb3ad633-b858-413e-858b-5de09005f9d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:53.941519 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cb3ad633-b858-413e-858b-5de09005f9d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:53.947987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb3ad633-b858-413e-858b-5de09005f9d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:53.948435 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb3ad633-b858-413e-858b-5de09005f9d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:53.949264 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb3ad633-b858-413e-858b-5de09005f9d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:53.949627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb3ad633-b858-413e-858b-5de09005f9d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:54.079906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cb3ad633-b858-413e-858b-5de09005f9d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:54.088120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cb3ad633-b858-413e-858b-5de09005f9d4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151145 May 10 21:35:54.088680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2191/2967] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:53 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:54.569799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a85093e7-09e3-4182-a90e-dfac4032b80f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:54.570390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a85093e7-09e3-4182-a90e-dfac4032b80f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:54.577226 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a85093e7-09e3-4182-a90e-dfac4032b80f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:54.577865 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a85093e7-09e3-4182-a90e-dfac4032b80f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:54.578492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a85093e7-09e3-4182-a90e-dfac4032b80f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:54.578925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a85093e7-09e3-4182-a90e-dfac4032b80f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:54.710371 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a85093e7-09e3-4182-a90e-dfac4032b80f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:54.718387 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a85093e7-09e3-4182-a90e-dfac4032b80f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.152564 May 10 21:35:54.718949 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2192/2968] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:54 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:54.725570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5bdcbe5c-debf-4ca1-9514-8417c5e61646 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:54.726175 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5bdcbe5c-debf-4ca1-9514-8417c5e61646 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:54.732204 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5bdcbe5c-debf-4ca1-9514-8417c5e61646 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:54.732657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5bdcbe5c-debf-4ca1-9514-8417c5e61646 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:54.733417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5bdcbe5c-debf-4ca1-9514-8417c5e61646 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:54.733857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5bdcbe5c-debf-4ca1-9514-8417c5e61646 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:54.865064 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5bdcbe5c-debf-4ca1-9514-8417c5e61646 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:54.873773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5bdcbe5c-debf-4ca1-9514-8417c5e61646 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.151885 May 10 21:35:54.874343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2193/2969] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:54 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:55.105350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f286950b-14c7-4b4a-a3f3-16023bb270ce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:55.106030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f286950b-14c7-4b4a-a3f3-16023bb270ce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:55.111844 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f286950b-14c7-4b4a-a3f3-16023bb270ce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:55.112374 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f286950b-14c7-4b4a-a3f3-16023bb270ce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:55.113193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f286950b-14c7-4b4a-a3f3-16023bb270ce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:55.113583 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f286950b-14c7-4b4a-a3f3-16023bb270ce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:55.239467 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f286950b-14c7-4b4a-a3f3-16023bb270ce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:55.247833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f286950b-14c7-4b4a-a3f3-16023bb270ce tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147239 May 10 21:35:55.248395 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2194/2970] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:55 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:55.735311 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fb5225da-58ae-4f5f-9ae9-b527d39caeca tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:55.735952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fb5225da-58ae-4f5f-9ae9-b527d39caeca tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:55.742431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb5225da-58ae-4f5f-9ae9-b527d39caeca tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:55.742924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb5225da-58ae-4f5f-9ae9-b527d39caeca tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:55.743711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb5225da-58ae-4f5f-9ae9-b527d39caeca tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:55.744151 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb5225da-58ae-4f5f-9ae9-b527d39caeca tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:55.878678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fb5225da-58ae-4f5f-9ae9-b527d39caeca tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:55.887191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fb5225da-58ae-4f5f-9ae9-b527d39caeca tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.155742 May 10 21:35:55.887773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2195/2971] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:55 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:55.892168 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2a676a4d-dfd9-44d5-8fb7-b057b84f5755 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:55.892796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2a676a4d-dfd9-44d5-8fb7-b057b84f5755 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:55.898583 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2a676a4d-dfd9-44d5-8fb7-b057b84f5755 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:55.900298 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2a676a4d-dfd9-44d5-8fb7-b057b84f5755 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:55.901080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2a676a4d-dfd9-44d5-8fb7-b057b84f5755 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:55.901523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2a676a4d-dfd9-44d5-8fb7-b057b84f5755 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:56.028775 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2a676a4d-dfd9-44d5-8fb7-b057b84f5755 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:56.036653 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2a676a4d-dfd9-44d5-8fb7-b057b84f5755 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.147954 May 10 21:35:56.037212 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2196/2972] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:55 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:56.264309 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a4175101-6be9-490b-8d30-c02e39e7a7d3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:56.264948 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a4175101-6be9-490b-8d30-c02e39e7a7d3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:56.271566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a4175101-6be9-490b-8d30-c02e39e7a7d3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:56.272016 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a4175101-6be9-490b-8d30-c02e39e7a7d3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:56.272837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a4175101-6be9-490b-8d30-c02e39e7a7d3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:56.273454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a4175101-6be9-490b-8d30-c02e39e7a7d3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:56.401562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a4175101-6be9-490b-8d30-c02e39e7a7d3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:56.409261 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a4175101-6be9-490b-8d30-c02e39e7a7d3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149017 May 10 21:35:56.409822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2197/2973] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:56 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:56.904514 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-319a9ba3-e858-48b6-918d-89572b89c96d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:56.905075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-319a9ba3-e858-48b6-918d-89572b89c96d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:56.911539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-319a9ba3-e858-48b6-918d-89572b89c96d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:56.911989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-319a9ba3-e858-48b6-918d-89572b89c96d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:56.912750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-319a9ba3-e858-48b6-918d-89572b89c96d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:56.913189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-319a9ba3-e858-48b6-918d-89572b89c96d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:57.046449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-319a9ba3-e858-48b6-918d-89572b89c96d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:57.054505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-319a9ba3-e858-48b6-918d-89572b89c96d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.153922 May 10 21:35:57.055065 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2198/2974] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:56 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:57.059932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ed89feff-7ffb-4aa8-89d4-bc3078d788ef tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:57.060537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ed89feff-7ffb-4aa8-89d4-bc3078d788ef tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:57.065965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed89feff-7ffb-4aa8-89d4-bc3078d788ef tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:57.066413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed89feff-7ffb-4aa8-89d4-bc3078d788ef tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:57.067197 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed89feff-7ffb-4aa8-89d4-bc3078d788ef tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:57.067638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed89feff-7ffb-4aa8-89d4-bc3078d788ef tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:57.206556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ed89feff-7ffb-4aa8-89d4-bc3078d788ef tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:57.214660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ed89feff-7ffb-4aa8-89d4-bc3078d788ef tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.158155 May 10 21:35:57.215244 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2199/2975] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:57 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:35:57.425688 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f0b51721-beb1-4790-b854-2efddd600103 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:57.426375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f0b51721-beb1-4790-b854-2efddd600103 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:57.432440 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0b51721-beb1-4790-b854-2efddd600103 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:57.432897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0b51721-beb1-4790-b854-2efddd600103 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:57.438678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0b51721-beb1-4790-b854-2efddd600103 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:57.438678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0b51721-beb1-4790-b854-2efddd600103 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:57.568519 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f0b51721-beb1-4790-b854-2efddd600103 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:57.577402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f0b51721-beb1-4790-b854-2efddd600103 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.155577 May 10 21:35:57.577975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2200/2976] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:57 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:58.072389 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e0e75ab5-e004-4c77-baa0-0b27d258e452 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:58.073030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e0e75ab5-e004-4c77-baa0-0b27d258e452 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:58.079375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e0e75ab5-e004-4c77-baa0-0b27d258e452 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:58.079826 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e0e75ab5-e004-4c77-baa0-0b27d258e452 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:58.080584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e0e75ab5-e004-4c77-baa0-0b27d258e452 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:58.081200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e0e75ab5-e004-4c77-baa0-0b27d258e452 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:58.207851 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e0e75ab5-e004-4c77-baa0-0b27d258e452 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:58.216122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e0e75ab5-e004-4c77-baa0-0b27d258e452 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.147676 May 10 21:35:58.216685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2201/2977] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:58 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:58.232054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d119d5dd-d387-4be1-a020-e78005fa14e7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:58.232719 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d119d5dd-d387-4be1-a020-e78005fa14e7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:58.238409 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d119d5dd-d387-4be1-a020-e78005fa14e7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:58.238856 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d119d5dd-d387-4be1-a020-e78005fa14e7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:58.239645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d119d5dd-d387-4be1-a020-e78005fa14e7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:58.240087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d119d5dd-d387-4be1-a020-e78005fa14e7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:58.366121 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d119d5dd-d387-4be1-a020-e78005fa14e7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:58.374088 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d119d5dd-d387-4be1-a020-e78005fa14e7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.145542 May 10 21:35:58.374644 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2202/2978] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:58 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:58.595414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1d249f3f-a18e-42e7-9b21-9f3cfd1f5cb4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:58.596057 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1d249f3f-a18e-42e7-9b21-9f3cfd1f5cb4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:58.602014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d249f3f-a18e-42e7-9b21-9f3cfd1f5cb4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:58.602521 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d249f3f-a18e-42e7-9b21-9f3cfd1f5cb4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:58.603335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d249f3f-a18e-42e7-9b21-9f3cfd1f5cb4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:58.603773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d249f3f-a18e-42e7-9b21-9f3cfd1f5cb4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:58.744045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1d249f3f-a18e-42e7-9b21-9f3cfd1f5cb4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:58.751759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1d249f3f-a18e-42e7-9b21-9f3cfd1f5cb4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.160103 May 10 21:35:58.752315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2203/2979] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:58 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:59.234149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-07fcebe2-986b-43c5-af48-b008e6e55618 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:59.234687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-07fcebe2-986b-43c5-af48-b008e6e55618 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:59.241221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07fcebe2-986b-43c5-af48-b008e6e55618 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:59.241678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07fcebe2-986b-43c5-af48-b008e6e55618 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:59.242453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07fcebe2-986b-43c5-af48-b008e6e55618 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:59.242903 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07fcebe2-986b-43c5-af48-b008e6e55618 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:59.368900 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-07fcebe2-986b-43c5-af48-b008e6e55618 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:59.376623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-07fcebe2-986b-43c5-af48-b008e6e55618 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.146487 May 10 21:35:59.377184 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2204/2980] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:59 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:59.391207 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-24b429bd-0908-4ae1-8374-51c918175deb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:59.391807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-24b429bd-0908-4ae1-8374-51c918175deb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:59.397527 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-24b429bd-0908-4ae1-8374-51c918175deb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:59.397972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-24b429bd-0908-4ae1-8374-51c918175deb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:59.398723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-24b429bd-0908-4ae1-8374-51c918175deb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:59.399815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-24b429bd-0908-4ae1-8374-51c918175deb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:59.531918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-24b429bd-0908-4ae1-8374-51c918175deb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:59.541090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-24b429bd-0908-4ae1-8374-51c918175deb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.153363 May 10 21:35:59.541677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2205/2981] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:59 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:35:59.769255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6885296c-31f3-4411-94fe-fba9388ca255 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:35:59.769899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6885296c-31f3-4411-94fe-fba9388ca255 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:35:59.776541 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6885296c-31f3-4411-94fe-fba9388ca255 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:59.776991 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6885296c-31f3-4411-94fe-fba9388ca255 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:59.777747 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6885296c-31f3-4411-94fe-fba9388ca255 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:35:59.778180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6885296c-31f3-4411-94fe-fba9388ca255 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:35:59.904564 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6885296c-31f3-4411-94fe-fba9388ca255 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:35:59.912440 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6885296c-31f3-4411-94fe-fba9388ca255 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147085 May 10 21:35:59.913011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2206/2982] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:35:59 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:00.393798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3a19b135-105a-4673-87b0-b5e4510d82e4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:00.394418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3a19b135-105a-4673-87b0-b5e4510d82e4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:00.401286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3a19b135-105a-4673-87b0-b5e4510d82e4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:00.401739 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3a19b135-105a-4673-87b0-b5e4510d82e4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:00.402505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3a19b135-105a-4673-87b0-b5e4510d82e4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:00.402947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3a19b135-105a-4673-87b0-b5e4510d82e4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:00.534829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3a19b135-105a-4673-87b0-b5e4510d82e4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:00.543662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3a19b135-105a-4673-87b0-b5e4510d82e4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.153766 May 10 21:36:00.544237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2207/2983] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:00 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:00.558097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-716635f7-2adc-4d83-9e85-c244eff63bff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:00.561597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-716635f7-2adc-4d83-9e85-c244eff63bff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:00.564697 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-716635f7-2adc-4d83-9e85-c244eff63bff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:00.565147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-716635f7-2adc-4d83-9e85-c244eff63bff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:00.565912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-716635f7-2adc-4d83-9e85-c244eff63bff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:00.566352 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-716635f7-2adc-4d83-9e85-c244eff63bff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:00.696319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-716635f7-2adc-4d83-9e85-c244eff63bff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:00.704116 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-716635f7-2adc-4d83-9e85-c244eff63bff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150379 May 10 21:36:00.704685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2208/2984] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:00 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:00.929532 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d2f54e73-ca66-4f4f-bd46-b577d57eb8c0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:00.930197 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d2f54e73-ca66-4f4f-bd46-b577d57eb8c0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:00.936611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2f54e73-ca66-4f4f-bd46-b577d57eb8c0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:00.936611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2f54e73-ca66-4f4f-bd46-b577d57eb8c0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:00.937324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2f54e73-ca66-4f4f-bd46-b577d57eb8c0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:00.937769 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2f54e73-ca66-4f4f-bd46-b577d57eb8c0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:01.066709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d2f54e73-ca66-4f4f-bd46-b577d57eb8c0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:01.075402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d2f54e73-ca66-4f4f-bd46-b577d57eb8c0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149809 May 10 21:36:01.075966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2209/2985] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:00 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:01.561469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4f4a3268-26d1-402f-b3fe-9f51b57e1649 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:01.562084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4f4a3268-26d1-402f-b3fe-9f51b57e1649 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:01.568568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f4a3268-26d1-402f-b3fe-9f51b57e1649 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:01.569018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f4a3268-26d1-402f-b3fe-9f51b57e1649 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:01.569789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f4a3268-26d1-402f-b3fe-9f51b57e1649 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:01.570230 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f4a3268-26d1-402f-b3fe-9f51b57e1649 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:01.703582 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4f4a3268-26d1-402f-b3fe-9f51b57e1649 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:01.711461 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4f4a3268-26d1-402f-b3fe-9f51b57e1649 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.153860 May 10 21:36:01.712288 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2210/2986] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:01 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:01.721294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-df879a65-2b56-4c63-b16e-d34f4627e102 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:01.721985 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-df879a65-2b56-4c63-b16e-d34f4627e102 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:01.727776 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df879a65-2b56-4c63-b16e-d34f4627e102 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:01.728234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df879a65-2b56-4c63-b16e-d34f4627e102 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:01.729001 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df879a65-2b56-4c63-b16e-d34f4627e102 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:01.729439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-df879a65-2b56-4c63-b16e-d34f4627e102 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:01.855154 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-df879a65-2b56-4c63-b16e-d34f4627e102 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:01.862961 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-df879a65-2b56-4c63-b16e-d34f4627e102 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.145258 May 10 21:36:01.863557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2211/2987] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:01 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:02.092973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d1501e2f-e961-461c-be9a-72c0136391b0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:02.093643 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d1501e2f-e961-461c-be9a-72c0136391b0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:02.099517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d1501e2f-e961-461c-be9a-72c0136391b0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:02.099972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d1501e2f-e961-461c-be9a-72c0136391b0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:02.100732 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d1501e2f-e961-461c-be9a-72c0136391b0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:02.101171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d1501e2f-e961-461c-be9a-72c0136391b0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:02.230216 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d1501e2f-e961-461c-be9a-72c0136391b0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:02.238006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d1501e2f-e961-461c-be9a-72c0136391b0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148929 May 10 21:36:02.238569 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2212/2988] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:02 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:02.728657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-71dafbfd-f45d-4eda-a7d7-b37cc4cf6519 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:02.729266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-71dafbfd-f45d-4eda-a7d7-b37cc4cf6519 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:02.735572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71dafbfd-f45d-4eda-a7d7-b37cc4cf6519 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:02.736020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71dafbfd-f45d-4eda-a7d7-b37cc4cf6519 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:02.736775 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71dafbfd-f45d-4eda-a7d7-b37cc4cf6519 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:02.737376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71dafbfd-f45d-4eda-a7d7-b37cc4cf6519 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:02.875812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-71dafbfd-f45d-4eda-a7d7-b37cc4cf6519 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:02.884097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-71dafbfd-f45d-4eda-a7d7-b37cc4cf6519 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.158781 May 10 21:36:02.884657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2213/2989] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:02 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:02.889014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-521505b7-ca6d-4108-97f1-c460444bb7b8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:02.889610 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-521505b7-ca6d-4108-97f1-c460444bb7b8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:02.895071 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-521505b7-ca6d-4108-97f1-c460444bb7b8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:02.895559 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-521505b7-ca6d-4108-97f1-c460444bb7b8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:02.896300 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-521505b7-ca6d-4108-97f1-c460444bb7b8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:02.896733 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-521505b7-ca6d-4108-97f1-c460444bb7b8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:03.026797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-521505b7-ca6d-4108-97f1-c460444bb7b8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:03.034548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-521505b7-ca6d-4108-97f1-c460444bb7b8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148965 May 10 21:36:03.035162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2214/2990] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:02 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:03.255055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-14bea2f9-779c-478a-9fbf-ffce26b87b15 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:03.255694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-14bea2f9-779c-478a-9fbf-ffce26b87b15 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:03.262253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-14bea2f9-779c-478a-9fbf-ffce26b87b15 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:03.262704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-14bea2f9-779c-478a-9fbf-ffce26b87b15 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:03.263510 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-14bea2f9-779c-478a-9fbf-ffce26b87b15 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:03.263948 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-14bea2f9-779c-478a-9fbf-ffce26b87b15 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:03.392869 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-14bea2f9-779c-478a-9fbf-ffce26b87b15 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:03.400804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-14bea2f9-779c-478a-9fbf-ffce26b87b15 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149611 May 10 21:36:03.401373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2215/2991] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:03 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:03.901921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5241aae4-b07a-40ea-bdcb-f0adf7815019 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:03.902453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5241aae4-b07a-40ea-bdcb-f0adf7815019 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:03.908823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5241aae4-b07a-40ea-bdcb-f0adf7815019 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:03.909269 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5241aae4-b07a-40ea-bdcb-f0adf7815019 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:03.910017 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5241aae4-b07a-40ea-bdcb-f0adf7815019 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:03.910455 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5241aae4-b07a-40ea-bdcb-f0adf7815019 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:04.039976 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5241aae4-b07a-40ea-bdcb-f0adf7815019 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:04.047467 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5241aae4-b07a-40ea-bdcb-f0adf7815019 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150158 May 10 21:36:04.048049 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2216/2992] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:03 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:04.052588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bf6f9c1f-e4bd-4dba-8da8-31b7065e9f4e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:04.053185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bf6f9c1f-e4bd-4dba-8da8-31b7065e9f4e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:04.058807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf6f9c1f-e4bd-4dba-8da8-31b7065e9f4e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:04.059294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf6f9c1f-e4bd-4dba-8da8-31b7065e9f4e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:04.060049 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf6f9c1f-e4bd-4dba-8da8-31b7065e9f4e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:04.060483 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bf6f9c1f-e4bd-4dba-8da8-31b7065e9f4e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:04.188351 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bf6f9c1f-e4bd-4dba-8da8-31b7065e9f4e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:04.196847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bf6f9c1f-e4bd-4dba-8da8-31b7065e9f4e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.147679 May 10 21:36:04.197421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2217/2993] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:04 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:04.286358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:36:04.286978 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Tue May 10 21:36:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 21:36:04.417865 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7108c1ea-e7ea-4184-89e4-be653b5b1ec9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:04.418472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7108c1ea-e7ea-4184-89e4-be653b5b1ec9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:04.424505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7108c1ea-e7ea-4184-89e4-be653b5b1ec9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:04.424956 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7108c1ea-e7ea-4184-89e4-be653b5b1ec9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:04.425724 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7108c1ea-e7ea-4184-89e4-be653b5b1ec9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:04.426165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7108c1ea-e7ea-4184-89e4-be653b5b1ec9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:04.553528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7108c1ea-e7ea-4184-89e4-be653b5b1ec9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:04.561893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7108c1ea-e7ea-4184-89e4-be653b5b1ec9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148281 May 10 21:36:04.562585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2218/2994] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:04 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:05.064763 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9775d3ca-9882-4d29-86ec-23cdff7291f0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:05.065381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9775d3ca-9882-4d29-86ec-23cdff7291f0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:05.071813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9775d3ca-9882-4d29-86ec-23cdff7291f0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:05.072270 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9775d3ca-9882-4d29-86ec-23cdff7291f0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:05.073041 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9775d3ca-9882-4d29-86ec-23cdff7291f0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:05.073487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9775d3ca-9882-4d29-86ec-23cdff7291f0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:05.203080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9775d3ca-9882-4d29-86ec-23cdff7291f0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:05.210914 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9775d3ca-9882-4d29-86ec-23cdff7291f0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150047 May 10 21:36:05.212248 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2219/2995] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:05 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:05.216632 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-803efbbc-b093-4781-bd7f-b324ca6c5a1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:05.217238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-803efbbc-b093-4781-bd7f-b324ca6c5a1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:05.222722 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-803efbbc-b093-4781-bd7f-b324ca6c5a1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:05.223206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-803efbbc-b093-4781-bd7f-b324ca6c5a1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:05.223990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-803efbbc-b093-4781-bd7f-b324ca6c5a1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:05.224429 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-803efbbc-b093-4781-bd7f-b324ca6c5a1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:05.349917 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-803efbbc-b093-4781-bd7f-b324ca6c5a1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:05.358330 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-803efbbc-b093-4781-bd7f-b324ca6c5a1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.145158 May 10 21:36:05.358904 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2220/2996] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:05 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:05.579381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0f0d2cc0-3a3b-43af-836f-341251c6ad46 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:05.580020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0f0d2cc0-3a3b-43af-836f-341251c6ad46 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:05.587130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f0d2cc0-3a3b-43af-836f-341251c6ad46 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:05.587671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f0d2cc0-3a3b-43af-836f-341251c6ad46 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:05.588475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f0d2cc0-3a3b-43af-836f-341251c6ad46 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:05.588913 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f0d2cc0-3a3b-43af-836f-341251c6ad46 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:05.655074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection May 10 21:36:05.655380 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Tue May 10 21:36:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e (ip 10.222.0.49) !!! May 10 21:36:05.720839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0f0d2cc0-3a3b-43af-836f-341251c6ad46 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:05.729470 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0f0d2cc0-3a3b-43af-836f-341251c6ad46 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.154181 May 10 21:36:05.730028 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2221/2997] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:05 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:06.229660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6c518299-2c5f-4847-bf13-ab8cadb7ec2f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:06.230280 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6c518299-2c5f-4847-bf13-ab8cadb7ec2f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:06.236761 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6c518299-2c5f-4847-bf13-ab8cadb7ec2f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:06.237210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6c518299-2c5f-4847-bf13-ab8cadb7ec2f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:06.237968 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6c518299-2c5f-4847-bf13-ab8cadb7ec2f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:06.238398 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6c518299-2c5f-4847-bf13-ab8cadb7ec2f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:06.368783 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6c518299-2c5f-4847-bf13-ab8cadb7ec2f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:06.376939 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6c518299-2c5f-4847-bf13-ab8cadb7ec2f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.152067 May 10 21:36:06.377518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2222/2998] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:06 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:06.382007 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1e50f0a4-2f34-4231-afa4-d0cf17c5731d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:06.382666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1e50f0a4-2f34-4231-afa4-d0cf17c5731d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:06.388906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1e50f0a4-2f34-4231-afa4-d0cf17c5731d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:06.389356 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1e50f0a4-2f34-4231-afa4-d0cf17c5731d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:06.390110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1e50f0a4-2f34-4231-afa4-d0cf17c5731d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:06.390543 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1e50f0a4-2f34-4231-afa4-d0cf17c5731d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:06.514964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1e50f0a4-2f34-4231-afa4-d0cf17c5731d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:06.522734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1e50f0a4-2f34-4231-afa4-d0cf17c5731d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.144304 May 10 21:36:06.523325 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2223/2999] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:06 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:06.745447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-17346460-a600-4c36-8398-e3c79ea26f2c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:06.746055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-17346460-a600-4c36-8398-e3c79ea26f2c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:06.752005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17346460-a600-4c36-8398-e3c79ea26f2c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:06.752452 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17346460-a600-4c36-8398-e3c79ea26f2c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:06.753210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17346460-a600-4c36-8398-e3c79ea26f2c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:06.753641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17346460-a600-4c36-8398-e3c79ea26f2c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:06.882301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-17346460-a600-4c36-8398-e3c79ea26f2c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:06.890276 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-17346460-a600-4c36-8398-e3c79ea26f2c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148750 May 10 21:36:06.890832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2224/3000] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:06 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:07.394441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-723ab3fa-116c-437e-8828-687ee948e381 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:07.395150 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-723ab3fa-116c-437e-8828-687ee948e381 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:07.401923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-723ab3fa-116c-437e-8828-687ee948e381 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:07.402375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-723ab3fa-116c-437e-8828-687ee948e381 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:07.403160 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-723ab3fa-116c-437e-8828-687ee948e381 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:07.403607 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-723ab3fa-116c-437e-8828-687ee948e381 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:07.536996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-723ab3fa-116c-437e-8828-687ee948e381 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:07.545629 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-723ab3fa-116c-437e-8828-687ee948e381 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.155024 May 10 21:36:07.546186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2225/3001] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:07 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:07.550730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-686b6489-a73e-4ddf-a567-32077e9dc882 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:07.551364 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-686b6489-a73e-4ddf-a567-32077e9dc882 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:07.558023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-686b6489-a73e-4ddf-a567-32077e9dc882 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:07.558451 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-686b6489-a73e-4ddf-a567-32077e9dc882 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:07.559261 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-686b6489-a73e-4ddf-a567-32077e9dc882 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:07.559703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-686b6489-a73e-4ddf-a567-32077e9dc882 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:07.686114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-686b6489-a73e-4ddf-a567-32077e9dc882 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:07.693821 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-686b6489-a73e-4ddf-a567-32077e9dc882 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.146686 May 10 21:36:07.694382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2226/3002] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:07 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:07.907076 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2c9ebd4b-91ad-4a2c-b1f3-b41247ae4908 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:07.907721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2c9ebd4b-91ad-4a2c-b1f3-b41247ae4908 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:07.913657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c9ebd4b-91ad-4a2c-b1f3-b41247ae4908 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:07.914102 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c9ebd4b-91ad-4a2c-b1f3-b41247ae4908 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:07.914859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c9ebd4b-91ad-4a2c-b1f3-b41247ae4908 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:07.915332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c9ebd4b-91ad-4a2c-b1f3-b41247ae4908 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:08.048563 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2c9ebd4b-91ad-4a2c-b1f3-b41247ae4908 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:08.057014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2c9ebd4b-91ad-4a2c-b1f3-b41247ae4908 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.153229 May 10 21:36:08.057564 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2227/3003] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:07 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:08.568507 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-55b5580d-1571-4bcf-b233-3f4cab857574 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:08.569174 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-55b5580d-1571-4bcf-b233-3f4cab857574 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:08.576245 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-55b5580d-1571-4bcf-b233-3f4cab857574 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:08.576703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-55b5580d-1571-4bcf-b233-3f4cab857574 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:08.577471 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-55b5580d-1571-4bcf-b233-3f4cab857574 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:08.577930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-55b5580d-1571-4bcf-b233-3f4cab857574 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:08.706988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-55b5580d-1571-4bcf-b233-3f4cab857574 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:08.715897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-55b5580d-1571-4bcf-b233-3f4cab857574 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151271 May 10 21:36:08.716456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2228/3004] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:08 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:08.720895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0c397fde-1251-41b5-9bd9-7242cb2c5289 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:08.721505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0c397fde-1251-41b5-9bd9-7242cb2c5289 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:08.726949 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c397fde-1251-41b5-9bd9-7242cb2c5289 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:08.727434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c397fde-1251-41b5-9bd9-7242cb2c5289 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:08.728237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c397fde-1251-41b5-9bd9-7242cb2c5289 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:08.728774 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c397fde-1251-41b5-9bd9-7242cb2c5289 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:08.859753 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0c397fde-1251-41b5-9bd9-7242cb2c5289 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:08.867473 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0c397fde-1251-41b5-9bd9-7242cb2c5289 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150055 May 10 21:36:08.868037 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2229/3005] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:08 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:09.074246 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f3e95207-e365-4539-b2af-32b3b825c702 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:09.074866 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f3e95207-e365-4539-b2af-32b3b825c702 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:09.080829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f3e95207-e365-4539-b2af-32b3b825c702 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:09.081286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f3e95207-e365-4539-b2af-32b3b825c702 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:09.082060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f3e95207-e365-4539-b2af-32b3b825c702 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:09.082502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f3e95207-e365-4539-b2af-32b3b825c702 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:09.210164 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f3e95207-e365-4539-b2af-32b3b825c702 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:09.218726 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f3e95207-e365-4539-b2af-32b3b825c702 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148946 May 10 21:36:09.219324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2230/3006] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:09 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:09.732754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bc2649fc-bd82-4909-b13d-8633c5ad0289 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:09.733399 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bc2649fc-bd82-4909-b13d-8633c5ad0289 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:09.739684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bc2649fc-bd82-4909-b13d-8633c5ad0289 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:09.740128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bc2649fc-bd82-4909-b13d-8633c5ad0289 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:09.740883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bc2649fc-bd82-4909-b13d-8633c5ad0289 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:09.741313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bc2649fc-bd82-4909-b13d-8633c5ad0289 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:09.873031 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bc2649fc-bd82-4909-b13d-8633c5ad0289 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:09.880809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bc2649fc-bd82-4909-b13d-8633c5ad0289 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151935 May 10 21:36:09.881362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2231/3007] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:09 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:09.886482 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9c6a869e-6108-41ef-baf3-f2837147f974 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:09.887080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9c6a869e-6108-41ef-baf3-f2837147f974 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:09.892714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c6a869e-6108-41ef-baf3-f2837147f974 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:09.893161 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c6a869e-6108-41ef-baf3-f2837147f974 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:09.893915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c6a869e-6108-41ef-baf3-f2837147f974 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:09.894354 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c6a869e-6108-41ef-baf3-f2837147f974 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:10.022988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9c6a869e-6108-41ef-baf3-f2837147f974 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:10.032151 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9c6a869e-6108-41ef-baf3-f2837147f974 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149862 May 10 21:36:10.032719 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2232/3008] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:09 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:10.235544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-69ee1ab0-9398-4b9d-b573-3675767c7338 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:10.236072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-69ee1ab0-9398-4b9d-b573-3675767c7338 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:10.241978 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-69ee1ab0-9398-4b9d-b573-3675767c7338 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:10.242426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-69ee1ab0-9398-4b9d-b573-3675767c7338 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:10.243207 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-69ee1ab0-9398-4b9d-b573-3675767c7338 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:10.243652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-69ee1ab0-9398-4b9d-b573-3675767c7338 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:10.371277 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-69ee1ab0-9398-4b9d-b573-3675767c7338 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:10.379059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-69ee1ab0-9398-4b9d-b573-3675767c7338 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147443 May 10 21:36:10.379650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2233/3009] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:10 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:10.898473 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7ec88e39-40fd-4ea5-a60d-0f851e440692 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:10.899172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7ec88e39-40fd-4ea5-a60d-0f851e440692 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:10.905382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ec88e39-40fd-4ea5-a60d-0f851e440692 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:10.905837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ec88e39-40fd-4ea5-a60d-0f851e440692 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:10.906596 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ec88e39-40fd-4ea5-a60d-0f851e440692 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:10.907032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ec88e39-40fd-4ea5-a60d-0f851e440692 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:11.038793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7ec88e39-40fd-4ea5-a60d-0f851e440692 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:11.047869 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7ec88e39-40fd-4ea5-a60d-0f851e440692 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.153340 May 10 21:36:11.048438 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2234/3010] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:10 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:11.052928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-041fa8a2-6b25-4073-96e3-680bed97f8be tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:11.053538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-041fa8a2-6b25-4073-96e3-680bed97f8be tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:11.060336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-041fa8a2-6b25-4073-96e3-680bed97f8be tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:11.060789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-041fa8a2-6b25-4073-96e3-680bed97f8be tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:11.061548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-041fa8a2-6b25-4073-96e3-680bed97f8be tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:11.061985 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-041fa8a2-6b25-4073-96e3-680bed97f8be tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:11.189124 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-041fa8a2-6b25-4073-96e3-680bed97f8be tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:11.196998 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-041fa8a2-6b25-4073-96e3-680bed97f8be tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.147621 May 10 21:36:11.197921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2235/3011] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:11 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:11.395749 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a9d0a21f-d261-4cb4-937b-36401292f762 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:11.396365 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a9d0a21f-d261-4cb4-937b-36401292f762 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:11.402914 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a9d0a21f-d261-4cb4-937b-36401292f762 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:11.403410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a9d0a21f-d261-4cb4-937b-36401292f762 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:11.404182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a9d0a21f-d261-4cb4-937b-36401292f762 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:11.404623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a9d0a21f-d261-4cb4-937b-36401292f762 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:11.534836 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a9d0a21f-d261-4cb4-937b-36401292f762 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:11.543144 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a9d0a21f-d261-4cb4-937b-36401292f762 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151475 May 10 21:36:11.543725 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2236/3012] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:11 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:12.064969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-990d09fe-eecb-4a91-8273-eee946b15763 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:12.065681 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-990d09fe-eecb-4a91-8273-eee946b15763 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:12.071967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-990d09fe-eecb-4a91-8273-eee946b15763 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:12.072989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-990d09fe-eecb-4a91-8273-eee946b15763 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:12.073737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-990d09fe-eecb-4a91-8273-eee946b15763 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:12.074174 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-990d09fe-eecb-4a91-8273-eee946b15763 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:12.199950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-990d09fe-eecb-4a91-8273-eee946b15763 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:12.207596 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-990d09fe-eecb-4a91-8273-eee946b15763 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.146572 May 10 21:36:12.208192 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2237/3013] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:12 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:12.213782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-035c5261-7aef-41fa-844b-7bfd2a758a1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:12.214382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-035c5261-7aef-41fa-844b-7bfd2a758a1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:12.220217 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-035c5261-7aef-41fa-844b-7bfd2a758a1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:12.220664 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-035c5261-7aef-41fa-844b-7bfd2a758a1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:12.221420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-035c5261-7aef-41fa-844b-7bfd2a758a1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:12.221853 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-035c5261-7aef-41fa-844b-7bfd2a758a1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:12.347799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-035c5261-7aef-41fa-844b-7bfd2a758a1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:12.355629 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-035c5261-7aef-41fa-844b-7bfd2a758a1d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.145732 May 10 21:36:12.356192 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2238/3014] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:12 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:12.560617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-044c7bed-2eca-476e-9cb7-93fd7893ec55 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:12.561243 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-044c7bed-2eca-476e-9cb7-93fd7893ec55 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:12.567276 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-044c7bed-2eca-476e-9cb7-93fd7893ec55 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:12.567727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-044c7bed-2eca-476e-9cb7-93fd7893ec55 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:12.568493 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-044c7bed-2eca-476e-9cb7-93fd7893ec55 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:12.568930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-044c7bed-2eca-476e-9cb7-93fd7893ec55 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:12.700901 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-044c7bed-2eca-476e-9cb7-93fd7893ec55 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:12.708711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-044c7bed-2eca-476e-9cb7-93fd7893ec55 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.152529 May 10 21:36:12.709273 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2239/3015] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:12 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:13.225972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6622ebc2-c257-4008-a103-eef21836b802 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:13.226647 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6622ebc2-c257-4008-a103-eef21836b802 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:13.232920 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6622ebc2-c257-4008-a103-eef21836b802 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:13.233370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6622ebc2-c257-4008-a103-eef21836b802 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:13.234131 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6622ebc2-c257-4008-a103-eef21836b802 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:13.234570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6622ebc2-c257-4008-a103-eef21836b802 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:13.360199 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6622ebc2-c257-4008-a103-eef21836b802 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:13.367974 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6622ebc2-c257-4008-a103-eef21836b802 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.145934 May 10 21:36:13.368535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2240/3016] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:13 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:13.373414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b6729069-e97c-4369-9443-844bd17ec77c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:13.374016 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b6729069-e97c-4369-9443-844bd17ec77c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:13.379600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b6729069-e97c-4369-9443-844bd17ec77c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:13.380037 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b6729069-e97c-4369-9443-844bd17ec77c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:13.380798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b6729069-e97c-4369-9443-844bd17ec77c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:13.381235 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b6729069-e97c-4369-9443-844bd17ec77c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:13.508550 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b6729069-e97c-4369-9443-844bd17ec77c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:13.517027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b6729069-e97c-4369-9443-844bd17ec77c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.147052 May 10 21:36:13.517609 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2241/3017] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:13 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:13.725573 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a382aaae-a941-47ca-9bea-22c9ec9dec47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:13.726193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a382aaae-a941-47ca-9bea-22c9ec9dec47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:13.732874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a382aaae-a941-47ca-9bea-22c9ec9dec47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:13.733320 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a382aaae-a941-47ca-9bea-22c9ec9dec47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:13.734077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a382aaae-a941-47ca-9bea-22c9ec9dec47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:13.734516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a382aaae-a941-47ca-9bea-22c9ec9dec47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:13.858835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a382aaae-a941-47ca-9bea-22c9ec9dec47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:13.866577 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a382aaae-a941-47ca-9bea-22c9ec9dec47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.144824 May 10 21:36:13.867156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2242/3018] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:13 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:14.385806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5ddbfc41-b1ae-461d-9c80-974e4d87e0c9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:14.386482 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5ddbfc41-b1ae-461d-9c80-974e4d87e0c9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:14.392320 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ddbfc41-b1ae-461d-9c80-974e4d87e0c9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:14.392788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ddbfc41-b1ae-461d-9c80-974e4d87e0c9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:14.393524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ddbfc41-b1ae-461d-9c80-974e4d87e0c9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:14.393964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ddbfc41-b1ae-461d-9c80-974e4d87e0c9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:14.524589 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5ddbfc41-b1ae-461d-9c80-974e4d87e0c9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:14.533201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5ddbfc41-b1ae-461d-9c80-974e4d87e0c9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151294 May 10 21:36:14.533761 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2243/3019] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:14 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:14.538193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e4039e50-88d6-4a42-8151-c476476fb972 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:14.538789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e4039e50-88d6-4a42-8151-c476476fb972 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:14.544656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4039e50-88d6-4a42-8151-c476476fb972 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:14.545893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4039e50-88d6-4a42-8151-c476476fb972 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:14.545893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4039e50-88d6-4a42-8151-c476476fb972 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:14.546451 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4039e50-88d6-4a42-8151-c476476fb972 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:14.922141 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e4039e50-88d6-4a42-8151-c476476fb972 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:14.929928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e4039e50-88d6-4a42-8151-c476476fb972 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.395175 May 10 21:36:14.930504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2244/3020] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:14 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:14.935738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3772eaff-ac60-453c-900e-8eb9d99742fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:14.936349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3772eaff-ac60-453c-900e-8eb9d99742fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:14.942008 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3772eaff-ac60-453c-900e-8eb9d99742fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:14.942462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3772eaff-ac60-453c-900e-8eb9d99742fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:14.943266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3772eaff-ac60-453c-900e-8eb9d99742fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:14.943711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3772eaff-ac60-453c-900e-8eb9d99742fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:15.072214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3772eaff-ac60-453c-900e-8eb9d99742fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:15.082714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3772eaff-ac60-453c-900e-8eb9d99742fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151274 May 10 21:36:15.083312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2245/3021] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:14 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:15.550486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f97513f2-1333-4cef-afe3-d048ec43e630 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:15.551245 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f97513f2-1333-4cef-afe3-d048ec43e630 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:15.557614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f97513f2-1333-4cef-afe3-d048ec43e630 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:15.558154 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f97513f2-1333-4cef-afe3-d048ec43e630 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:15.558925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f97513f2-1333-4cef-afe3-d048ec43e630 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:15.559389 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f97513f2-1333-4cef-afe3-d048ec43e630 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:15.688763 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f97513f2-1333-4cef-afe3-d048ec43e630 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:15.696506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f97513f2-1333-4cef-afe3-d048ec43e630 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150077 May 10 21:36:15.697115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2246/3022] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:15 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:15.947630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e8452f81-2a74-4fab-9845-4bd53fff16bc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:15.948244 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e8452f81-2a74-4fab-9845-4bd53fff16bc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:15.954529 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e8452f81-2a74-4fab-9845-4bd53fff16bc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:15.954980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e8452f81-2a74-4fab-9845-4bd53fff16bc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:15.955786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e8452f81-2a74-4fab-9845-4bd53fff16bc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:15.956244 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e8452f81-2a74-4fab-9845-4bd53fff16bc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:16.082401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e8452f81-2a74-4fab-9845-4bd53fff16bc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:16.093190 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e8452f81-2a74-4fab-9845-4bd53fff16bc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149490 May 10 21:36:16.093759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2247/3023] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:15 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:16.098987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bfb3f4b8-be02-4edf-a8d5-67abacb901f6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:16.099620 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bfb3f4b8-be02-4edf-a8d5-67abacb901f6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:16.105759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfb3f4b8-be02-4edf-a8d5-67abacb901f6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:16.106210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfb3f4b8-be02-4edf-a8d5-67abacb901f6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:16.106981 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfb3f4b8-be02-4edf-a8d5-67abacb901f6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:16.107453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bfb3f4b8-be02-4edf-a8d5-67abacb901f6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:16.241512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bfb3f4b8-be02-4edf-a8d5-67abacb901f6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:16.249646 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bfb3f4b8-be02-4edf-a8d5-67abacb901f6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.154213 May 10 21:36:16.250209 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2248/3024] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:16 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:16.714001 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7708aab4-9256-4026-b86d-8e4f4c1e47e2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:16.714622 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7708aab4-9256-4026-b86d-8e4f4c1e47e2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:16.720550 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7708aab4-9256-4026-b86d-8e4f4c1e47e2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:16.720991 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7708aab4-9256-4026-b86d-8e4f4c1e47e2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:16.721748 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7708aab4-9256-4026-b86d-8e4f4c1e47e2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:16.722188 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7708aab4-9256-4026-b86d-8e4f4c1e47e2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:16.849776 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7708aab4-9256-4026-b86d-8e4f4c1e47e2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:16.860031 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7708aab4-9256-4026-b86d-8e4f4c1e47e2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150197 May 10 21:36:16.860541 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2249/3025] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:16 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:17.111533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9cbad63a-74dd-426a-8e5c-0d6980185b9c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:17.112073 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9cbad63a-74dd-426a-8e5c-0d6980185b9c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:17.118293 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9cbad63a-74dd-426a-8e5c-0d6980185b9c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:17.118735 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9cbad63a-74dd-426a-8e5c-0d6980185b9c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:17.120081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9cbad63a-74dd-426a-8e5c-0d6980185b9c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:17.120516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9cbad63a-74dd-426a-8e5c-0d6980185b9c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:17.250441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9cbad63a-74dd-426a-8e5c-0d6980185b9c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:17.258195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9cbad63a-74dd-426a-8e5c-0d6980185b9c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150645 May 10 21:36:17.258750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2250/3026] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:17 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:17.265352 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-abfb9539-698a-4127-a819-64c487fbe560 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:17.265966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-abfb9539-698a-4127-a819-64c487fbe560 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:17.271707 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-abfb9539-698a-4127-a819-64c487fbe560 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:17.272163 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-abfb9539-698a-4127-a819-64c487fbe560 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:17.272932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-abfb9539-698a-4127-a819-64c487fbe560 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:17.273378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-abfb9539-698a-4127-a819-64c487fbe560 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:17.399557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-abfb9539-698a-4127-a819-64c487fbe560 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:17.407429 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-abfb9539-698a-4127-a819-64c487fbe560 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.145672 May 10 21:36:17.407995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2251/3027] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:17 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:17.877912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5de95e2c-c25f-423e-9391-af8f5dd05c78 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:17.878561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5de95e2c-c25f-423e-9391-af8f5dd05c78 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:17.885737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5de95e2c-c25f-423e-9391-af8f5dd05c78 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:17.886203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5de95e2c-c25f-423e-9391-af8f5dd05c78 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:17.886972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5de95e2c-c25f-423e-9391-af8f5dd05c78 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:17.887449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5de95e2c-c25f-423e-9391-af8f5dd05c78 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:18.014409 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5de95e2c-c25f-423e-9391-af8f5dd05c78 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:18.022178 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5de95e2c-c25f-423e-9391-af8f5dd05c78 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148125 May 10 21:36:18.022740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2252/3028] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:17 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:18.276117 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-75780745-c206-42f0-9fcd-3374c6ca9bea tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:18.276652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-75780745-c206-42f0-9fcd-3374c6ca9bea tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:18.283207 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-75780745-c206-42f0-9fcd-3374c6ca9bea tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:18.283662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-75780745-c206-42f0-9fcd-3374c6ca9bea tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:18.284430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-75780745-c206-42f0-9fcd-3374c6ca9bea tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:18.284867 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-75780745-c206-42f0-9fcd-3374c6ca9bea tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:18.413396 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-75780745-c206-42f0-9fcd-3374c6ca9bea tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:18.421848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-75780745-c206-42f0-9fcd-3374c6ca9bea tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149982 May 10 21:36:18.422407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2253/3029] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:18 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:18.426715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-39a1352e-9146-44c8-bad5-ba4c64be9678 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:18.427343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-39a1352e-9146-44c8-bad5-ba4c64be9678 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:18.433589 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39a1352e-9146-44c8-bad5-ba4c64be9678 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:18.434034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39a1352e-9146-44c8-bad5-ba4c64be9678 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:18.434788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39a1352e-9146-44c8-bad5-ba4c64be9678 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:18.435251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39a1352e-9146-44c8-bad5-ba4c64be9678 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:18.560113 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-39a1352e-9146-44c8-bad5-ba4c64be9678 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:18.567994 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-39a1352e-9146-44c8-bad5-ba4c64be9678 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.144662 May 10 21:36:18.568558 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2254/3030] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:18 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:19.039777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5992d533-e217-42eb-adb8-a636072f8997 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:19.040436 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5992d533-e217-42eb-adb8-a636072f8997 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:19.047442 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5992d533-e217-42eb-adb8-a636072f8997 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:19.047904 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5992d533-e217-42eb-adb8-a636072f8997 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:19.048679 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5992d533-e217-42eb-adb8-a636072f8997 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:19.049121 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5992d533-e217-42eb-adb8-a636072f8997 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:19.261945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5992d533-e217-42eb-adb8-a636072f8997 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:19.269753 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5992d533-e217-42eb-adb8-a636072f8997 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.233953 May 10 21:36:19.270411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2255/3031] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:19 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:19.438803 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-74e9e31f-aa4a-4849-8b0a-d545635be085 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:19.439368 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-74e9e31f-aa4a-4849-8b0a-d545635be085 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:19.445620 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74e9e31f-aa4a-4849-8b0a-d545635be085 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:19.446068 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74e9e31f-aa4a-4849-8b0a-d545635be085 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:19.446823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74e9e31f-aa4a-4849-8b0a-d545635be085 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:19.448067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74e9e31f-aa4a-4849-8b0a-d545635be085 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:19.573229 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-74e9e31f-aa4a-4849-8b0a-d545635be085 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:19.580981 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-74e9e31f-aa4a-4849-8b0a-d545635be085 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.146097 May 10 21:36:19.581537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2256/3032] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:19 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:19.585853 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-73b4ba66-6e49-4585-b4b1-d7d46da20da6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:19.586447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-73b4ba66-6e49-4585-b4b1-d7d46da20da6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:19.592800 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-73b4ba66-6e49-4585-b4b1-d7d46da20da6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:19.593247 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-73b4ba66-6e49-4585-b4b1-d7d46da20da6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:19.594002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-73b4ba66-6e49-4585-b4b1-d7d46da20da6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:19.594435 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-73b4ba66-6e49-4585-b4b1-d7d46da20da6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:19.735591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-73b4ba66-6e49-4585-b4b1-d7d46da20da6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:19.743426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-73b4ba66-6e49-4585-b4b1-d7d46da20da6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.160934 May 10 21:36:19.744044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2257/3033] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:19 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:20.287367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f0e9e7b0-7f68-4603-9c6c-149cbdfe1b03 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:20.288057 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f0e9e7b0-7f68-4603-9c6c-149cbdfe1b03 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:20.295193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0e9e7b0-7f68-4603-9c6c-149cbdfe1b03 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:20.295650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0e9e7b0-7f68-4603-9c6c-149cbdfe1b03 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:20.296418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0e9e7b0-7f68-4603-9c6c-149cbdfe1b03 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:20.296859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0e9e7b0-7f68-4603-9c6c-149cbdfe1b03 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:20.425074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f0e9e7b0-7f68-4603-9c6c-149cbdfe1b03 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:20.432965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f0e9e7b0-7f68-4603-9c6c-149cbdfe1b03 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149373 May 10 21:36:20.433531 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2258/3034] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:20 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:20.599135 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9832ddb4-d117-46ec-8263-6f465b09f5df tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:20.599787 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9832ddb4-d117-46ec-8263-6f465b09f5df tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:20.606269 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9832ddb4-d117-46ec-8263-6f465b09f5df tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:20.606723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9832ddb4-d117-46ec-8263-6f465b09f5df tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:20.607593 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9832ddb4-d117-46ec-8263-6f465b09f5df tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:20.608030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9832ddb4-d117-46ec-8263-6f465b09f5df tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:20.738782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9832ddb4-d117-46ec-8263-6f465b09f5df tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:20.747340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9832ddb4-d117-46ec-8263-6f465b09f5df tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.152160 May 10 21:36:20.747918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2259/3035] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:20 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:20.760198 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3b334f35-f37c-46f3-abc5-01835be276e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:20.761025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3b334f35-f37c-46f3-abc5-01835be276e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:20.766902 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3b334f35-f37c-46f3-abc5-01835be276e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:20.767383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3b334f35-f37c-46f3-abc5-01835be276e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:20.768139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3b334f35-f37c-46f3-abc5-01835be276e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:20.768612 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3b334f35-f37c-46f3-abc5-01835be276e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:20.895000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3b334f35-f37c-46f3-abc5-01835be276e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:20.902792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3b334f35-f37c-46f3-abc5-01835be276e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.146140 May 10 21:36:20.903388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2260/3036] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:20 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:21.449997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-641b63a4-3b0a-4a18-b429-c3f5e22a9d90 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:21.450672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-641b63a4-3b0a-4a18-b429-c3f5e22a9d90 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:21.456611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-641b63a4-3b0a-4a18-b429-c3f5e22a9d90 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:21.457062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-641b63a4-3b0a-4a18-b429-c3f5e22a9d90 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:21.457825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-641b63a4-3b0a-4a18-b429-c3f5e22a9d90 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:21.458316 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-641b63a4-3b0a-4a18-b429-c3f5e22a9d90 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:21.585523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-641b63a4-3b0a-4a18-b429-c3f5e22a9d90 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:21.594452 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-641b63a4-3b0a-4a18-b429-c3f5e22a9d90 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148494 May 10 21:36:21.595015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2261/3037] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:21 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:21.765813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-53306e19-3922-4721-9054-3471ef7d5039 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:21.766345 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-53306e19-3922-4721-9054-3471ef7d5039 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:21.772694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-53306e19-3922-4721-9054-3471ef7d5039 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:21.773142 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-53306e19-3922-4721-9054-3471ef7d5039 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:21.773895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-53306e19-3922-4721-9054-3471ef7d5039 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:21.774329 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-53306e19-3922-4721-9054-3471ef7d5039 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:21.906335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-53306e19-3922-4721-9054-3471ef7d5039 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:21.915641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-53306e19-3922-4721-9054-3471ef7d5039 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.154823 May 10 21:36:21.916223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2262/3038] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:21 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:21.921375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-85e01442-1a62-45a4-ac1c-a976b51271e0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:21.921990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-85e01442-1a62-45a4-ac1c-a976b51271e0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:21.927862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-85e01442-1a62-45a4-ac1c-a976b51271e0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:21.928314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-85e01442-1a62-45a4-ac1c-a976b51271e0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:21.929081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-85e01442-1a62-45a4-ac1c-a976b51271e0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:21.929520 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-85e01442-1a62-45a4-ac1c-a976b51271e0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:22.058410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-85e01442-1a62-45a4-ac1c-a976b51271e0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:22.066361 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-85e01442-1a62-45a4-ac1c-a976b51271e0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149191 May 10 21:36:22.066931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2263/3039] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:21 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:22.611581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-050ec037-306a-4f73-a56d-f3b46d015b95 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:22.612241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-050ec037-306a-4f73-a56d-f3b46d015b95 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:22.618096 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-050ec037-306a-4f73-a56d-f3b46d015b95 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:22.618543 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-050ec037-306a-4f73-a56d-f3b46d015b95 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:22.619343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-050ec037-306a-4f73-a56d-f3b46d015b95 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:22.619806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-050ec037-306a-4f73-a56d-f3b46d015b95 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:22.750955 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-050ec037-306a-4f73-a56d-f3b46d015b95 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:22.758727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-050ec037-306a-4f73-a56d-f3b46d015b95 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151054 May 10 21:36:22.759325 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2264/3040] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:22 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:22.934284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1de8ab93-ff90-46be-80ff-52eb7db60a4f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:22.934895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1de8ab93-ff90-46be-80ff-52eb7db60a4f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:22.941267 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1de8ab93-ff90-46be-80ff-52eb7db60a4f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:22.941740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1de8ab93-ff90-46be-80ff-52eb7db60a4f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:22.942493 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1de8ab93-ff90-46be-80ff-52eb7db60a4f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:22.942931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1de8ab93-ff90-46be-80ff-52eb7db60a4f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:23.072450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1de8ab93-ff90-46be-80ff-52eb7db60a4f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:23.080594 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1de8ab93-ff90-46be-80ff-52eb7db60a4f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.151149 May 10 21:36:23.081165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2265/3041] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:22 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:23.085664 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c14d656c-998a-4243-8e5d-72f803974371 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:23.086270 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c14d656c-998a-4243-8e5d-72f803974371 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:23.092855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c14d656c-998a-4243-8e5d-72f803974371 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:23.093318 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c14d656c-998a-4243-8e5d-72f803974371 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:23.094091 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c14d656c-998a-4243-8e5d-72f803974371 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:23.094534 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c14d656c-998a-4243-8e5d-72f803974371 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:23.222499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c14d656c-998a-4243-8e5d-72f803974371 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:23.231374 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c14d656c-998a-4243-8e5d-72f803974371 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149178 May 10 21:36:23.231951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2266/3042] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:23 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:23.776833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-349e27f7-b280-4248-8fe9-5069fc0d276d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:23.777642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-349e27f7-b280-4248-8fe9-5069fc0d276d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:23.783429 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-349e27f7-b280-4248-8fe9-5069fc0d276d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:23.783879 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-349e27f7-b280-4248-8fe9-5069fc0d276d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:23.784630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-349e27f7-b280-4248-8fe9-5069fc0d276d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:23.785069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-349e27f7-b280-4248-8fe9-5069fc0d276d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:23.914974 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-349e27f7-b280-4248-8fe9-5069fc0d276d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:23.923046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-349e27f7-b280-4248-8fe9-5069fc0d276d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150607 May 10 21:36:23.923638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2267/3043] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:23 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:24.098930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5f014773-7612-4d95-8ccc-15d665254b53 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:24.099570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5f014773-7612-4d95-8ccc-15d665254b53 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:24.106710 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f014773-7612-4d95-8ccc-15d665254b53 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:24.107182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f014773-7612-4d95-8ccc-15d665254b53 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:24.107944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f014773-7612-4d95-8ccc-15d665254b53 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:24.108377 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f014773-7612-4d95-8ccc-15d665254b53 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:24.234509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5f014773-7612-4d95-8ccc-15d665254b53 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:24.242241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5f014773-7612-4d95-8ccc-15d665254b53 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.147256 May 10 21:36:24.242799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2268/3044] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:24 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:24.247416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3d1abc15-d00b-4afa-9e1a-34c29c795df4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:24.248016 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3d1abc15-d00b-4afa-9e1a-34c29c795df4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:24.253600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d1abc15-d00b-4afa-9e1a-34c29c795df4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:24.254045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d1abc15-d00b-4afa-9e1a-34c29c795df4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:24.254800 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d1abc15-d00b-4afa-9e1a-34c29c795df4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:24.255274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d1abc15-d00b-4afa-9e1a-34c29c795df4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:24.384864 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3d1abc15-d00b-4afa-9e1a-34c29c795df4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:24.393401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3d1abc15-d00b-4afa-9e1a-34c29c795df4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149662 May 10 21:36:24.393958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2269/3045] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:24 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:24.940213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1b6d308f-ca2f-4cee-8072-03130db7203b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:24.940855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1b6d308f-ca2f-4cee-8072-03130db7203b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:24.946747 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1b6d308f-ca2f-4cee-8072-03130db7203b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:24.947237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1b6d308f-ca2f-4cee-8072-03130db7203b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:24.948011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1b6d308f-ca2f-4cee-8072-03130db7203b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:24.949110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1b6d308f-ca2f-4cee-8072-03130db7203b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:25.077633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1b6d308f-ca2f-4cee-8072-03130db7203b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:25.085568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1b6d308f-ca2f-4cee-8072-03130db7203b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149374 May 10 21:36:25.086133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2270/3046] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:24 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:25.259678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-53d40b51-b1c6-4147-8c5c-d3fd23bc7a32 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:25.260227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-53d40b51-b1c6-4147-8c5c-d3fd23bc7a32 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:25.267097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-53d40b51-b1c6-4147-8c5c-d3fd23bc7a32 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:25.267577 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-53d40b51-b1c6-4147-8c5c-d3fd23bc7a32 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:25.268332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-53d40b51-b1c6-4147-8c5c-d3fd23bc7a32 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:25.268766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-53d40b51-b1c6-4147-8c5c-d3fd23bc7a32 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:25.399943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-53d40b51-b1c6-4147-8c5c-d3fd23bc7a32 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:25.408669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-53d40b51-b1c6-4147-8c5c-d3fd23bc7a32 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.152935 May 10 21:36:25.409237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2271/3047] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:25 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:25.413697 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fec5b016-db72-4079-82fe-1a0765a3f93f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:25.414297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fec5b016-db72-4079-82fe-1a0765a3f93f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:25.420443 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fec5b016-db72-4079-82fe-1a0765a3f93f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:25.420889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fec5b016-db72-4079-82fe-1a0765a3f93f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:25.421648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fec5b016-db72-4079-82fe-1a0765a3f93f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:25.422080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fec5b016-db72-4079-82fe-1a0765a3f93f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:25.548305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fec5b016-db72-4079-82fe-1a0765a3f93f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:25.556016 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fec5b016-db72-4079-82fe-1a0765a3f93f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.145803 May 10 21:36:25.558428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2272/3048] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:25 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:26.103700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5cc0037a-8a5e-4321-952d-734494dc00a9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:26.104604 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5cc0037a-8a5e-4321-952d-734494dc00a9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:26.110642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5cc0037a-8a5e-4321-952d-734494dc00a9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:26.111101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5cc0037a-8a5e-4321-952d-734494dc00a9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:26.111887 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5cc0037a-8a5e-4321-952d-734494dc00a9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:26.112330 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5cc0037a-8a5e-4321-952d-734494dc00a9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:26.240757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5cc0037a-8a5e-4321-952d-734494dc00a9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:26.249168 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5cc0037a-8a5e-4321-952d-734494dc00a9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149390 May 10 21:36:26.253034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2273/3049] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:26 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:26.426412 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7ab7608f-f6f1-43c3-8ae4-330838cc923d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:26.427177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7ab7608f-f6f1-43c3-8ae4-330838cc923d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:26.434182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ab7608f-f6f1-43c3-8ae4-330838cc923d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:26.434642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ab7608f-f6f1-43c3-8ae4-330838cc923d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:26.435448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ab7608f-f6f1-43c3-8ae4-330838cc923d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:26.435894 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ab7608f-f6f1-43c3-8ae4-330838cc923d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:26.570245 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7ab7608f-f6f1-43c3-8ae4-330838cc923d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:26.578115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7ab7608f-f6f1-43c3-8ae4-330838cc923d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.155601 May 10 21:36:26.578673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2274/3050] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:26 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:26.582962 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-34fa4b83-184c-42dd-b934-13bcdd9bcaf7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:26.583601 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-34fa4b83-184c-42dd-b934-13bcdd9bcaf7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:26.589232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-34fa4b83-184c-42dd-b934-13bcdd9bcaf7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:26.589673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-34fa4b83-184c-42dd-b934-13bcdd9bcaf7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:26.590427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-34fa4b83-184c-42dd-b934-13bcdd9bcaf7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:26.590857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-34fa4b83-184c-42dd-b934-13bcdd9bcaf7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:26.719506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-34fa4b83-184c-42dd-b934-13bcdd9bcaf7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:26.727272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-34fa4b83-184c-42dd-b934-13bcdd9bcaf7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147592 May 10 21:36:26.727839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2275/3051] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:26 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:27.266198 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-47f5864d-fcfe-4ecc-83fa-0627fe8eae9c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:27.266833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-47f5864d-fcfe-4ecc-83fa-0627fe8eae9c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:27.272975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47f5864d-fcfe-4ecc-83fa-0627fe8eae9c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:27.273428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47f5864d-fcfe-4ecc-83fa-0627fe8eae9c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:27.274198 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47f5864d-fcfe-4ecc-83fa-0627fe8eae9c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:27.274642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47f5864d-fcfe-4ecc-83fa-0627fe8eae9c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:27.405537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-47f5864d-fcfe-4ecc-83fa-0627fe8eae9c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:27.413517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-47f5864d-fcfe-4ecc-83fa-0627fe8eae9c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151273 May 10 21:36:27.414085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2276/3052] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:27 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:27.595810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f3925147-ed48-47b0-b987-921f4301fd34 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:27.596413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f3925147-ed48-47b0-b987-921f4301fd34 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:27.602979 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f3925147-ed48-47b0-b987-921f4301fd34 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:27.603458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f3925147-ed48-47b0-b987-921f4301fd34 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:27.604309 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f3925147-ed48-47b0-b987-921f4301fd34 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:27.605290 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f3925147-ed48-47b0-b987-921f4301fd34 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:27.732724 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f3925147-ed48-47b0-b987-921f4301fd34 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:27.740694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f3925147-ed48-47b0-b987-921f4301fd34 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148721 May 10 21:36:27.741257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2277/3053] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:27 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:27.746484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-927b342d-6d88-4100-9666-fefe3670739b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:27.747079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-927b342d-6d88-4100-9666-fefe3670739b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:27.752792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-927b342d-6d88-4100-9666-fefe3670739b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:27.753251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-927b342d-6d88-4100-9666-fefe3670739b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:27.754006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-927b342d-6d88-4100-9666-fefe3670739b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:27.754437 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-927b342d-6d88-4100-9666-fefe3670739b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:27.879854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-927b342d-6d88-4100-9666-fefe3670739b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:27.888613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-927b342d-6d88-4100-9666-fefe3670739b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.146333 May 10 21:36:27.889193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2278/3054] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:27 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:28.430279 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-580abb1e-32bb-4887-9d8c-13856fb8fed1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:28.430967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-580abb1e-32bb-4887-9d8c-13856fb8fed1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:28.437570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-580abb1e-32bb-4887-9d8c-13856fb8fed1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:28.438021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-580abb1e-32bb-4887-9d8c-13856fb8fed1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:28.438788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-580abb1e-32bb-4887-9d8c-13856fb8fed1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:28.439254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-580abb1e-32bb-4887-9d8c-13856fb8fed1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:28.569651 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-580abb1e-32bb-4887-9d8c-13856fb8fed1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:28.578322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-580abb1e-32bb-4887-9d8c-13856fb8fed1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151908 May 10 21:36:28.578880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2279/3055] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:28 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:28.758218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-690acb22-38b1-4aca-837c-bd3c107c421d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:28.758769 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-690acb22-38b1-4aca-837c-bd3c107c421d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:28.765248 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-690acb22-38b1-4aca-837c-bd3c107c421d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:28.765706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-690acb22-38b1-4aca-837c-bd3c107c421d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:28.766474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-690acb22-38b1-4aca-837c-bd3c107c421d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:28.766915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-690acb22-38b1-4aca-837c-bd3c107c421d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:28.896210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-690acb22-38b1-4aca-837c-bd3c107c421d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:28.904646 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-690acb22-38b1-4aca-837c-bd3c107c421d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150318 May 10 21:36:28.905212 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2280/3056] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:28 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:28.909570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-777d4057-7e3c-4ecb-8a81-71efd1354052 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:28.910186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-777d4057-7e3c-4ecb-8a81-71efd1354052 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:28.915794 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-777d4057-7e3c-4ecb-8a81-71efd1354052 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:28.916277 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-777d4057-7e3c-4ecb-8a81-71efd1354052 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:28.917088 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-777d4057-7e3c-4ecb-8a81-71efd1354052 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:28.917528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-777d4057-7e3c-4ecb-8a81-71efd1354052 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:29.051319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-777d4057-7e3c-4ecb-8a81-71efd1354052 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:29.060296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-777d4057-7e3c-4ecb-8a81-71efd1354052 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.154139 May 10 21:36:29.060868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2281/3057] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:28 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:29.595645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-eb183d0b-c3d1-4aaa-a571-641a2d499837 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:29.596310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-eb183d0b-c3d1-4aaa-a571-641a2d499837 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:29.602673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eb183d0b-c3d1-4aaa-a571-641a2d499837 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:29.603138 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eb183d0b-c3d1-4aaa-a571-641a2d499837 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:29.603907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eb183d0b-c3d1-4aaa-a571-641a2d499837 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:29.604343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eb183d0b-c3d1-4aaa-a571-641a2d499837 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:29.730881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-eb183d0b-c3d1-4aaa-a571-641a2d499837 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:29.738604 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-eb183d0b-c3d1-4aaa-a571-641a2d499837 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.146819 May 10 21:36:29.739185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2282/3058] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:29 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:29.922002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-97fb0b16-1b4f-4299-8d7d-1ded83d0f967 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:29.922535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-97fb0b16-1b4f-4299-8d7d-1ded83d0f967 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:29.930026 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-97fb0b16-1b4f-4299-8d7d-1ded83d0f967 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:29.930476 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-97fb0b16-1b4f-4299-8d7d-1ded83d0f967 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:29.931275 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-97fb0b16-1b4f-4299-8d7d-1ded83d0f967 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:29.931714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-97fb0b16-1b4f-4299-8d7d-1ded83d0f967 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:30.060931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-97fb0b16-1b4f-4299-8d7d-1ded83d0f967 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:30.068751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-97fb0b16-1b4f-4299-8d7d-1ded83d0f967 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150845 May 10 21:36:30.069324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2283/3059] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:29 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:30.078306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cd8ae26f-f856-4a22-a00d-200d55f17188 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:30.078916 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cd8ae26f-f856-4a22-a00d-200d55f17188 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:30.084762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd8ae26f-f856-4a22-a00d-200d55f17188 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:30.085211 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd8ae26f-f856-4a22-a00d-200d55f17188 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:30.085972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd8ae26f-f856-4a22-a00d-200d55f17188 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:30.086413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd8ae26f-f856-4a22-a00d-200d55f17188 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:30.218144 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cd8ae26f-f856-4a22-a00d-200d55f17188 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:30.226043 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cd8ae26f-f856-4a22-a00d-200d55f17188 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.152817 May 10 21:36:30.226607 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2284/3060] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:30 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:30.754884 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-da6661cc-a15f-445f-b339-57ee82488999 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:30.755566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-da6661cc-a15f-445f-b339-57ee82488999 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:30.761657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-da6661cc-a15f-445f-b339-57ee82488999 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:30.762047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-da6661cc-a15f-445f-b339-57ee82488999 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:30.762713 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-da6661cc-a15f-445f-b339-57ee82488999 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:30.763171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-da6661cc-a15f-445f-b339-57ee82488999 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:30.893005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-da6661cc-a15f-445f-b339-57ee82488999 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:30.900673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-da6661cc-a15f-445f-b339-57ee82488999 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149611 May 10 21:36:30.901230 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2285/3061] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:30 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:31.085686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-12cfd6a6-bcde-4bee-a191-b4177392a27a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:31.086317 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-12cfd6a6-bcde-4bee-a191-b4177392a27a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:31.093706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-12cfd6a6-bcde-4bee-a191-b4177392a27a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:31.094180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-12cfd6a6-bcde-4bee-a191-b4177392a27a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:31.094922 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-12cfd6a6-bcde-4bee-a191-b4177392a27a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:31.095381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-12cfd6a6-bcde-4bee-a191-b4177392a27a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:31.226288 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-12cfd6a6-bcde-4bee-a191-b4177392a27a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:31.234706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-12cfd6a6-bcde-4bee-a191-b4177392a27a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.152873 May 10 21:36:31.235348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2286/3062] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:31 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:31.243916 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-39642bf0-be4f-4cb8-808f-283621ee0b57 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:31.244542 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-39642bf0-be4f-4cb8-808f-283621ee0b57 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:31.250596 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39642bf0-be4f-4cb8-808f-283621ee0b57 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:31.251045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39642bf0-be4f-4cb8-808f-283621ee0b57 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:31.251829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39642bf0-be4f-4cb8-808f-283621ee0b57 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:31.252265 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39642bf0-be4f-4cb8-808f-283621ee0b57 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:31.380815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-39642bf0-be4f-4cb8-808f-283621ee0b57 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:31.388793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-39642bf0-be4f-4cb8-808f-283621ee0b57 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148551 May 10 21:36:31.389357 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2287/3063] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:31 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:31.918321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-55faac93-b3f8-44e3-ba8c-090cd3b4d328 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:31.919027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-55faac93-b3f8-44e3-ba8c-090cd3b4d328 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:31.925118 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-55faac93-b3f8-44e3-ba8c-090cd3b4d328 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:31.925570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-55faac93-b3f8-44e3-ba8c-090cd3b4d328 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:31.926341 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-55faac93-b3f8-44e3-ba8c-090cd3b4d328 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:31.926781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-55faac93-b3f8-44e3-ba8c-090cd3b4d328 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:32.058157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-55faac93-b3f8-44e3-ba8c-090cd3b4d328 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:32.066613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-55faac93-b3f8-44e3-ba8c-090cd3b4d328 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.152703 May 10 21:36:32.067195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2288/3064] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:31 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:32.252289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e18eb7ce-77c4-45a2-9b3c-c0a0cf799e5c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:32.252817 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e18eb7ce-77c4-45a2-9b3c-c0a0cf799e5c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:32.259097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e18eb7ce-77c4-45a2-9b3c-c0a0cf799e5c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:32.259572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e18eb7ce-77c4-45a2-9b3c-c0a0cf799e5c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:32.260321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e18eb7ce-77c4-45a2-9b3c-c0a0cf799e5c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:32.260751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e18eb7ce-77c4-45a2-9b3c-c0a0cf799e5c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:32.388041 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e18eb7ce-77c4-45a2-9b3c-c0a0cf799e5c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:32.395599 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e18eb7ce-77c4-45a2-9b3c-c0a0cf799e5c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.147235 May 10 21:36:32.396161 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2289/3065] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:32 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:32.405607 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-695ffdd6-5bd5-4fab-b0af-8ec6f057fe88 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:32.406206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-695ffdd6-5bd5-4fab-b0af-8ec6f057fe88 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:32.411907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-695ffdd6-5bd5-4fab-b0af-8ec6f057fe88 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:32.412350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-695ffdd6-5bd5-4fab-b0af-8ec6f057fe88 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:32.413101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-695ffdd6-5bd5-4fab-b0af-8ec6f057fe88 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:32.413534 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-695ffdd6-5bd5-4fab-b0af-8ec6f057fe88 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:32.540472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-695ffdd6-5bd5-4fab-b0af-8ec6f057fe88 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:32.548345 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-695ffdd6-5bd5-4fab-b0af-8ec6f057fe88 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.146870 May 10 21:36:32.548905 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2290/3066] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:32 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:33.083923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-740f3e12-1000-45ff-918e-607ff02677e0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:33.084568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-740f3e12-1000-45ff-918e-607ff02677e0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:33.091658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-740f3e12-1000-45ff-918e-607ff02677e0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:33.092109 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-740f3e12-1000-45ff-918e-607ff02677e0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:33.092874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-740f3e12-1000-45ff-918e-607ff02677e0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:33.093305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-740f3e12-1000-45ff-918e-607ff02677e0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:33.227742 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-740f3e12-1000-45ff-918e-607ff02677e0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:33.235650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-740f3e12-1000-45ff-918e-607ff02677e0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.155575 May 10 21:36:33.236223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2291/3067] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:33 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:33.413777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f3df2ec1-28d5-4bc0-aac3-6dfab7f49a33 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:33.414392 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f3df2ec1-28d5-4bc0-aac3-6dfab7f49a33 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:33.421293 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f3df2ec1-28d5-4bc0-aac3-6dfab7f49a33 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:33.421742 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f3df2ec1-28d5-4bc0-aac3-6dfab7f49a33 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:33.422538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f3df2ec1-28d5-4bc0-aac3-6dfab7f49a33 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:33.422971 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f3df2ec1-28d5-4bc0-aac3-6dfab7f49a33 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:33.556326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f3df2ec1-28d5-4bc0-aac3-6dfab7f49a33 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:33.565951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f3df2ec1-28d5-4bc0-aac3-6dfab7f49a33 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.155864 May 10 21:36:33.566799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2292/3068] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:33 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:33.571373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e4af3556-026e-4b4a-97a9-d14f111b5fdb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:33.571975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e4af3556-026e-4b4a-97a9-d14f111b5fdb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:33.578792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4af3556-026e-4b4a-97a9-d14f111b5fdb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:33.579292 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4af3556-026e-4b4a-97a9-d14f111b5fdb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:33.580075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4af3556-026e-4b4a-97a9-d14f111b5fdb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:33.580516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4af3556-026e-4b4a-97a9-d14f111b5fdb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:33.719526 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e4af3556-026e-4b4a-97a9-d14f111b5fdb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:33.731591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e4af3556-026e-4b4a-97a9-d14f111b5fdb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.163648 May 10 21:36:33.732169 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2293/3069] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:33 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:34.252889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7aa3c092-6fda-48e0-944d-bd02f9169ae5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:34.253588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7aa3c092-6fda-48e0-944d-bd02f9169ae5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:34.259493 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7aa3c092-6fda-48e0-944d-bd02f9169ae5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:34.259940 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7aa3c092-6fda-48e0-944d-bd02f9169ae5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:34.260704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7aa3c092-6fda-48e0-944d-bd02f9169ae5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:34.261143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7aa3c092-6fda-48e0-944d-bd02f9169ae5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:34.389128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7aa3c092-6fda-48e0-944d-bd02f9169ae5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:34.396891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7aa3c092-6fda-48e0-944d-bd02f9169ae5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.147949 May 10 21:36:34.397457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2294/3070] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:34 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:34.584663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f5af7923-c78a-4637-aefb-5171c120fc7b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:34.585201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f5af7923-c78a-4637-aefb-5171c120fc7b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:34.591854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5af7923-c78a-4637-aefb-5171c120fc7b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:34.592301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5af7923-c78a-4637-aefb-5171c120fc7b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:34.593057 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5af7923-c78a-4637-aefb-5171c120fc7b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:34.593489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5af7923-c78a-4637-aefb-5171c120fc7b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:34.724611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f5af7923-c78a-4637-aefb-5171c120fc7b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:34.733158 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f5af7923-c78a-4637-aefb-5171c120fc7b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.152582 May 10 21:36:34.733730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2295/3071] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:34 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:34.749681 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-89733791-0557-4364-b38c-1df03cf916a6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:34.750284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-89733791-0557-4364-b38c-1df03cf916a6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:34.755930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89733791-0557-4364-b38c-1df03cf916a6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:34.756381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89733791-0557-4364-b38c-1df03cf916a6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:34.757146 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89733791-0557-4364-b38c-1df03cf916a6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:34.757583 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89733791-0557-4364-b38c-1df03cf916a6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:34.881732 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-89733791-0557-4364-b38c-1df03cf916a6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:34.890223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-89733791-0557-4364-b38c-1df03cf916a6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.144609 May 10 21:36:34.890802 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2296/3072] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:34 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:35.414083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fa7faa77-cc96-4c48-b5cc-9577e7dce17a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:35.414726 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fa7faa77-cc96-4c48-b5cc-9577e7dce17a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:35.421440 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fa7faa77-cc96-4c48-b5cc-9577e7dce17a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:35.421996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fa7faa77-cc96-4c48-b5cc-9577e7dce17a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:35.422838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fa7faa77-cc96-4c48-b5cc-9577e7dce17a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:35.423322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fa7faa77-cc96-4c48-b5cc-9577e7dce17a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:35.550656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fa7faa77-cc96-4c48-b5cc-9577e7dce17a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:35.557367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fa7faa77-cc96-4c48-b5cc-9577e7dce17a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.147182 May 10 21:36:35.557931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2297/3073] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:35 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:35.750782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8bacc69a-1c36-45b8-af45-2d8310eefcae tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:35.751367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8bacc69a-1c36-45b8-af45-2d8310eefcae tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:35.757732 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8bacc69a-1c36-45b8-af45-2d8310eefcae tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:35.758189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8bacc69a-1c36-45b8-af45-2d8310eefcae tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:35.758953 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8bacc69a-1c36-45b8-af45-2d8310eefcae tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:35.759433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8bacc69a-1c36-45b8-af45-2d8310eefcae tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:35.890950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8bacc69a-1c36-45b8-af45-2d8310eefcae tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:35.898731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8bacc69a-1c36-45b8-af45-2d8310eefcae tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.151869 May 10 21:36:35.899325 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2298/3074] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:35 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:35.907241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-be692c28-36ad-4a27-bb5a-f5b4f9d28a38 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:35.907977 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-be692c28-36ad-4a27-bb5a-f5b4f9d28a38 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:35.913590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be692c28-36ad-4a27-bb5a-f5b4f9d28a38 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:35.914039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be692c28-36ad-4a27-bb5a-f5b4f9d28a38 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:35.914797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be692c28-36ad-4a27-bb5a-f5b4f9d28a38 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:35.915267 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be692c28-36ad-4a27-bb5a-f5b4f9d28a38 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:36.043651 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-be692c28-36ad-4a27-bb5a-f5b4f9d28a38 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:36.051425 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-be692c28-36ad-4a27-bb5a-f5b4f9d28a38 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147705 May 10 21:36:36.051993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2299/3075] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:35 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:36.575975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d62220b3-272a-4f8f-9a24-fc5c09e9909c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:36.576642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d62220b3-272a-4f8f-9a24-fc5c09e9909c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:36.582574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d62220b3-272a-4f8f-9a24-fc5c09e9909c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:36.583023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d62220b3-272a-4f8f-9a24-fc5c09e9909c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:36.583815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d62220b3-272a-4f8f-9a24-fc5c09e9909c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:36.584252 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d62220b3-272a-4f8f-9a24-fc5c09e9909c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:36.713361 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d62220b3-272a-4f8f-9a24-fc5c09e9909c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:36.721441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d62220b3-272a-4f8f-9a24-fc5c09e9909c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149933 May 10 21:36:36.722000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2300/3076] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:36 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:36.915403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c7f00806-b7e2-4d77-ad8e-eea593a989b3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:36.916014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c7f00806-b7e2-4d77-ad8e-eea593a989b3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:36.923040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c7f00806-b7e2-4d77-ad8e-eea593a989b3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:36.923525 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c7f00806-b7e2-4d77-ad8e-eea593a989b3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:36.924288 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c7f00806-b7e2-4d77-ad8e-eea593a989b3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:36.924724 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c7f00806-b7e2-4d77-ad8e-eea593a989b3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:37.051194 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c7f00806-b7e2-4d77-ad8e-eea593a989b3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:37.060127 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c7f00806-b7e2-4d77-ad8e-eea593a989b3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148461 May 10 21:36:37.060700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2301/3077] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:36 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:37.179590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4185017c-1dfc-44e7-895d-53ae51526f65 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:37.180237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4185017c-1dfc-44e7-895d-53ae51526f65 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:37.186408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4185017c-1dfc-44e7-895d-53ae51526f65 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:37.186854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4185017c-1dfc-44e7-895d-53ae51526f65 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:37.187644 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4185017c-1dfc-44e7-895d-53ae51526f65 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:37.188083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4185017c-1dfc-44e7-895d-53ae51526f65 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:37.314424 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4185017c-1dfc-44e7-895d-53ae51526f65 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:37.322195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4185017c-1dfc-44e7-895d-53ae51526f65 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.257957 May 10 21:36:37.322766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2302/3078] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:37 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:37.737830 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-60fc3cb9-2064-45bd-91fe-ece165d2dd07 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:37.738451 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-60fc3cb9-2064-45bd-91fe-ece165d2dd07 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:37.744378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-60fc3cb9-2064-45bd-91fe-ece165d2dd07 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:37.744828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-60fc3cb9-2064-45bd-91fe-ece165d2dd07 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:37.745589 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-60fc3cb9-2064-45bd-91fe-ece165d2dd07 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:37.746187 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-60fc3cb9-2064-45bd-91fe-ece165d2dd07 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:37.876342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-60fc3cb9-2064-45bd-91fe-ece165d2dd07 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:37.884065 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-60fc3cb9-2064-45bd-91fe-ece165d2dd07 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150110 May 10 21:36:37.884633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2303/3079] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:37 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:38.077738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-356f443f-8d67-4b34-b815-49a4acf2183d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:38.078346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-356f443f-8d67-4b34-b815-49a4acf2183d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:38.084662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-356f443f-8d67-4b34-b815-49a4acf2183d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:38.085110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-356f443f-8d67-4b34-b815-49a4acf2183d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:38.085868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-356f443f-8d67-4b34-b815-49a4acf2183d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:38.086335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-356f443f-8d67-4b34-b815-49a4acf2183d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:38.212646 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-356f443f-8d67-4b34-b815-49a4acf2183d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:38.222809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-356f443f-8d67-4b34-b815-49a4acf2183d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149452 May 10 21:36:38.223421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2304/3080] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:38 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:38.339988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1dd953db-2eed-4459-95b7-4b9d60d42ef5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:38.340601 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1dd953db-2eed-4459-95b7-4b9d60d42ef5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:38.346792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1dd953db-2eed-4459-95b7-4b9d60d42ef5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:38.347268 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1dd953db-2eed-4459-95b7-4b9d60d42ef5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:38.348037 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1dd953db-2eed-4459-95b7-4b9d60d42ef5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:38.348478 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1dd953db-2eed-4459-95b7-4b9d60d42ef5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:38.482072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1dd953db-2eed-4459-95b7-4b9d60d42ef5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:38.489750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1dd953db-2eed-4459-95b7-4b9d60d42ef5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.153880 May 10 21:36:38.490315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2305/3081] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:38 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:38.901996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-23e34df5-237e-4e73-ad08-b5a7d4a71e66 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:38.902692 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-23e34df5-237e-4e73-ad08-b5a7d4a71e66 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:38.908543 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-23e34df5-237e-4e73-ad08-b5a7d4a71e66 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:38.909007 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-23e34df5-237e-4e73-ad08-b5a7d4a71e66 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:38.909747 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-23e34df5-237e-4e73-ad08-b5a7d4a71e66 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:38.910184 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-23e34df5-237e-4e73-ad08-b5a7d4a71e66 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:39.038137 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-23e34df5-237e-4e73-ad08-b5a7d4a71e66 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:39.045874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-23e34df5-237e-4e73-ad08-b5a7d4a71e66 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.147741 May 10 21:36:39.046428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2306/3082] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:38 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:39.240274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-44452633-6d27-4f42-b083-2c143ebe6207 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:39.240818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-44452633-6d27-4f42-b083-2c143ebe6207 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:39.248035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44452633-6d27-4f42-b083-2c143ebe6207 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:39.248495 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44452633-6d27-4f42-b083-2c143ebe6207 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:39.249271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44452633-6d27-4f42-b083-2c143ebe6207 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:39.249723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44452633-6d27-4f42-b083-2c143ebe6207 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:39.383293 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-44452633-6d27-4f42-b083-2c143ebe6207 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:39.391849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-44452633-6d27-4f42-b083-2c143ebe6207 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.155614 May 10 21:36:39.392403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2307/3083] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:39 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:39.506781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5aaa2a78-d6f0-4232-a57b-35ef27fdf081 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:39.507353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5aaa2a78-d6f0-4232-a57b-35ef27fdf081 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:39.514008 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5aaa2a78-d6f0-4232-a57b-35ef27fdf081 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:39.514458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5aaa2a78-d6f0-4232-a57b-35ef27fdf081 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:39.515261 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5aaa2a78-d6f0-4232-a57b-35ef27fdf081 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:39.515703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5aaa2a78-d6f0-4232-a57b-35ef27fdf081 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:39.643329 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5aaa2a78-d6f0-4232-a57b-35ef27fdf081 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:39.650974 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5aaa2a78-d6f0-4232-a57b-35ef27fdf081 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148044 May 10 21:36:39.651558 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2308/3084] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:39 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:40.062057 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7ad69b1a-aeaf-453d-be82-6826919b6b5d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:40.062736 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7ad69b1a-aeaf-453d-be82-6826919b6b5d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:40.068561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ad69b1a-aeaf-453d-be82-6826919b6b5d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:40.069014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ad69b1a-aeaf-453d-be82-6826919b6b5d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:40.069766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ad69b1a-aeaf-453d-be82-6826919b6b5d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:40.070201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ad69b1a-aeaf-453d-be82-6826919b6b5d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:40.197829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7ad69b1a-aeaf-453d-be82-6826919b6b5d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:40.206119 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7ad69b1a-aeaf-453d-be82-6826919b6b5d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148188 May 10 21:36:40.206681 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2309/3085] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:40 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:40.408760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-aba12777-d6e2-437f-bc74-b9304d48d9df tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:40.409379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-aba12777-d6e2-437f-bc74-b9304d48d9df tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:40.415728 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aba12777-d6e2-437f-bc74-b9304d48d9df tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:40.416189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aba12777-d6e2-437f-bc74-b9304d48d9df tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:40.416960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aba12777-d6e2-437f-bc74-b9304d48d9df tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:40.417406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aba12777-d6e2-437f-bc74-b9304d48d9df tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:40.549376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-aba12777-d6e2-437f-bc74-b9304d48d9df tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:40.557255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-aba12777-d6e2-437f-bc74-b9304d48d9df tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.152287 May 10 21:36:40.557819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2310/3086] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:40 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:40.668975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1ba5919d-9295-4247-8d7d-1270410bc495 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:40.669559 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1ba5919d-9295-4247-8d7d-1270410bc495 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:40.675523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1ba5919d-9295-4247-8d7d-1270410bc495 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:40.675974 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1ba5919d-9295-4247-8d7d-1270410bc495 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:40.676734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1ba5919d-9295-4247-8d7d-1270410bc495 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:40.677173 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1ba5919d-9295-4247-8d7d-1270410bc495 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:40.803562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1ba5919d-9295-4247-8d7d-1270410bc495 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:40.812720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1ba5919d-9295-4247-8d7d-1270410bc495 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148720 May 10 21:36:40.813352 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2311/3087] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:40 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:41.223815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9a8b3f5a-580c-40df-b6ef-fc4e6c6c4626 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:41.224598 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9a8b3f5a-580c-40df-b6ef-fc4e6c6c4626 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:41.230987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9a8b3f5a-580c-40df-b6ef-fc4e6c6c4626 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:41.231470 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9a8b3f5a-580c-40df-b6ef-fc4e6c6c4626 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:41.232255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9a8b3f5a-580c-40df-b6ef-fc4e6c6c4626 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:41.232680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9a8b3f5a-580c-40df-b6ef-fc4e6c6c4626 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:41.366475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9a8b3f5a-580c-40df-b6ef-fc4e6c6c4626 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:41.374473 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9a8b3f5a-580c-40df-b6ef-fc4e6c6c4626 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.154672 May 10 21:36:41.375039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2312/3088] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:41 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:41.575458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ce9e63c4-0397-45ce-a1a6-b7d8c7ba61aa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:41.575993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ce9e63c4-0397-45ce-a1a6-b7d8c7ba61aa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:41.582295 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ce9e63c4-0397-45ce-a1a6-b7d8c7ba61aa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:41.582745 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ce9e63c4-0397-45ce-a1a6-b7d8c7ba61aa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:41.583537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ce9e63c4-0397-45ce-a1a6-b7d8c7ba61aa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:41.583976 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ce9e63c4-0397-45ce-a1a6-b7d8c7ba61aa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:41.710648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ce9e63c4-0397-45ce-a1a6-b7d8c7ba61aa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:41.719364 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ce9e63c4-0397-45ce-a1a6-b7d8c7ba61aa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148329 May 10 21:36:41.719937 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2313/3089] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:41 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:41.830357 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-390c39be-b779-45ff-be6d-ae8f452530bd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:41.830911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-390c39be-b779-45ff-be6d-ae8f452530bd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:41.836790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-390c39be-b779-45ff-be6d-ae8f452530bd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:41.837501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-390c39be-b779-45ff-be6d-ae8f452530bd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:41.838270 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-390c39be-b779-45ff-be6d-ae8f452530bd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:41.838711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-390c39be-b779-45ff-be6d-ae8f452530bd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:41.966481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-390c39be-b779-45ff-be6d-ae8f452530bd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:41.974589 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-390c39be-b779-45ff-be6d-ae8f452530bd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148059 May 10 21:36:41.975174 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2314/3090] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:41 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:42.392243 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2d9cdb2f-ec79-4e94-ab08-808e6d1b31fd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:42.393061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2d9cdb2f-ec79-4e94-ab08-808e6d1b31fd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:42.398776 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d9cdb2f-ec79-4e94-ab08-808e6d1b31fd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:42.399260 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d9cdb2f-ec79-4e94-ab08-808e6d1b31fd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:42.400015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d9cdb2f-ec79-4e94-ab08-808e6d1b31fd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:42.400458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d9cdb2f-ec79-4e94-ab08-808e6d1b31fd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:42.530528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2d9cdb2f-ec79-4e94-ab08-808e6d1b31fd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:42.538283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2d9cdb2f-ec79-4e94-ab08-808e6d1b31fd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150042 May 10 21:36:42.538853 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2315/3091] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:42 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:42.736409 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-87d84a22-45b3-4f1f-9641-d038207393f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:42.736951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-87d84a22-45b3-4f1f-9641-d038207393f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:42.743316 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87d84a22-45b3-4f1f-9641-d038207393f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:42.743762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87d84a22-45b3-4f1f-9641-d038207393f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:42.744511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87d84a22-45b3-4f1f-9641-d038207393f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:42.744947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87d84a22-45b3-4f1f-9641-d038207393f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:42.872388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-87d84a22-45b3-4f1f-9641-d038207393f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:42.880236 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-87d84a22-45b3-4f1f-9641-d038207393f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.147761 May 10 21:36:42.880803 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2316/3092] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:42 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:42.992212 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-499386b5-d75d-4049-9391-ccbce3eb07e2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:42.992862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-499386b5-d75d-4049-9391-ccbce3eb07e2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:42.999549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-499386b5-d75d-4049-9391-ccbce3eb07e2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:42.999995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-499386b5-d75d-4049-9391-ccbce3eb07e2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:43.000750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-499386b5-d75d-4049-9391-ccbce3eb07e2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:43.001185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-499386b5-d75d-4049-9391-ccbce3eb07e2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:43.132047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-499386b5-d75d-4049-9391-ccbce3eb07e2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:43.140345 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-499386b5-d75d-4049-9391-ccbce3eb07e2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.152050 May 10 21:36:43.140911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2317/3093] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:42 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:43.554640 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4a31d3c7-6334-4f37-a6ce-e50c84ffa6c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:43.555361 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4a31d3c7-6334-4f37-a6ce-e50c84ffa6c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:43.562420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a31d3c7-6334-4f37-a6ce-e50c84ffa6c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:43.562875 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a31d3c7-6334-4f37-a6ce-e50c84ffa6c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:43.563687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a31d3c7-6334-4f37-a6ce-e50c84ffa6c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:43.564128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a31d3c7-6334-4f37-a6ce-e50c84ffa6c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:43.691902 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4a31d3c7-6334-4f37-a6ce-e50c84ffa6c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:43.700104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4a31d3c7-6334-4f37-a6ce-e50c84ffa6c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149371 May 10 21:36:43.700671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2318/3094] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:43 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:43.897596 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-113744a0-f086-453d-92ed-275a10e9a1ec tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:43.898213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-113744a0-f086-453d-92ed-275a10e9a1ec tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:43.904691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-113744a0-f086-453d-92ed-275a10e9a1ec tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:43.905142 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-113744a0-f086-453d-92ed-275a10e9a1ec tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:43.905905 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-113744a0-f086-453d-92ed-275a10e9a1ec tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:43.906341 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-113744a0-f086-453d-92ed-275a10e9a1ec tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:44.035444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-113744a0-f086-453d-92ed-275a10e9a1ec tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:44.044654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-113744a0-f086-453d-92ed-275a10e9a1ec tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150858 May 10 21:36:44.045228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2319/3095] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:43 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:44.158445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ac5f6b0d-c655-4fd1-b8a5-a4e3835eb2b6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:44.158991 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ac5f6b0d-c655-4fd1-b8a5-a4e3835eb2b6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:44.164859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ac5f6b0d-c655-4fd1-b8a5-a4e3835eb2b6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:44.165311 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ac5f6b0d-c655-4fd1-b8a5-a4e3835eb2b6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:44.166072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ac5f6b0d-c655-4fd1-b8a5-a4e3835eb2b6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:44.166512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ac5f6b0d-c655-4fd1-b8a5-a4e3835eb2b6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:44.293147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ac5f6b0d-c655-4fd1-b8a5-a4e3835eb2b6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:44.301061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ac5f6b0d-c655-4fd1-b8a5-a4e3835eb2b6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.146419 May 10 21:36:44.301631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2320/3096] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:44 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:44.718778 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d99aeb2c-5744-469f-825e-11fc18ca20d1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:44.719425 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d99aeb2c-5744-469f-825e-11fc18ca20d1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:44.725764 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d99aeb2c-5744-469f-825e-11fc18ca20d1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:44.726219 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d99aeb2c-5744-469f-825e-11fc18ca20d1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:44.726984 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d99aeb2c-5744-469f-825e-11fc18ca20d1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:44.727457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d99aeb2c-5744-469f-825e-11fc18ca20d1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:44.855570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d99aeb2c-5744-469f-825e-11fc18ca20d1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:44.863335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d99aeb2c-5744-469f-825e-11fc18ca20d1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149166 May 10 21:36:44.863832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2321/3097] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:44 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:45.062407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9848abba-7f8f-4c41-85b3-1c61fd26fa8e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:45.063063 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9848abba-7f8f-4c41-85b3-1c61fd26fa8e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:45.069066 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9848abba-7f8f-4c41-85b3-1c61fd26fa8e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:45.069518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9848abba-7f8f-4c41-85b3-1c61fd26fa8e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:45.070313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9848abba-7f8f-4c41-85b3-1c61fd26fa8e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:45.070824 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9848abba-7f8f-4c41-85b3-1c61fd26fa8e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:45.201423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9848abba-7f8f-4c41-85b3-1c61fd26fa8e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:45.209240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9848abba-7f8f-4c41-85b3-1c61fd26fa8e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.151324 May 10 21:36:45.209808 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2322/3098] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:45 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:45.317768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7ce0eb46-3f09-4b31-bf5e-fc8a92c55988 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:45.318375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7ce0eb46-3f09-4b31-bf5e-fc8a92c55988 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:45.324280 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ce0eb46-3f09-4b31-bf5e-fc8a92c55988 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:45.324787 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ce0eb46-3f09-4b31-bf5e-fc8a92c55988 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:45.325547 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ce0eb46-3f09-4b31-bf5e-fc8a92c55988 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:45.325981 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ce0eb46-3f09-4b31-bf5e-fc8a92c55988 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:45.452790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7ce0eb46-3f09-4b31-bf5e-fc8a92c55988 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:45.460652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7ce0eb46-3f09-4b31-bf5e-fc8a92c55988 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.146901 May 10 21:36:45.461221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2323/3099] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:45 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:45.880997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ee6221d0-9a67-4c21-9cf2-fb63e8126b50 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:45.881641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ee6221d0-9a67-4c21-9cf2-fb63e8126b50 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:45.888600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee6221d0-9a67-4c21-9cf2-fb63e8126b50 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:45.889047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee6221d0-9a67-4c21-9cf2-fb63e8126b50 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:45.889797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee6221d0-9a67-4c21-9cf2-fb63e8126b50 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:45.890231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee6221d0-9a67-4c21-9cf2-fb63e8126b50 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:46.021449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ee6221d0-9a67-4c21-9cf2-fb63e8126b50 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:46.029268 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ee6221d0-9a67-4c21-9cf2-fb63e8126b50 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.152119 May 10 21:36:46.029838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2324/3100] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:45 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:46.226829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a1062182-d24b-453f-8657-6b148746c5f4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:46.227407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a1062182-d24b-453f-8657-6b148746c5f4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:46.233825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a1062182-d24b-453f-8657-6b148746c5f4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:46.234275 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a1062182-d24b-453f-8657-6b148746c5f4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:46.235044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a1062182-d24b-453f-8657-6b148746c5f4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:46.235502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a1062182-d24b-453f-8657-6b148746c5f4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:46.362000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a1062182-d24b-453f-8657-6b148746c5f4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:46.369730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a1062182-d24b-453f-8657-6b148746c5f4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.146883 May 10 21:36:46.370295 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2325/3101] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:46 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:46.477652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bff57274-f595-4feb-98aa-045eb71da0fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:46.478193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bff57274-f595-4feb-98aa-045eb71da0fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:46.484185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bff57274-f595-4feb-98aa-045eb71da0fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:46.484641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bff57274-f595-4feb-98aa-045eb71da0fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:46.485405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bff57274-f595-4feb-98aa-045eb71da0fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:46.485848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bff57274-f595-4feb-98aa-045eb71da0fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:46.610165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bff57274-f595-4feb-98aa-045eb71da0fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:46.618228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bff57274-f595-4feb-98aa-045eb71da0fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.144436 May 10 21:36:46.618798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2326/3102] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:46 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:47.047159 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-68751993-9254-45b8-8ad0-951f1a1d1487 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:47.047804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-68751993-9254-45b8-8ad0-951f1a1d1487 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:47.054265 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-68751993-9254-45b8-8ad0-951f1a1d1487 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:47.054708 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-68751993-9254-45b8-8ad0-951f1a1d1487 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:47.055498 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-68751993-9254-45b8-8ad0-951f1a1d1487 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:47.055930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-68751993-9254-45b8-8ad0-951f1a1d1487 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:47.185032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-68751993-9254-45b8-8ad0-951f1a1d1487 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:47.193349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-68751993-9254-45b8-8ad0-951f1a1d1487 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151137 May 10 21:36:47.193910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2327/3103] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:47 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:47.387569 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a9496bc9-fbf6-476b-bbfa-59f058662cf6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:47.388187 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a9496bc9-fbf6-476b-bbfa-59f058662cf6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:47.394933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a9496bc9-fbf6-476b-bbfa-59f058662cf6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:47.395421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a9496bc9-fbf6-476b-bbfa-59f058662cf6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:47.396184 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a9496bc9-fbf6-476b-bbfa-59f058662cf6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:47.396625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a9496bc9-fbf6-476b-bbfa-59f058662cf6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:47.523718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a9496bc9-fbf6-476b-bbfa-59f058662cf6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:47.532275 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a9496bc9-fbf6-476b-bbfa-59f058662cf6 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148559 May 10 21:36:47.532842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2328/3104] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:47 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:47.635876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bbe252f4-21e7-491f-9ae9-5632abc15924 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:47.636487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bbe252f4-21e7-491f-9ae9-5632abc15924 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:47.644365 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bbe252f4-21e7-491f-9ae9-5632abc15924 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:47.644365 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bbe252f4-21e7-491f-9ae9-5632abc15924 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:47.644365 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bbe252f4-21e7-491f-9ae9-5632abc15924 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:47.644883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bbe252f4-21e7-491f-9ae9-5632abc15924 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:47.773958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bbe252f4-21e7-491f-9ae9-5632abc15924 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:47.781667 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bbe252f4-21e7-491f-9ae9-5632abc15924 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149777 May 10 21:36:47.782225 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2329/3105] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:47 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:48.209777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a8c4aa08-7e38-4ea6-b65b-d87201b5c25f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:48.210461 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a8c4aa08-7e38-4ea6-b65b-d87201b5c25f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:48.217048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a8c4aa08-7e38-4ea6-b65b-d87201b5c25f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:48.217498 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a8c4aa08-7e38-4ea6-b65b-d87201b5c25f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:48.218254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a8c4aa08-7e38-4ea6-b65b-d87201b5c25f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:48.218690 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a8c4aa08-7e38-4ea6-b65b-d87201b5c25f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:48.344958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a8c4aa08-7e38-4ea6-b65b-d87201b5c25f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:48.352703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a8c4aa08-7e38-4ea6-b65b-d87201b5c25f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.146872 May 10 21:36:48.353271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2330/3106] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:48 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:48.550590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8fcd38e2-98f1-4504-af2c-79484babf4fb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:48.551159 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8fcd38e2-98f1-4504-af2c-79484babf4fb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:48.557061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8fcd38e2-98f1-4504-af2c-79484babf4fb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:48.557510 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8fcd38e2-98f1-4504-af2c-79484babf4fb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:48.558268 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8fcd38e2-98f1-4504-af2c-79484babf4fb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:48.558708 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8fcd38e2-98f1-4504-af2c-79484babf4fb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:48.689700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8fcd38e2-98f1-4504-af2c-79484babf4fb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:48.697374 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8fcd38e2-98f1-4504-af2c-79484babf4fb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150646 May 10 21:36:48.697941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2331/3107] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:48 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:48.798534 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3355cde5-1125-423f-8e02-f96e50fc2ea4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:48.799173 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3355cde5-1125-423f-8e02-f96e50fc2ea4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:48.805133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3355cde5-1125-423f-8e02-f96e50fc2ea4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:48.805535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3355cde5-1125-423f-8e02-f96e50fc2ea4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:48.806298 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3355cde5-1125-423f-8e02-f96e50fc2ea4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:48.806736 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3355cde5-1125-423f-8e02-f96e50fc2ea4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:48.932554 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3355cde5-1125-423f-8e02-f96e50fc2ea4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:48.940778 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3355cde5-1125-423f-8e02-f96e50fc2ea4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147050 May 10 21:36:48.941348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2332/3108] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:48 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:49.370425 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f18ca58c-0c50-443a-8af7-930fff73c022 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:49.371085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f18ca58c-0c50-443a-8af7-930fff73c022 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:49.377928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f18ca58c-0c50-443a-8af7-930fff73c022 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:49.378378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f18ca58c-0c50-443a-8af7-930fff73c022 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:49.379145 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f18ca58c-0c50-443a-8af7-930fff73c022 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:49.379585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f18ca58c-0c50-443a-8af7-930fff73c022 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:49.505952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f18ca58c-0c50-443a-8af7-930fff73c022 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:49.514349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f18ca58c-0c50-443a-8af7-930fff73c022 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.147388 May 10 21:36:49.514906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2333/3109] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:49 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:49.715357 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0bd260c2-0238-4dae-bae1-f0c9034b4e8f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:49.715917 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0bd260c2-0238-4dae-bae1-f0c9034b4e8f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:49.721997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0bd260c2-0238-4dae-bae1-f0c9034b4e8f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:49.722451 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0bd260c2-0238-4dae-bae1-f0c9034b4e8f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:49.723248 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0bd260c2-0238-4dae-bae1-f0c9034b4e8f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:49.723700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0bd260c2-0238-4dae-bae1-f0c9034b4e8f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:49.852414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0bd260c2-0238-4dae-bae1-f0c9034b4e8f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:49.861310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0bd260c2-0238-4dae-bae1-f0c9034b4e8f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150193 May 10 21:36:49.861874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2334/3110] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:49 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:49.958053 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0e7b89b5-1c35-4928-9942-5ee18f79d1ca tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:49.958665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0e7b89b5-1c35-4928-9942-5ee18f79d1ca tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:49.964767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0e7b89b5-1c35-4928-9942-5ee18f79d1ca tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:49.965218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0e7b89b5-1c35-4928-9942-5ee18f79d1ca tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:49.966029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0e7b89b5-1c35-4928-9942-5ee18f79d1ca tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:49.966414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0e7b89b5-1c35-4928-9942-5ee18f79d1ca tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:50.094457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0e7b89b5-1c35-4928-9942-5ee18f79d1ca tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:50.102147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0e7b89b5-1c35-4928-9942-5ee18f79d1ca tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147793 May 10 21:36:50.102699 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2335/3111] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:49 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:50.531421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-46b904fe-d6b0-4f38-9b89-593d413d88ad tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:50.532149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-46b904fe-d6b0-4f38-9b89-593d413d88ad tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:50.538571 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-46b904fe-d6b0-4f38-9b89-593d413d88ad tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:50.539108 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-46b904fe-d6b0-4f38-9b89-593d413d88ad tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:50.539906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-46b904fe-d6b0-4f38-9b89-593d413d88ad tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:50.540346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-46b904fe-d6b0-4f38-9b89-593d413d88ad tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:50.673334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-46b904fe-d6b0-4f38-9b89-593d413d88ad tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:50.681190 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-46b904fe-d6b0-4f38-9b89-593d413d88ad tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.153877 May 10 21:36:50.681763 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2336/3112] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:50 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:50.877811 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9c76047c-47f7-4132-ab0f-de2a6a115d65 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:50.878353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9c76047c-47f7-4132-ab0f-de2a6a115d65 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:50.884428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c76047c-47f7-4132-ab0f-de2a6a115d65 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:50.884887 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c76047c-47f7-4132-ab0f-de2a6a115d65 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:50.885659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c76047c-47f7-4132-ab0f-de2a6a115d65 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:50.886103 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c76047c-47f7-4132-ab0f-de2a6a115d65 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:51.015191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9c76047c-47f7-4132-ab0f-de2a6a115d65 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:51.023059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9c76047c-47f7-4132-ab0f-de2a6a115d65 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149257 May 10 21:36:51.023656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2337/3113] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:50 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:51.118359 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6166a14a-b5bc-4b1d-86f9-f399fbfbe44e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:51.118966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6166a14a-b5bc-4b1d-86f9-f399fbfbe44e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:51.124969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6166a14a-b5bc-4b1d-86f9-f399fbfbe44e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:51.125427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6166a14a-b5bc-4b1d-86f9-f399fbfbe44e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:51.126185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6166a14a-b5bc-4b1d-86f9-f399fbfbe44e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:51.126619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6166a14a-b5bc-4b1d-86f9-f399fbfbe44e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:51.256944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6166a14a-b5bc-4b1d-86f9-f399fbfbe44e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:51.264718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6166a14a-b5bc-4b1d-86f9-f399fbfbe44e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150148 May 10 21:36:51.266696 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2338/3114] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:51 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:51.699046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b4c135d2-05e3-4bf3-ad94-b89817d8c825 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:51.699683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b4c135d2-05e3-4bf3-ad94-b89817d8c825 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:51.706506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b4c135d2-05e3-4bf3-ad94-b89817d8c825 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:51.706958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b4c135d2-05e3-4bf3-ad94-b89817d8c825 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:51.707755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b4c135d2-05e3-4bf3-ad94-b89817d8c825 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:51.708193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b4c135d2-05e3-4bf3-ad94-b89817d8c825 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:51.837131 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b4c135d2-05e3-4bf3-ad94-b89817d8c825 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:51.845671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b4c135d2-05e3-4bf3-ad94-b89817d8c825 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150510 May 10 21:36:51.846236 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2339/3115] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:51 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:52.040368 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fe2b02fa-a5ef-4b33-878e-c893b9e9e77d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:52.040892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fe2b02fa-a5ef-4b33-878e-c893b9e9e77d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:52.047599 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fe2b02fa-a5ef-4b33-878e-c893b9e9e77d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:52.048051 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fe2b02fa-a5ef-4b33-878e-c893b9e9e77d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:52.048827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fe2b02fa-a5ef-4b33-878e-c893b9e9e77d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:52.049271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fe2b02fa-a5ef-4b33-878e-c893b9e9e77d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:52.174771 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fe2b02fa-a5ef-4b33-878e-c893b9e9e77d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:52.182505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fe2b02fa-a5ef-4b33-878e-c893b9e9e77d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.146091 May 10 21:36:52.183070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2340/3116] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:52 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:52.282940 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2d0c48e1-dfbf-46d0-b231-7c965db28646 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:52.283572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2d0c48e1-dfbf-46d0-b231-7c965db28646 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:52.289451 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d0c48e1-dfbf-46d0-b231-7c965db28646 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:52.289904 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d0c48e1-dfbf-46d0-b231-7c965db28646 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:52.290709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d0c48e1-dfbf-46d0-b231-7c965db28646 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:52.291092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d0c48e1-dfbf-46d0-b231-7c965db28646 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:52.419871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2d0c48e1-dfbf-46d0-b231-7c965db28646 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:52.427868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2d0c48e1-dfbf-46d0-b231-7c965db28646 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149378 May 10 21:36:52.428444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2341/3117] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:52 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:52.863057 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-573e4804-b4d3-4566-8902-e81ecabe5675 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:52.863716 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-573e4804-b4d3-4566-8902-e81ecabe5675 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:52.870051 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-573e4804-b4d3-4566-8902-e81ecabe5675 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:52.870487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-573e4804-b4d3-4566-8902-e81ecabe5675 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:52.871279 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-573e4804-b4d3-4566-8902-e81ecabe5675 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:52.871721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-573e4804-b4d3-4566-8902-e81ecabe5675 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:52.998938 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-573e4804-b4d3-4566-8902-e81ecabe5675 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:53.007407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-573e4804-b4d3-4566-8902-e81ecabe5675 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148509 May 10 21:36:53.007980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2342/3118] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:52 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:53.200630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0d23764f-d840-4864-8ef6-e35584d63074 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:53.201164 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0d23764f-d840-4864-8ef6-e35584d63074 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:53.208194 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d23764f-d840-4864-8ef6-e35584d63074 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:53.208651 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d23764f-d840-4864-8ef6-e35584d63074 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:53.209413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d23764f-d840-4864-8ef6-e35584d63074 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:53.209850 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d23764f-d840-4864-8ef6-e35584d63074 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:53.354932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0d23764f-d840-4864-8ef6-e35584d63074 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:53.362959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0d23764f-d840-4864-8ef6-e35584d63074 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.166227 May 10 21:36:53.363549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2343/3119] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:53 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:53.444930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-628c4721-974c-4ea0-a8d5-6809468b14dd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:53.445529 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-628c4721-974c-4ea0-a8d5-6809468b14dd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:53.451313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-628c4721-974c-4ea0-a8d5-6809468b14dd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:53.451704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-628c4721-974c-4ea0-a8d5-6809468b14dd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:53.452942 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-628c4721-974c-4ea0-a8d5-6809468b14dd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:53.453381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-628c4721-974c-4ea0-a8d5-6809468b14dd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:53.580367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-628c4721-974c-4ea0-a8d5-6809468b14dd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:53.588312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-628c4721-974c-4ea0-a8d5-6809468b14dd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147004 May 10 21:36:53.588857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2344/3120] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:53 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:54.025260 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-552c1ea6-c5c0-4a6b-9310-cf87e7b6da1e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:54.025941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-552c1ea6-c5c0-4a6b-9310-cf87e7b6da1e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:54.032240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-552c1ea6-c5c0-4a6b-9310-cf87e7b6da1e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:54.032692 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-552c1ea6-c5c0-4a6b-9310-cf87e7b6da1e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:54.033462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-552c1ea6-c5c0-4a6b-9310-cf87e7b6da1e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:54.033897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-552c1ea6-c5c0-4a6b-9310-cf87e7b6da1e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:54.159082 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-552c1ea6-c5c0-4a6b-9310-cf87e7b6da1e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:54.166829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-552c1ea6-c5c0-4a6b-9310-cf87e7b6da1e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.145501 May 10 21:36:54.167439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2345/3121] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:54 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:54.379713 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ba47e17b-9201-402b-9a46-81a5a016dd59 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:54.380322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ba47e17b-9201-402b-9a46-81a5a016dd59 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:54.386185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ba47e17b-9201-402b-9a46-81a5a016dd59 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:54.386640 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ba47e17b-9201-402b-9a46-81a5a016dd59 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:54.387428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ba47e17b-9201-402b-9a46-81a5a016dd59 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:54.387867 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ba47e17b-9201-402b-9a46-81a5a016dd59 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:54.521312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ba47e17b-9201-402b-9a46-81a5a016dd59 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:54.529281 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ba47e17b-9201-402b-9a46-81a5a016dd59 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.153402 May 10 21:36:54.529844 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2346/3122] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:54 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:54.606411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-24a4dc0e-24e1-4f60-ab0b-1684f1d8c461 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:54.607174 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-24a4dc0e-24e1-4f60-ab0b-1684f1d8c461 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:54.613203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-24a4dc0e-24e1-4f60-ab0b-1684f1d8c461 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:54.618685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-24a4dc0e-24e1-4f60-ab0b-1684f1d8c461 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:54.618685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-24a4dc0e-24e1-4f60-ab0b-1684f1d8c461 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:54.618685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-24a4dc0e-24e1-4f60-ab0b-1684f1d8c461 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:54.745713 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-24a4dc0e-24e1-4f60-ab0b-1684f1d8c461 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:54.754079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-24a4dc0e-24e1-4f60-ab0b-1684f1d8c461 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.152081 May 10 21:36:54.754641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2347/3123] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:54 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:36:55.184063 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ca885197-76fa-44f1-a53c-af3cd8b05110 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:55.184777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ca885197-76fa-44f1-a53c-af3cd8b05110 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:55.196736 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ca885197-76fa-44f1-a53c-af3cd8b05110 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:55.197184 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ca885197-76fa-44f1-a53c-af3cd8b05110 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:55.197944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ca885197-76fa-44f1-a53c-af3cd8b05110 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:55.198379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ca885197-76fa-44f1-a53c-af3cd8b05110 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:55.330908 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ca885197-76fa-44f1-a53c-af3cd8b05110 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:55.338906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ca885197-76fa-44f1-a53c-af3cd8b05110 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.158731 May 10 21:36:55.339504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2348/3124] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:55 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:55.546960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bbb377c0-2847-4914-bafe-fad505b2ddf3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:55.547565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bbb377c0-2847-4914-bafe-fad505b2ddf3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:55.553718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bbb377c0-2847-4914-bafe-fad505b2ddf3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:55.554175 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bbb377c0-2847-4914-bafe-fad505b2ddf3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:55.554953 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bbb377c0-2847-4914-bafe-fad505b2ddf3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:55.555454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bbb377c0-2847-4914-bafe-fad505b2ddf3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:55.684091 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bbb377c0-2847-4914-bafe-fad505b2ddf3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:55.692019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bbb377c0-2847-4914-bafe-fad505b2ddf3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149625 May 10 21:36:55.692581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2349/3125] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:55 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:55.770399 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3dee9aa1-14b3-430c-acef-6347a56a4a4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:55.771006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3dee9aa1-14b3-430c-acef-6347a56a4a4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:55.776798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3dee9aa1-14b3-430c-acef-6347a56a4a4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:55.777242 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3dee9aa1-14b3-430c-acef-6347a56a4a4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:55.777993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3dee9aa1-14b3-430c-acef-6347a56a4a4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:55.778426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3dee9aa1-14b3-430c-acef-6347a56a4a4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:55.904251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3dee9aa1-14b3-430c-acef-6347a56a4a4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:55.912718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3dee9aa1-14b3-430c-acef-6347a56a4a4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.146064 May 10 21:36:55.913282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2350/3126] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:55 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:56.355903 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b5cb8e61-aaae-4a5c-9793-acd6394c82b1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:56.356518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b5cb8e61-aaae-4a5c-9793-acd6394c82b1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:56.363952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5cb8e61-aaae-4a5c-9793-acd6394c82b1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:56.364404 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5cb8e61-aaae-4a5c-9793-acd6394c82b1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:56.365168 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5cb8e61-aaae-4a5c-9793-acd6394c82b1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:56.365608 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5cb8e61-aaae-4a5c-9793-acd6394c82b1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:56.495758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b5cb8e61-aaae-4a5c-9793-acd6394c82b1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:56.504373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b5cb8e61-aaae-4a5c-9793-acd6394c82b1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.152376 May 10 21:36:56.505109 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2351/3127] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:56 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:56.709397 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6ed41d61-3377-4060-94a2-074b65c1f7dc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:56.710010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6ed41d61-3377-4060-94a2-074b65c1f7dc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:56.716219 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6ed41d61-3377-4060-94a2-074b65c1f7dc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:56.716673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6ed41d61-3377-4060-94a2-074b65c1f7dc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:56.717433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6ed41d61-3377-4060-94a2-074b65c1f7dc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:56.717879 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6ed41d61-3377-4060-94a2-074b65c1f7dc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:56.901899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6ed41d61-3377-4060-94a2-074b65c1f7dc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:56.911734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6ed41d61-3377-4060-94a2-074b65c1f7dc tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.206284 May 10 21:36:56.912299 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2352/3128] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:56 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:56.929230 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9ea2cc13-6e41-46f4-b307-7b9ea19bf53e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:56.929835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9ea2cc13-6e41-46f4-b307-7b9ea19bf53e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:56.935717 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ea2cc13-6e41-46f4-b307-7b9ea19bf53e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:56.936163 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ea2cc13-6e41-46f4-b307-7b9ea19bf53e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:56.937007 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ea2cc13-6e41-46f4-b307-7b9ea19bf53e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:56.937604 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9ea2cc13-6e41-46f4-b307-7b9ea19bf53e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:57.066332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9ea2cc13-6e41-46f4-b307-7b9ea19bf53e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:57.074134 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9ea2cc13-6e41-46f4-b307-7b9ea19bf53e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148549 May 10 21:36:57.074702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2353/3129] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:56 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:57.522139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-63ee0aef-688b-4a6e-b587-179712e36365 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:57.522887 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-63ee0aef-688b-4a6e-b587-179712e36365 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:57.529174 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-63ee0aef-688b-4a6e-b587-179712e36365 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:57.529626 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-63ee0aef-688b-4a6e-b587-179712e36365 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:57.530392 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-63ee0aef-688b-4a6e-b587-179712e36365 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:57.531397 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-63ee0aef-688b-4a6e-b587-179712e36365 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:57.662217 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-63ee0aef-688b-4a6e-b587-179712e36365 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:57.670018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-63ee0aef-688b-4a6e-b587-179712e36365 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151737 May 10 21:36:57.670581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2354/3130] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:57 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:57.929778 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1428386b-f97e-4127-bdce-b93ce73c0ff9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:57.930387 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1428386b-f97e-4127-bdce-b93ce73c0ff9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:57.936344 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1428386b-f97e-4127-bdce-b93ce73c0ff9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:57.936795 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1428386b-f97e-4127-bdce-b93ce73c0ff9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:57.937682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1428386b-f97e-4127-bdce-b93ce73c0ff9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:57.938112 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1428386b-f97e-4127-bdce-b93ce73c0ff9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:58.067050 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1428386b-f97e-4127-bdce-b93ce73c0ff9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:58.074774 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1428386b-f97e-4127-bdce-b93ce73c0ff9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148765 May 10 21:36:58.075375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2355/3131] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:57 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:58.091373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a5aa82d6-d71f-453f-bbee-08dddcbe1c18 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:58.091982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a5aa82d6-d71f-453f-bbee-08dddcbe1c18 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:58.098214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a5aa82d6-d71f-453f-bbee-08dddcbe1c18 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:58.098668 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a5aa82d6-d71f-453f-bbee-08dddcbe1c18 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:58.099460 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a5aa82d6-d71f-453f-bbee-08dddcbe1c18 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:58.099903 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a5aa82d6-d71f-453f-bbee-08dddcbe1c18 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:58.462018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a5aa82d6-d71f-453f-bbee-08dddcbe1c18 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:58.470097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a5aa82d6-d71f-453f-bbee-08dddcbe1c18 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.382545 May 10 21:36:58.470674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2356/3132] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:58 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:58.687972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8e1a154b-1f4b-44ae-91c8-596f9a933ec0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:58.688598 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8e1a154b-1f4b-44ae-91c8-596f9a933ec0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:58.694886 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e1a154b-1f4b-44ae-91c8-596f9a933ec0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:58.695396 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e1a154b-1f4b-44ae-91c8-596f9a933ec0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:58.696168 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e1a154b-1f4b-44ae-91c8-596f9a933ec0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:58.696612 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e1a154b-1f4b-44ae-91c8-596f9a933ec0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:58.824446 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8e1a154b-1f4b-44ae-91c8-596f9a933ec0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:58.832272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8e1a154b-1f4b-44ae-91c8-596f9a933ec0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149064 May 10 21:36:58.832849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2357/3133] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:58 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:59.092304 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6da09828-a577-4d06-8218-f1fccdbecafd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:59.093426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6da09828-a577-4d06-8218-f1fccdbecafd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:59.099414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6da09828-a577-4d06-8218-f1fccdbecafd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:59.099862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6da09828-a577-4d06-8218-f1fccdbecafd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:59.100615 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6da09828-a577-4d06-8218-f1fccdbecafd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:59.101045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6da09828-a577-4d06-8218-f1fccdbecafd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:59.228410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6da09828-a577-4d06-8218-f1fccdbecafd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:59.237151 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6da09828-a577-4d06-8218-f1fccdbecafd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148739 May 10 21:36:59.237719 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2358/3134] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:59 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:59.487222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-843af313-ab24-4c31-ad05-4d6a446d1c47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:59.487750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-843af313-ab24-4c31-ad05-4d6a446d1c47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:59.493709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-843af313-ab24-4c31-ad05-4d6a446d1c47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:59.494155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-843af313-ab24-4c31-ad05-4d6a446d1c47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:59.494915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-843af313-ab24-4c31-ad05-4d6a446d1c47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:59.495383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-843af313-ab24-4c31-ad05-4d6a446d1c47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:59.623149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-843af313-ab24-4c31-ad05-4d6a446d1c47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:59.631082 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-843af313-ab24-4c31-ad05-4d6a446d1c47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148025 May 10 21:36:59.631672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2359/3135] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:59 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:36:59.849372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-98ad6555-db8e-41b3-b793-c56090fb326e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:36:59.849998 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-98ad6555-db8e-41b3-b793-c56090fb326e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:36:59.856348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-98ad6555-db8e-41b3-b793-c56090fb326e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:59.856801 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-98ad6555-db8e-41b3-b793-c56090fb326e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:59.857561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-98ad6555-db8e-41b3-b793-c56090fb326e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:36:59.857999 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-98ad6555-db8e-41b3-b793-c56090fb326e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:36:59.988439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-98ad6555-db8e-41b3-b793-c56090fb326e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:36:59.996253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-98ad6555-db8e-41b3-b793-c56090fb326e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150706 May 10 21:36:59.996830 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2360/3136] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:36:59 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:00.254837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2e10a106-cd96-4087-a385-f5b0f5c4a0a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:00.255406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2e10a106-cd96-4087-a385-f5b0f5c4a0a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:00.261370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e10a106-cd96-4087-a385-f5b0f5c4a0a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:00.261820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e10a106-cd96-4087-a385-f5b0f5c4a0a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:00.262573 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e10a106-cd96-4087-a385-f5b0f5c4a0a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:00.263044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e10a106-cd96-4087-a385-f5b0f5c4a0a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:00.387633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2e10a106-cd96-4087-a385-f5b0f5c4a0a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:00.395429 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2e10a106-cd96-4087-a385-f5b0f5c4a0a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.144539 May 10 21:37:00.396000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2361/3137] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:00 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:00.648503 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c5c65144-03f1-4391-b8c7-36457473480e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:00.649277 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c5c65144-03f1-4391-b8c7-36457473480e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:00.655266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5c65144-03f1-4391-b8c7-36457473480e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:00.657171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5c65144-03f1-4391-b8c7-36457473480e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:00.657171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5c65144-03f1-4391-b8c7-36457473480e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:00.657171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5c65144-03f1-4391-b8c7-36457473480e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:00.785375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c5c65144-03f1-4391-b8c7-36457473480e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:00.793107 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c5c65144-03f1-4391-b8c7-36457473480e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148448 May 10 21:37:00.793673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2362/3138] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:00 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:01.014182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-406b9e97-d908-400a-9b50-e344118d7a7c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:01.015001 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-406b9e97-d908-400a-9b50-e344118d7a7c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:01.021396 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-406b9e97-d908-400a-9b50-e344118d7a7c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:01.021842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-406b9e97-d908-400a-9b50-e344118d7a7c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:01.022631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-406b9e97-d908-400a-9b50-e344118d7a7c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:01.023182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-406b9e97-d908-400a-9b50-e344118d7a7c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:01.150588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-406b9e97-d908-400a-9b50-e344118d7a7c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:01.158772 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-406b9e97-d908-400a-9b50-e344118d7a7c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148436 May 10 21:37:01.159367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2363/3139] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:01 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:01.412787 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c9c8235b-3355-457b-82e6-b2409776f483 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:01.413395 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c9c8235b-3355-457b-82e6-b2409776f483 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:01.419352 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9c8235b-3355-457b-82e6-b2409776f483 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:01.419799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9c8235b-3355-457b-82e6-b2409776f483 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:01.420557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9c8235b-3355-457b-82e6-b2409776f483 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:01.421016 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9c8235b-3355-457b-82e6-b2409776f483 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:01.547373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c9c8235b-3355-457b-82e6-b2409776f483 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:01.555262 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c9c8235b-3355-457b-82e6-b2409776f483 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.146358 May 10 21:37:01.555856 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2364/3140] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:01 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:01.809771 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c7fdcb9f-cc1d-40e5-ac17-42a46e29f2e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:01.810316 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c7fdcb9f-cc1d-40e5-ac17-42a46e29f2e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:01.817063 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c7fdcb9f-cc1d-40e5-ac17-42a46e29f2e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:01.817521 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c7fdcb9f-cc1d-40e5-ac17-42a46e29f2e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:01.818292 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c7fdcb9f-cc1d-40e5-ac17-42a46e29f2e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:01.818738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c7fdcb9f-cc1d-40e5-ac17-42a46e29f2e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:01.950321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c7fdcb9f-cc1d-40e5-ac17-42a46e29f2e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:01.958480 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c7fdcb9f-cc1d-40e5-ac17-42a46e29f2e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.152636 May 10 21:37:01.959047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2365/3141] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:01 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:02.175259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-38b7f678-fc9d-410e-a577-e6de0bae02b8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:02.176065 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-38b7f678-fc9d-410e-a577-e6de0bae02b8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:02.183110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38b7f678-fc9d-410e-a577-e6de0bae02b8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:02.183592 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38b7f678-fc9d-410e-a577-e6de0bae02b8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:02.184366 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38b7f678-fc9d-410e-a577-e6de0bae02b8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:02.184817 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38b7f678-fc9d-410e-a577-e6de0bae02b8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:02.310533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-38b7f678-fc9d-410e-a577-e6de0bae02b8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:02.319217 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-38b7f678-fc9d-410e-a577-e6de0bae02b8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.147897 May 10 21:37:02.319796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2366/3142] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:02 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:02.573175 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f40a7279-80bc-4899-be66-0b756c2fa3b1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:02.573702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f40a7279-80bc-4899-be66-0b756c2fa3b1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:02.579644 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f40a7279-80bc-4899-be66-0b756c2fa3b1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:02.580087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f40a7279-80bc-4899-be66-0b756c2fa3b1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:02.580842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f40a7279-80bc-4899-be66-0b756c2fa3b1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:02.581276 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f40a7279-80bc-4899-be66-0b756c2fa3b1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:02.713735 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f40a7279-80bc-4899-be66-0b756c2fa3b1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:02.722221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f40a7279-80bc-4899-be66-0b756c2fa3b1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.153015 May 10 21:37:02.722797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2367/3143] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:02 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:02.975614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-69a95d26-0c2f-4a1a-8fd4-37fd32fdd660 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:02.976231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-69a95d26-0c2f-4a1a-8fd4-37fd32fdd660 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:02.982465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-69a95d26-0c2f-4a1a-8fd4-37fd32fdd660 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:02.982918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-69a95d26-0c2f-4a1a-8fd4-37fd32fdd660 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:02.984963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-69a95d26-0c2f-4a1a-8fd4-37fd32fdd660 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:02.985415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-69a95d26-0c2f-4a1a-8fd4-37fd32fdd660 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:03.111240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-69a95d26-0c2f-4a1a-8fd4-37fd32fdd660 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:03.118983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-69a95d26-0c2f-4a1a-8fd4-37fd32fdd660 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147328 May 10 21:37:03.119576 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2368/3144] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:02 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:03.337023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7b5e7fe0-3e25-44a8-8631-f5e01b1c5ace tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:03.337957 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7b5e7fe0-3e25-44a8-8631-f5e01b1c5ace tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:03.344485 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b5e7fe0-3e25-44a8-8631-f5e01b1c5ace tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:03.344940 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b5e7fe0-3e25-44a8-8631-f5e01b1c5ace tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:03.345706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b5e7fe0-3e25-44a8-8631-f5e01b1c5ace tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:03.346148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7b5e7fe0-3e25-44a8-8631-f5e01b1c5ace tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:03.472039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7b5e7fe0-3e25-44a8-8631-f5e01b1c5ace tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:03.479800 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7b5e7fe0-3e25-44a8-8631-f5e01b1c5ace tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.146567 May 10 21:37:03.480371 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2369/3145] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:03 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:03.739427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ed0ebb5c-c911-4693-970b-adfd9740da29 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:03.740074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ed0ebb5c-c911-4693-970b-adfd9740da29 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:03.745971 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed0ebb5c-c911-4693-970b-adfd9740da29 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:03.746414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed0ebb5c-c911-4693-970b-adfd9740da29 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:03.747188 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed0ebb5c-c911-4693-970b-adfd9740da29 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:03.747645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed0ebb5c-c911-4693-970b-adfd9740da29 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:03.877805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ed0ebb5c-c911-4693-970b-adfd9740da29 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:03.885559 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ed0ebb5c-c911-4693-970b-adfd9740da29 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150083 May 10 21:37:03.886123 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2370/3146] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:03 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:04.136004 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e21319c6-2b52-4ec2-a223-2927fcb754d1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:04.136545 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e21319c6-2b52-4ec2-a223-2927fcb754d1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:04.142711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e21319c6-2b52-4ec2-a223-2927fcb754d1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:04.143194 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e21319c6-2b52-4ec2-a223-2927fcb754d1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:04.143964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e21319c6-2b52-4ec2-a223-2927fcb754d1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:04.144401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e21319c6-2b52-4ec2-a223-2927fcb754d1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:04.271746 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e21319c6-2b52-4ec2-a223-2927fcb754d1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:04.279544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e21319c6-2b52-4ec2-a223-2927fcb754d1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147443 May 10 21:37:04.282358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2371/3147] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:04 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:04.497409 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-653212b6-be10-4f1f-b682-11eb7510ff90 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:04.498039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-653212b6-be10-4f1f-b682-11eb7510ff90 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:04.504349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-653212b6-be10-4f1f-b682-11eb7510ff90 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:04.504799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-653212b6-be10-4f1f-b682-11eb7510ff90 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:04.505575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-653212b6-be10-4f1f-b682-11eb7510ff90 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:04.505998 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-653212b6-be10-4f1f-b682-11eb7510ff90 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:04.637449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-653212b6-be10-4f1f-b682-11eb7510ff90 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:04.646961 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-653212b6-be10-4f1f-b682-11eb7510ff90 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.153511 May 10 21:37:04.652707 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2372/3148] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:04 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:04.902751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d2fb9d43-dba1-4357-9f52-19236f197dda tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:04.903413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d2fb9d43-dba1-4357-9f52-19236f197dda tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:04.909911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2fb9d43-dba1-4357-9f52-19236f197dda tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:04.910358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2fb9d43-dba1-4357-9f52-19236f197dda tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:04.911134 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2fb9d43-dba1-4357-9f52-19236f197dda tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:04.911580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d2fb9d43-dba1-4357-9f52-19236f197dda tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:05.039870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d2fb9d43-dba1-4357-9f52-19236f197dda tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:05.047940 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d2fb9d43-dba1-4357-9f52-19236f197dda tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149011 May 10 21:37:05.050428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2373/3149] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:04 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:05.297403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-401d9487-c8e8-47a2-a0f0-f411cabc2bc1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:05.297936 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-401d9487-c8e8-47a2-a0f0-f411cabc2bc1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:05.304024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-401d9487-c8e8-47a2-a0f0-f411cabc2bc1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:05.304478 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-401d9487-c8e8-47a2-a0f0-f411cabc2bc1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:05.305241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-401d9487-c8e8-47a2-a0f0-f411cabc2bc1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:05.305682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-401d9487-c8e8-47a2-a0f0-f411cabc2bc1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:05.435357 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-401d9487-c8e8-47a2-a0f0-f411cabc2bc1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:05.443327 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-401d9487-c8e8-47a2-a0f0-f411cabc2bc1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149931 May 10 21:37:05.443894 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2374/3150] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:05 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:05.664479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8ce9ecbc-2efc-4b95-93e0-97e72431bc68 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:05.665115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8ce9ecbc-2efc-4b95-93e0-97e72431bc68 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:05.671693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ce9ecbc-2efc-4b95-93e0-97e72431bc68 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:05.673784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ce9ecbc-2efc-4b95-93e0-97e72431bc68 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:05.673784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ce9ecbc-2efc-4b95-93e0-97e72431bc68 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:05.673784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ce9ecbc-2efc-4b95-93e0-97e72431bc68 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:05.800275 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8ce9ecbc-2efc-4b95-93e0-97e72431bc68 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:05.808026 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8ce9ecbc-2efc-4b95-93e0-97e72431bc68 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.147559 May 10 21:37:05.808593 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2375/3151] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:05 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:06.065481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-39e21597-9725-4477-9c79-c307353998b1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:06.066019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-39e21597-9725-4477-9c79-c307353998b1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:06.071981 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39e21597-9725-4477-9c79-c307353998b1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:06.072435 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39e21597-9725-4477-9c79-c307353998b1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:06.073206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39e21597-9725-4477-9c79-c307353998b1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:06.073642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-39e21597-9725-4477-9c79-c307353998b1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:06.201001 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-39e21597-9725-4477-9c79-c307353998b1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:06.209257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-39e21597-9725-4477-9c79-c307353998b1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148160 May 10 21:37:06.209834 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2376/3152] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:06 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:06.460869 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-21d4534e-2433-4db6-9d6a-704dbe4dee34 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:06.461482 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-21d4534e-2433-4db6-9d6a-704dbe4dee34 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:06.467682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21d4534e-2433-4db6-9d6a-704dbe4dee34 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:06.468997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21d4534e-2433-4db6-9d6a-704dbe4dee34 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:06.469768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21d4534e-2433-4db6-9d6a-704dbe4dee34 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:06.470209 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21d4534e-2433-4db6-9d6a-704dbe4dee34 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:06.600519 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-21d4534e-2433-4db6-9d6a-704dbe4dee34 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:06.609189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-21d4534e-2433-4db6-9d6a-704dbe4dee34 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151525 May 10 21:37:06.609761 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2377/3153] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:06 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:06.829141 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e99fe52d-c7fb-4dcb-954e-c13fe1d00762 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:06.829141 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e99fe52d-c7fb-4dcb-954e-c13fe1d00762 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:06.833498 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e99fe52d-c7fb-4dcb-954e-c13fe1d00762 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:06.833946 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e99fe52d-c7fb-4dcb-954e-c13fe1d00762 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:06.834702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e99fe52d-c7fb-4dcb-954e-c13fe1d00762 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:06.835267 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e99fe52d-c7fb-4dcb-954e-c13fe1d00762 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:06.962213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e99fe52d-c7fb-4dcb-954e-c13fe1d00762 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:06.970333 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e99fe52d-c7fb-4dcb-954e-c13fe1d00762 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148660 May 10 21:37:06.971303 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2378/3154] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:06 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:07.225754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1b95f990-0244-4f8c-972c-75169afee206 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:07.226364 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1b95f990-0244-4f8c-972c-75169afee206 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:07.232567 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1b95f990-0244-4f8c-972c-75169afee206 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:07.233022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1b95f990-0244-4f8c-972c-75169afee206 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:07.234250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1b95f990-0244-4f8c-972c-75169afee206 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:07.234696 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1b95f990-0244-4f8c-972c-75169afee206 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:07.366438 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1b95f990-0244-4f8c-972c-75169afee206 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:07.374346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1b95f990-0244-4f8c-972c-75169afee206 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.152381 May 10 21:37:07.374915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2379/3155] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:07 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:07.627015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-07e306b4-c7fa-4ef3-940a-d9255e8283ae tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:07.627659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-07e306b4-c7fa-4ef3-940a-d9255e8283ae tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:07.633600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07e306b4-c7fa-4ef3-940a-d9255e8283ae tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:07.634050 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07e306b4-c7fa-4ef3-940a-d9255e8283ae tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:07.634816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07e306b4-c7fa-4ef3-940a-d9255e8283ae tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:07.635286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07e306b4-c7fa-4ef3-940a-d9255e8283ae tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:07.764177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-07e306b4-c7fa-4ef3-940a-d9255e8283ae tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:07.771870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-07e306b4-c7fa-4ef3-940a-d9255e8283ae tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149910 May 10 21:37:07.772431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2380/3156] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:07 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:07.986886 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-62e272dd-f519-43cc-bdb6-165a36c13d9d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:07.987543 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-62e272dd-f519-43cc-bdb6-165a36c13d9d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:07.993734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-62e272dd-f519-43cc-bdb6-165a36c13d9d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:07.994182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-62e272dd-f519-43cc-bdb6-165a36c13d9d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:07.994939 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-62e272dd-f519-43cc-bdb6-165a36c13d9d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:07.995396 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-62e272dd-f519-43cc-bdb6-165a36c13d9d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:08.124830 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-62e272dd-f519-43cc-bdb6-165a36c13d9d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:08.132741 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-62e272dd-f519-43cc-bdb6-165a36c13d9d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149750 May 10 21:37:08.133313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2381/3157] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:07 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:08.392088 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8f5d3c73-38bd-43cd-8d28-98889c7c70af tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:08.392689 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8f5d3c73-38bd-43cd-8d28-98889c7c70af tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:08.398577 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8f5d3c73-38bd-43cd-8d28-98889c7c70af tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:08.399021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8f5d3c73-38bd-43cd-8d28-98889c7c70af tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:08.399803 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8f5d3c73-38bd-43cd-8d28-98889c7c70af tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:08.400241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8f5d3c73-38bd-43cd-8d28-98889c7c70af tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:08.529893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8f5d3c73-38bd-43cd-8d28-98889c7c70af tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:08.538703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8f5d3c73-38bd-43cd-8d28-98889c7c70af tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.151179 May 10 21:37:08.539295 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2382/3158] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:08 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:08.788761 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5f509734-9bd2-4eab-86e8-9eca8496d6cc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:08.789294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5f509734-9bd2-4eab-86e8-9eca8496d6cc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:08.795485 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f509734-9bd2-4eab-86e8-9eca8496d6cc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:08.795931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f509734-9bd2-4eab-86e8-9eca8496d6cc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:08.796722 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f509734-9bd2-4eab-86e8-9eca8496d6cc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:08.797155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f509734-9bd2-4eab-86e8-9eca8496d6cc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:08.923006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5f509734-9bd2-4eab-86e8-9eca8496d6cc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:08.930702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5f509734-9bd2-4eab-86e8-9eca8496d6cc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.145885 May 10 21:37:08.931285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2383/3159] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:08 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:09.150046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-993e6808-676f-4509-a39c-6c89613b2510 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:09.150679 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-993e6808-676f-4509-a39c-6c89613b2510 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:09.157878 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-993e6808-676f-4509-a39c-6c89613b2510 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:09.158333 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-993e6808-676f-4509-a39c-6c89613b2510 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:09.159102 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-993e6808-676f-4509-a39c-6c89613b2510 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:09.159564 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-993e6808-676f-4509-a39c-6c89613b2510 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:09.291068 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-993e6808-676f-4509-a39c-6c89613b2510 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:09.299040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-993e6808-676f-4509-a39c-6c89613b2510 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.152912 May 10 21:37:09.299653 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2384/3160] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:09 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:09.556140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f45512be-4b63-4237-a0cd-8275d672290d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:09.556676 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f45512be-4b63-4237-a0cd-8275d672290d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:09.563525 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f45512be-4b63-4237-a0cd-8275d672290d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:09.564015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f45512be-4b63-4237-a0cd-8275d672290d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:09.564762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f45512be-4b63-4237-a0cd-8275d672290d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:09.565206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f45512be-4b63-4237-a0cd-8275d672290d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:09.693043 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f45512be-4b63-4237-a0cd-8275d672290d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:09.700817 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f45512be-4b63-4237-a0cd-8275d672290d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148658 May 10 21:37:09.701379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2385/3161] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:09 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:09.948027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cde1f44b-9689-4455-a20d-d37f1b774ef2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:09.948641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cde1f44b-9689-4455-a20d-d37f1b774ef2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:09.955076 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cde1f44b-9689-4455-a20d-d37f1b774ef2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:09.955569 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cde1f44b-9689-4455-a20d-d37f1b774ef2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:09.956336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cde1f44b-9689-4455-a20d-d37f1b774ef2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:09.956782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cde1f44b-9689-4455-a20d-d37f1b774ef2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:10.087189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cde1f44b-9689-4455-a20d-d37f1b774ef2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:10.095752 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cde1f44b-9689-4455-a20d-d37f1b774ef2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151583 May 10 21:37:10.096349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2386/3162] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:09 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:10.316587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e09efd9b-6e79-4daf-bd08-91552380d80c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:10.317208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e09efd9b-6e79-4daf-bd08-91552380d80c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:10.323421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e09efd9b-6e79-4daf-bd08-91552380d80c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:10.323871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e09efd9b-6e79-4daf-bd08-91552380d80c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:10.324626 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e09efd9b-6e79-4daf-bd08-91552380d80c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:10.325057 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e09efd9b-6e79-4daf-bd08-91552380d80c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:10.454975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e09efd9b-6e79-4daf-bd08-91552380d80c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:10.463261 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e09efd9b-6e79-4daf-bd08-91552380d80c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150843 May 10 21:37:10.463839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2387/3163] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:10 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:10.719469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ea0420e9-d9f0-41ef-bfac-8e6f247c4df3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:10.720214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ea0420e9-d9f0-41ef-bfac-8e6f247c4df3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:10.726109 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ea0420e9-d9f0-41ef-bfac-8e6f247c4df3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:10.726555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ea0420e9-d9f0-41ef-bfac-8e6f247c4df3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:10.727362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ea0420e9-d9f0-41ef-bfac-8e6f247c4df3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:10.727793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ea0420e9-d9f0-41ef-bfac-8e6f247c4df3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:10.854366 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ea0420e9-d9f0-41ef-bfac-8e6f247c4df3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:10.862475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ea0420e9-d9f0-41ef-bfac-8e6f247c4df3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.146929 May 10 21:37:10.863044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2388/3164] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:10 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:11.113720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-01618dcd-b080-44f2-b2de-b43dbab4eb5a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:11.114297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-01618dcd-b080-44f2-b2de-b43dbab4eb5a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:11.120291 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01618dcd-b080-44f2-b2de-b43dbab4eb5a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:11.120748 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01618dcd-b080-44f2-b2de-b43dbab4eb5a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:11.121508 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01618dcd-b080-44f2-b2de-b43dbab4eb5a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:11.121944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01618dcd-b080-44f2-b2de-b43dbab4eb5a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:11.253560 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-01618dcd-b080-44f2-b2de-b43dbab4eb5a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:11.261299 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-01618dcd-b080-44f2-b2de-b43dbab4eb5a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.152598 May 10 21:37:11.261871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2389/3165] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:11 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:11.480350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2f52c1b0-6b06-47eb-bc55-f9fc2246abf3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:11.481000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2f52c1b0-6b06-47eb-bc55-f9fc2246abf3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:11.488231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2f52c1b0-6b06-47eb-bc55-f9fc2246abf3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:11.488714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2f52c1b0-6b06-47eb-bc55-f9fc2246abf3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:11.489486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2f52c1b0-6b06-47eb-bc55-f9fc2246abf3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:11.489929 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2f52c1b0-6b06-47eb-bc55-f9fc2246abf3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:11.623748 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2f52c1b0-6b06-47eb-bc55-f9fc2246abf3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:11.632215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2f52c1b0-6b06-47eb-bc55-f9fc2246abf3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.155788 May 10 21:37:11.632790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2390/3166] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:11 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:11.879888 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f0661dfd-533b-47d1-80b3-b2a99cd6a48a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:11.880504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f0661dfd-533b-47d1-80b3-b2a99cd6a48a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:11.886413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0661dfd-533b-47d1-80b3-b2a99cd6a48a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:11.886859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0661dfd-533b-47d1-80b3-b2a99cd6a48a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:11.887653 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0661dfd-533b-47d1-80b3-b2a99cd6a48a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:11.888097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0661dfd-533b-47d1-80b3-b2a99cd6a48a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:12.021774 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f0661dfd-533b-47d1-80b3-b2a99cd6a48a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:12.029518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f0661dfd-533b-47d1-80b3-b2a99cd6a48a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.153897 May 10 21:37:12.030084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2391/3167] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:11 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:12.279755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f6a0ce4e-9136-4d74-b06b-3cff9890fdc9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:12.280283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f6a0ce4e-9136-4d74-b06b-3cff9890fdc9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:12.286411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6a0ce4e-9136-4d74-b06b-3cff9890fdc9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:12.286857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6a0ce4e-9136-4d74-b06b-3cff9890fdc9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:12.287650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6a0ce4e-9136-4d74-b06b-3cff9890fdc9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:12.288086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6a0ce4e-9136-4d74-b06b-3cff9890fdc9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:12.414430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f6a0ce4e-9136-4d74-b06b-3cff9890fdc9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:12.422806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f6a0ce4e-9136-4d74-b06b-3cff9890fdc9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.146404 May 10 21:37:12.423413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2392/3168] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:12 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:12.649314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-abc171e6-33e6-4f40-ace8-d14868632212 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:12.649930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-abc171e6-33e6-4f40-ace8-d14868632212 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:12.656319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-abc171e6-33e6-4f40-ace8-d14868632212 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:12.657272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-abc171e6-33e6-4f40-ace8-d14868632212 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:12.658036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-abc171e6-33e6-4f40-ace8-d14868632212 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:12.658481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-abc171e6-33e6-4f40-ace8-d14868632212 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:12.787358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-abc171e6-33e6-4f40-ace8-d14868632212 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:12.795111 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-abc171e6-33e6-4f40-ace8-d14868632212 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149666 May 10 21:37:12.795702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2393/3169] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:12 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:13.046989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9a6df878-fb7b-4b34-b933-05dccd429051 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:13.047785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9a6df878-fb7b-4b34-b933-05dccd429051 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:13.053568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9a6df878-fb7b-4b34-b933-05dccd429051 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:13.054026 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9a6df878-fb7b-4b34-b933-05dccd429051 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:13.054792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9a6df878-fb7b-4b34-b933-05dccd429051 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:13.055265 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9a6df878-fb7b-4b34-b933-05dccd429051 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:13.185477 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9a6df878-fb7b-4b34-b933-05dccd429051 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:13.194232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9a6df878-fb7b-4b34-b933-05dccd429051 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.151109 May 10 21:37:13.194797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2394/3170] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:13 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:13.439041 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6449dfcb-b7b4-4803-8608-1cf050d5f3c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:13.439691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6449dfcb-b7b4-4803-8608-1cf050d5f3c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:13.445685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6449dfcb-b7b4-4803-8608-1cf050d5f3c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:13.446135 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6449dfcb-b7b4-4803-8608-1cf050d5f3c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:13.446919 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6449dfcb-b7b4-4803-8608-1cf050d5f3c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:13.447392 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6449dfcb-b7b4-4803-8608-1cf050d5f3c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:13.572898 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6449dfcb-b7b4-4803-8608-1cf050d5f3c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:13.581339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6449dfcb-b7b4-4803-8608-1cf050d5f3c5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.146261 May 10 21:37:13.581908 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2395/3171] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:13 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:13.812712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-50ad9e72-5a38-494b-b34a-5033216c4185 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:13.813605 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-50ad9e72-5a38-494b-b34a-5033216c4185 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:13.819609 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50ad9e72-5a38-494b-b34a-5033216c4185 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:13.820058 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50ad9e72-5a38-494b-b34a-5033216c4185 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:13.820814 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50ad9e72-5a38-494b-b34a-5033216c4185 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:13.821253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50ad9e72-5a38-494b-b34a-5033216c4185 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:13.951778 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-50ad9e72-5a38-494b-b34a-5033216c4185 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:13.960234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-50ad9e72-5a38-494b-b34a-5033216c4185 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151493 May 10 21:37:13.960797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2396/3172] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:13 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:14.212000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c9ff6856-09bd-4e7c-bd2a-ccefaeddbd95 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:14.212885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c9ff6856-09bd-4e7c-bd2a-ccefaeddbd95 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:14.218888 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9ff6856-09bd-4e7c-bd2a-ccefaeddbd95 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:14.219374 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9ff6856-09bd-4e7c-bd2a-ccefaeddbd95 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:14.220147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9ff6856-09bd-4e7c-bd2a-ccefaeddbd95 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:14.220597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9ff6856-09bd-4e7c-bd2a-ccefaeddbd95 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:14.347509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c9ff6856-09bd-4e7c-bd2a-ccefaeddbd95 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:14.355217 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c9ff6856-09bd-4e7c-bd2a-ccefaeddbd95 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.147085 May 10 21:37:14.355791 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2397/3173] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:14 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:14.598120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f503b089-290a-43b1-9116-8e137acacf54 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:14.598736 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f503b089-290a-43b1-9116-8e137acacf54 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:14.605122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f503b089-290a-43b1-9116-8e137acacf54 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:14.605584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f503b089-290a-43b1-9116-8e137acacf54 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:14.606363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f503b089-290a-43b1-9116-8e137acacf54 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:14.606805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f503b089-290a-43b1-9116-8e137acacf54 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:14.740806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f503b089-290a-43b1-9116-8e137acacf54 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:14.748612 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f503b089-290a-43b1-9116-8e137acacf54 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.154557 May 10 21:37:14.749182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2398/3174] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:14 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:14.977522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-922dcafa-1c55-4661-afce-bd34a710291c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:14.978148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-922dcafa-1c55-4661-afce-bd34a710291c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:14.984565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-922dcafa-1c55-4661-afce-bd34a710291c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:14.985658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-922dcafa-1c55-4661-afce-bd34a710291c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:14.986442 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-922dcafa-1c55-4661-afce-bd34a710291c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:14.986885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-922dcafa-1c55-4661-afce-bd34a710291c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:15.116260 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-922dcafa-1c55-4661-afce-bd34a710291c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:15.123984 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-922dcafa-1c55-4661-afce-bd34a710291c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150400 May 10 21:37:15.124551 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2399/3175] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:14 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:15.372989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f44fc58b-d327-477a-ad73-eaf80acd4fd3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:15.373606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f44fc58b-d327-477a-ad73-eaf80acd4fd3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:15.380714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f44fc58b-d327-477a-ad73-eaf80acd4fd3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:15.381168 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f44fc58b-d327-477a-ad73-eaf80acd4fd3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:15.381932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f44fc58b-d327-477a-ad73-eaf80acd4fd3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:15.382373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f44fc58b-d327-477a-ad73-eaf80acd4fd3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:15.509727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f44fc58b-d327-477a-ad73-eaf80acd4fd3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:15.517623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f44fc58b-d327-477a-ad73-eaf80acd4fd3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148497 May 10 21:37:15.518186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2400/3176] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:15 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:15.765866 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f4d60543-2aaf-4afe-b592-c0761f46d795 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:15.767214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f4d60543-2aaf-4afe-b592-c0761f46d795 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:15.773348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4d60543-2aaf-4afe-b592-c0761f46d795 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:15.773802 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4d60543-2aaf-4afe-b592-c0761f46d795 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:15.774564 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4d60543-2aaf-4afe-b592-c0761f46d795 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:15.775002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4d60543-2aaf-4afe-b592-c0761f46d795 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:15.906820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f4d60543-2aaf-4afe-b592-c0761f46d795 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:15.914620 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f4d60543-2aaf-4afe-b592-c0761f46d795 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.152864 May 10 21:37:15.915200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2401/3177] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:15 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:16.142206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e07557f0-46c6-4bd1-a9f5-12f33b704ee4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:16.142893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e07557f0-46c6-4bd1-a9f5-12f33b704ee4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:16.149383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e07557f0-46c6-4bd1-a9f5-12f33b704ee4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:16.149742 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e07557f0-46c6-4bd1-a9f5-12f33b704ee4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:16.150499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e07557f0-46c6-4bd1-a9f5-12f33b704ee4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:16.150936 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e07557f0-46c6-4bd1-a9f5-12f33b704ee4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:16.278853 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e07557f0-46c6-4bd1-a9f5-12f33b704ee4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:16.289603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e07557f0-46c6-4bd1-a9f5-12f33b704ee4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151675 May 10 21:37:16.290177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2402/3178] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:16 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:16.534558 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b9a80f74-8402-48df-bf73-2e1a0d61da84 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:16.535081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b9a80f74-8402-48df-bf73-2e1a0d61da84 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:16.541009 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b9a80f74-8402-48df-bf73-2e1a0d61da84 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:16.541454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b9a80f74-8402-48df-bf73-2e1a0d61da84 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:16.542205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b9a80f74-8402-48df-bf73-2e1a0d61da84 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:16.542636 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b9a80f74-8402-48df-bf73-2e1a0d61da84 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:16.674036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b9a80f74-8402-48df-bf73-2e1a0d61da84 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:16.681791 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b9a80f74-8402-48df-bf73-2e1a0d61da84 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.151144 May 10 21:37:16.682397 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2403/3179] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:16 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:16.931849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e749a1e2-2a40-4447-8bf5-7fb6118d3970 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:16.932464 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e749a1e2-2a40-4447-8bf5-7fb6118d3970 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:16.939061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e749a1e2-2a40-4447-8bf5-7fb6118d3970 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:16.939582 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e749a1e2-2a40-4447-8bf5-7fb6118d3970 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:16.940347 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e749a1e2-2a40-4447-8bf5-7fb6118d3970 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:16.940794 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e749a1e2-2a40-4447-8bf5-7fb6118d3970 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:17.068823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e749a1e2-2a40-4447-8bf5-7fb6118d3970 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:17.076598 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e749a1e2-2a40-4447-8bf5-7fb6118d3970 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148573 May 10 21:37:17.077164 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2404/3180] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:16 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:17.306924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-01f00151-8e01-4deb-a6e4-28fdfbb7b9ff tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:17.307594 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-01f00151-8e01-4deb-a6e4-28fdfbb7b9ff tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:17.314397 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01f00151-8e01-4deb-a6e4-28fdfbb7b9ff tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:17.314852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01f00151-8e01-4deb-a6e4-28fdfbb7b9ff tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:17.315661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01f00151-8e01-4deb-a6e4-28fdfbb7b9ff tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:17.316101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-01f00151-8e01-4deb-a6e4-28fdfbb7b9ff tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:17.443340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-01f00151-8e01-4deb-a6e4-28fdfbb7b9ff tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:17.451015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-01f00151-8e01-4deb-a6e4-28fdfbb7b9ff tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.147970 May 10 21:37:17.451606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2405/3181] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:17 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:17.699794 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cd09c68b-86c3-47ff-a069-19ffadf5d4e4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:17.700402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cd09c68b-86c3-47ff-a069-19ffadf5d4e4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:17.707210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd09c68b-86c3-47ff-a069-19ffadf5d4e4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:17.707662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd09c68b-86c3-47ff-a069-19ffadf5d4e4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:17.708423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd09c68b-86c3-47ff-a069-19ffadf5d4e4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:17.708865 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd09c68b-86c3-47ff-a069-19ffadf5d4e4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:17.837923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cd09c68b-86c3-47ff-a069-19ffadf5d4e4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:17.845571 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cd09c68b-86c3-47ff-a069-19ffadf5d4e4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149619 May 10 21:37:17.846181 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2406/3182] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:17 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:18.093860 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-91297dec-9bb0-4ea2-a55a-45e8934fceb0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:18.094469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-91297dec-9bb0-4ea2-a55a-45e8934fceb0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:18.100461 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91297dec-9bb0-4ea2-a55a-45e8934fceb0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:18.100909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91297dec-9bb0-4ea2-a55a-45e8934fceb0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:18.101665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91297dec-9bb0-4ea2-a55a-45e8934fceb0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:18.102096 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91297dec-9bb0-4ea2-a55a-45e8934fceb0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:18.228378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-91297dec-9bb0-4ea2-a55a-45e8934fceb0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:18.236617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-91297dec-9bb0-4ea2-a55a-45e8934fceb0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.146620 May 10 21:37:18.237181 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2407/3183] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:18 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:18.468362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-84373677-1d14-4b26-a1c0-b46b6f2ace63 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:18.469513 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-84373677-1d14-4b26-a1c0-b46b6f2ace63 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:18.476003 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-84373677-1d14-4b26-a1c0-b46b6f2ace63 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:18.476458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-84373677-1d14-4b26-a1c0-b46b6f2ace63 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:18.477256 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-84373677-1d14-4b26-a1c0-b46b6f2ace63 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:18.477694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-84373677-1d14-4b26-a1c0-b46b6f2ace63 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:18.608907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-84373677-1d14-4b26-a1c0-b46b6f2ace63 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:18.617884 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-84373677-1d14-4b26-a1c0-b46b6f2ace63 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.153480 May 10 21:37:18.618443 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2408/3184] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:18 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:18.863411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b41ef73e-fe32-43c6-b817-292fa7d4c04c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:18.864022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b41ef73e-fe32-43c6-b817-292fa7d4c04c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:18.869888 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b41ef73e-fe32-43c6-b817-292fa7d4c04c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:18.870335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b41ef73e-fe32-43c6-b817-292fa7d4c04c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:18.871092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b41ef73e-fe32-43c6-b817-292fa7d4c04c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:18.871552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b41ef73e-fe32-43c6-b817-292fa7d4c04c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:19.096520 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b41ef73e-fe32-43c6-b817-292fa7d4c04c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:19.104650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b41ef73e-fe32-43c6-b817-292fa7d4c04c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.245783 May 10 21:37:19.105226 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2409/3185] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:18 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:19.254302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4a5b9995-caac-44b3-adad-64259d26fde4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:19.254976 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4a5b9995-caac-44b3-adad-64259d26fde4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:19.260784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a5b9995-caac-44b3-adad-64259d26fde4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:19.261236 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a5b9995-caac-44b3-adad-64259d26fde4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:19.262045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a5b9995-caac-44b3-adad-64259d26fde4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:19.262493 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a5b9995-caac-44b3-adad-64259d26fde4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:19.398793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4a5b9995-caac-44b3-adad-64259d26fde4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:19.407636 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4a5b9995-caac-44b3-adad-64259d26fde4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.156613 May 10 21:37:19.407846 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2410/3186] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:19 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:19.634971 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-76907fd4-0133-48d9-a17d-16703d9f878a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:19.635607 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-76907fd4-0133-48d9-a17d-16703d9f878a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:19.642545 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76907fd4-0133-48d9-a17d-16703d9f878a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:19.642996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76907fd4-0133-48d9-a17d-16703d9f878a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:19.643789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76907fd4-0133-48d9-a17d-16703d9f878a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:19.644229 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76907fd4-0133-48d9-a17d-16703d9f878a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:19.773436 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-76907fd4-0133-48d9-a17d-16703d9f878a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:19.781160 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-76907fd4-0133-48d9-a17d-16703d9f878a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150007 May 10 21:37:19.782488 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2411/3187] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:19 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:20.121869 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-010e8fc8-236c-47dd-a4a3-3c08b7257f4e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:20.122520 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-010e8fc8-236c-47dd-a4a3-3c08b7257f4e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:20.128816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-010e8fc8-236c-47dd-a4a3-3c08b7257f4e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:20.129274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-010e8fc8-236c-47dd-a4a3-3c08b7257f4e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:20.130041 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-010e8fc8-236c-47dd-a4a3-3c08b7257f4e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:20.130483 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-010e8fc8-236c-47dd-a4a3-3c08b7257f4e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:20.258681 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-010e8fc8-236c-47dd-a4a3-3c08b7257f4e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:20.266627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-010e8fc8-236c-47dd-a4a3-3c08b7257f4e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148560 May 10 21:37:20.267689 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2412/3188] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:20 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:20.424310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3f39f35e-f39e-463e-b02f-554626692cc2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:20.424841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3f39f35e-f39e-463e-b02f-554626692cc2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:20.430849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3f39f35e-f39e-463e-b02f-554626692cc2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:20.431343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3f39f35e-f39e-463e-b02f-554626692cc2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:20.432105 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3f39f35e-f39e-463e-b02f-554626692cc2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:20.432540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3f39f35e-f39e-463e-b02f-554626692cc2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:20.559072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3f39f35e-f39e-463e-b02f-554626692cc2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:20.566915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3f39f35e-f39e-463e-b02f-554626692cc2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.146756 May 10 21:37:20.567502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2413/3189] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:20 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:20.799404 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1b37ff5a-3cab-4c6f-a03a-2288db4aba20 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:20.799998 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1b37ff5a-3cab-4c6f-a03a-2288db4aba20 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:20.806582 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1b37ff5a-3cab-4c6f-a03a-2288db4aba20 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:20.807030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1b37ff5a-3cab-4c6f-a03a-2288db4aba20 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:20.807813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1b37ff5a-3cab-4c6f-a03a-2288db4aba20 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:20.808247 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1b37ff5a-3cab-4c6f-a03a-2288db4aba20 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:20.934139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1b37ff5a-3cab-4c6f-a03a-2288db4aba20 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:20.942469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1b37ff5a-3cab-4c6f-a03a-2288db4aba20 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.147312 May 10 21:37:20.943031 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2414/3190] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:20 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:21.284997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-09deddd6-3a13-405f-8a25-bfc21bebb295 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:21.285645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-09deddd6-3a13-405f-8a25-bfc21bebb295 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:21.291628 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-09deddd6-3a13-405f-8a25-bfc21bebb295 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:21.292080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-09deddd6-3a13-405f-8a25-bfc21bebb295 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:21.292988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-09deddd6-3a13-405f-8a25-bfc21bebb295 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:21.293468 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-09deddd6-3a13-405f-8a25-bfc21bebb295 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:21.424653 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-09deddd6-3a13-405f-8a25-bfc21bebb295 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:21.432376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-09deddd6-3a13-405f-8a25-bfc21bebb295 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.152133 May 10 21:37:21.432941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2415/3191] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:21 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:21.583960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-da167829-4ea9-4902-a7d8-cc51a4105e20 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:21.584489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-da167829-4ea9-4902-a7d8-cc51a4105e20 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:21.590604 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-da167829-4ea9-4902-a7d8-cc51a4105e20 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:21.591050 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-da167829-4ea9-4902-a7d8-cc51a4105e20 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:21.591838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-da167829-4ea9-4902-a7d8-cc51a4105e20 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:21.592274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-da167829-4ea9-4902-a7d8-cc51a4105e20 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:21.719202 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-da167829-4ea9-4902-a7d8-cc51a4105e20 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:21.727924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-da167829-4ea9-4902-a7d8-cc51a4105e20 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147776 May 10 21:37:21.728500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2416/3192] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:21 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:21.960697 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0f4f7af5-8e17-4615-a4e6-22d5249f4d9a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:21.961339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0f4f7af5-8e17-4615-a4e6-22d5249f4d9a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:21.967935 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f4f7af5-8e17-4615-a4e6-22d5249f4d9a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:21.968394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f4f7af5-8e17-4615-a4e6-22d5249f4d9a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:21.969164 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f4f7af5-8e17-4615-a4e6-22d5249f4d9a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:21.969625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f4f7af5-8e17-4615-a4e6-22d5249f4d9a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:22.100040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0f4f7af5-8e17-4615-a4e6-22d5249f4d9a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:22.107885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0f4f7af5-8e17-4615-a4e6-22d5249f4d9a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151097 May 10 21:37:22.108460 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2417/3193] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:21 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:22.450032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8d5964cb-da45-47f8-9fb7-1b94fdafac95 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:22.450645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8d5964cb-da45-47f8-9fb7-1b94fdafac95 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:22.457633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8d5964cb-da45-47f8-9fb7-1b94fdafac95 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:22.458080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8d5964cb-da45-47f8-9fb7-1b94fdafac95 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:22.458969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8d5964cb-da45-47f8-9fb7-1b94fdafac95 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:22.459440 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8d5964cb-da45-47f8-9fb7-1b94fdafac95 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:22.590963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8d5964cb-da45-47f8-9fb7-1b94fdafac95 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:22.599644 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8d5964cb-da45-47f8-9fb7-1b94fdafac95 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.153456 May 10 21:37:22.600216 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2418/3194] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:22 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:22.745808 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-57cba9c5-6a48-4761-acbf-72958eda05ff tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:22.746350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-57cba9c5-6a48-4761-acbf-72958eda05ff tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:22.752372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-57cba9c5-6a48-4761-acbf-72958eda05ff tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:22.752857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-57cba9c5-6a48-4761-acbf-72958eda05ff tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:22.753624 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-57cba9c5-6a48-4761-acbf-72958eda05ff tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:22.754068 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-57cba9c5-6a48-4761-acbf-72958eda05ff tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:22.879608 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-57cba9c5-6a48-4761-acbf-72958eda05ff tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:22.887414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-57cba9c5-6a48-4761-acbf-72958eda05ff tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.145559 May 10 21:37:22.887987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2419/3195] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:22 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:23.124941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d5d8d31a-a12b-453a-bcfd-dc9c9185c1fa tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:23.125621 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d5d8d31a-a12b-453a-bcfd-dc9c9185c1fa tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:23.132455 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d5d8d31a-a12b-453a-bcfd-dc9c9185c1fa tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:23.132902 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d5d8d31a-a12b-453a-bcfd-dc9c9185c1fa tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:23.133666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d5d8d31a-a12b-453a-bcfd-dc9c9185c1fa tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:23.134107 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d5d8d31a-a12b-453a-bcfd-dc9c9185c1fa tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:23.266567 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d5d8d31a-a12b-453a-bcfd-dc9c9185c1fa tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:23.274619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d5d8d31a-a12b-453a-bcfd-dc9c9185c1fa tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.153562 May 10 21:37:23.275211 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2420/3196] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:23 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:23.616450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ec16ce21-0c6a-46b1-be73-00ae5084d624 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:23.617087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ec16ce21-0c6a-46b1-be73-00ae5084d624 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:23.623107 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec16ce21-0c6a-46b1-be73-00ae5084d624 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:23.623601 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec16ce21-0c6a-46b1-be73-00ae5084d624 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:23.624367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec16ce21-0c6a-46b1-be73-00ae5084d624 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:23.624798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec16ce21-0c6a-46b1-be73-00ae5084d624 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:23.749758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ec16ce21-0c6a-46b1-be73-00ae5084d624 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:23.758554 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ec16ce21-0c6a-46b1-be73-00ae5084d624 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.145975 May 10 21:37:23.759141 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2421/3197] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:23 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:23.904875 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-87ad2bc1-c5ad-44a5-b305-52cc1a9787c3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:23.905403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-87ad2bc1-c5ad-44a5-b305-52cc1a9787c3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:23.911553 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87ad2bc1-c5ad-44a5-b305-52cc1a9787c3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:23.912004 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87ad2bc1-c5ad-44a5-b305-52cc1a9787c3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:23.912767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87ad2bc1-c5ad-44a5-b305-52cc1a9787c3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:23.913210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87ad2bc1-c5ad-44a5-b305-52cc1a9787c3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:24.043422 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-87ad2bc1-c5ad-44a5-b305-52cc1a9787c3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:24.052032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-87ad2bc1-c5ad-44a5-b305-52cc1a9787c3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150990 May 10 21:37:24.052600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2422/3198] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:23 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:24.291683 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6c54e332-f198-4f7a-9629-a26e7be6ddc1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:24.292299 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6c54e332-f198-4f7a-9629-a26e7be6ddc1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:24.299627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6c54e332-f198-4f7a-9629-a26e7be6ddc1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:24.300086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6c54e332-f198-4f7a-9629-a26e7be6ddc1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:24.300853 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6c54e332-f198-4f7a-9629-a26e7be6ddc1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:24.301332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6c54e332-f198-4f7a-9629-a26e7be6ddc1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:24.430425 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6c54e332-f198-4f7a-9629-a26e7be6ddc1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:24.438179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6c54e332-f198-4f7a-9629-a26e7be6ddc1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150414 May 10 21:37:24.439305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2423/3199] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:24 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:24.776841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d6fd8e5b-625c-4b5f-8048-cfec44dd6388 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:24.777452 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d6fd8e5b-625c-4b5f-8048-cfec44dd6388 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:24.784038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6fd8e5b-625c-4b5f-8048-cfec44dd6388 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:24.784474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6fd8e5b-625c-4b5f-8048-cfec44dd6388 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:24.785288 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6fd8e5b-625c-4b5f-8048-cfec44dd6388 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:24.785705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6fd8e5b-625c-4b5f-8048-cfec44dd6388 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:24.913966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d6fd8e5b-625c-4b5f-8048-cfec44dd6388 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:24.921787 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d6fd8e5b-625c-4b5f-8048-cfec44dd6388 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148860 May 10 21:37:24.922347 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2424/3200] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:24 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:25.069020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c955dcfb-d83b-44cd-8017-66a2a2b1da33 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:25.069661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c955dcfb-d83b-44cd-8017-66a2a2b1da33 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:25.075647 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c955dcfb-d83b-44cd-8017-66a2a2b1da33 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:25.076094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c955dcfb-d83b-44cd-8017-66a2a2b1da33 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:25.082052 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c955dcfb-d83b-44cd-8017-66a2a2b1da33 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:25.082052 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c955dcfb-d83b-44cd-8017-66a2a2b1da33 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:25.204801 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c955dcfb-d83b-44cd-8017-66a2a2b1da33 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:25.212691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c955dcfb-d83b-44cd-8017-66a2a2b1da33 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147647 May 10 21:37:25.213518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2425/3201] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:25 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:25.456035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-21065f6b-4f72-4d0b-99e9-5ddeaf07f4ef tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:25.456678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-21065f6b-4f72-4d0b-99e9-5ddeaf07f4ef tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:25.463261 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21065f6b-4f72-4d0b-99e9-5ddeaf07f4ef tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:25.463719 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21065f6b-4f72-4d0b-99e9-5ddeaf07f4ef tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:25.464488 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21065f6b-4f72-4d0b-99e9-5ddeaf07f4ef tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:25.464928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21065f6b-4f72-4d0b-99e9-5ddeaf07f4ef tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:25.590114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-21065f6b-4f72-4d0b-99e9-5ddeaf07f4ef tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:25.598686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-21065f6b-4f72-4d0b-99e9-5ddeaf07f4ef tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.147196 May 10 21:37:25.599277 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2426/3202] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:25 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:25.939908 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-33f2dee3-9419-4673-8411-ac5df6d79bfd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:25.940528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-33f2dee3-9419-4673-8411-ac5df6d79bfd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:25.946626 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-33f2dee3-9419-4673-8411-ac5df6d79bfd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:25.947075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-33f2dee3-9419-4673-8411-ac5df6d79bfd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:25.947870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-33f2dee3-9419-4673-8411-ac5df6d79bfd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:25.948307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-33f2dee3-9419-4673-8411-ac5df6d79bfd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:26.086148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-33f2dee3-9419-4673-8411-ac5df6d79bfd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:26.094338 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-33f2dee3-9419-4673-8411-ac5df6d79bfd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.159391 May 10 21:37:26.095076 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2427/3203] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:25 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:26.230219 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-791748d4-dc4b-4c8f-b833-bd1a99366c8c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:26.230790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-791748d4-dc4b-4c8f-b833-bd1a99366c8c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:26.236899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-791748d4-dc4b-4c8f-b833-bd1a99366c8c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:26.237360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-791748d4-dc4b-4c8f-b833-bd1a99366c8c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:26.238140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-791748d4-dc4b-4c8f-b833-bd1a99366c8c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:26.238586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-791748d4-dc4b-4c8f-b833-bd1a99366c8c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:26.370478 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-791748d4-dc4b-4c8f-b833-bd1a99366c8c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:26.380330 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-791748d4-dc4b-4c8f-b833-bd1a99366c8c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.153998 May 10 21:37:26.380910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2428/3204] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:26 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:26.617281 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-45660b41-9a8c-48d7-8075-1649ee847ace tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:26.617873 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-45660b41-9a8c-48d7-8075-1649ee847ace tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:26.624305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-45660b41-9a8c-48d7-8075-1649ee847ace tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:26.624751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-45660b41-9a8c-48d7-8075-1649ee847ace tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:26.625504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-45660b41-9a8c-48d7-8075-1649ee847ace tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:26.626047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-45660b41-9a8c-48d7-8075-1649ee847ace tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:26.676771 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:37:26.676992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Tue May 10 21:37:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 (ip 10.222.0.49) !!! May 10 21:37:26.756478 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-45660b41-9a8c-48d7-8075-1649ee847ace tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:26.764462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-45660b41-9a8c-48d7-8075-1649ee847ace tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151035 May 10 21:37:26.765023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2429/3205] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:26 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:27.112548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dfef8bc3-6916-4f56-a54f-baed008af988 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:27.113160 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dfef8bc3-6916-4f56-a54f-baed008af988 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:27.119389 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dfef8bc3-6916-4f56-a54f-baed008af988 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:27.119837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dfef8bc3-6916-4f56-a54f-baed008af988 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:27.120601 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dfef8bc3-6916-4f56-a54f-baed008af988 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:27.121038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dfef8bc3-6916-4f56-a54f-baed008af988 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:27.257457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dfef8bc3-6916-4f56-a54f-baed008af988 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:27.265734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dfef8bc3-6916-4f56-a54f-baed008af988 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.157843 May 10 21:37:27.266310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2430/3206] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:27 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:27.397345 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-810f3339-34d7-4b02-9ce8-a46814647a89 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:27.397990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-810f3339-34d7-4b02-9ce8-a46814647a89 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:27.403916 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-810f3339-34d7-4b02-9ce8-a46814647a89 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:27.404369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-810f3339-34d7-4b02-9ce8-a46814647a89 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:27.405133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-810f3339-34d7-4b02-9ce8-a46814647a89 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:27.405581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-810f3339-34d7-4b02-9ce8-a46814647a89 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:27.535738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-810f3339-34d7-4b02-9ce8-a46814647a89 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:27.543608 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-810f3339-34d7-4b02-9ce8-a46814647a89 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150192 May 10 21:37:27.544176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2431/3207] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:27 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:27.781971 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-682c61e6-9e47-4e4d-b7b3-1f26682d14b7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:27.783760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-682c61e6-9e47-4e4d-b7b3-1f26682d14b7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:27.789631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-682c61e6-9e47-4e4d-b7b3-1f26682d14b7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:27.790083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-682c61e6-9e47-4e4d-b7b3-1f26682d14b7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:27.790851 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-682c61e6-9e47-4e4d-b7b3-1f26682d14b7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:27.791322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-682c61e6-9e47-4e4d-b7b3-1f26682d14b7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:27.938106 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-682c61e6-9e47-4e4d-b7b3-1f26682d14b7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:27.946434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-682c61e6-9e47-4e4d-b7b3-1f26682d14b7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.168445 May 10 21:37:27.946999 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2432/3208] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:27 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:28.284899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c317d6a5-9d97-49e9-8060-86cd81c5e281 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:28.285504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c317d6a5-9d97-49e9-8060-86cd81c5e281 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:28.291484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c317d6a5-9d97-49e9-8060-86cd81c5e281 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:28.291928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c317d6a5-9d97-49e9-8060-86cd81c5e281 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:28.292685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c317d6a5-9d97-49e9-8060-86cd81c5e281 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:28.293119 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c317d6a5-9d97-49e9-8060-86cd81c5e281 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:28.432196 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c317d6a5-9d97-49e9-8060-86cd81c5e281 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:28.441031 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c317d6a5-9d97-49e9-8060-86cd81c5e281 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.160969 May 10 21:37:28.441604 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2433/3209] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:28 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:28.561700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fef3d73a-6897-4b78-b1ea-616168fdf763 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:28.562218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fef3d73a-6897-4b78-b1ea-616168fdf763 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:28.568984 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fef3d73a-6897-4b78-b1ea-616168fdf763 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:28.569435 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fef3d73a-6897-4b78-b1ea-616168fdf763 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:28.570213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fef3d73a-6897-4b78-b1ea-616168fdf763 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:28.570654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fef3d73a-6897-4b78-b1ea-616168fdf763 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:28.716502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fef3d73a-6897-4b78-b1ea-616168fdf763 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:28.725232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fef3d73a-6897-4b78-b1ea-616168fdf763 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.167469 May 10 21:37:28.725813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2434/3210] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:28 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:28.969585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-240ad075-caca-45ae-b2cc-bc17057f9756 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:28.970668 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-240ad075-caca-45ae-b2cc-bc17057f9756 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:28.977072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-240ad075-caca-45ae-b2cc-bc17057f9756 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:28.979014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-240ad075-caca-45ae-b2cc-bc17057f9756 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:28.979014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-240ad075-caca-45ae-b2cc-bc17057f9756 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:28.979014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-240ad075-caca-45ae-b2cc-bc17057f9756 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:29.106524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-240ad075-caca-45ae-b2cc-bc17057f9756 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:29.114748 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-240ad075-caca-45ae-b2cc-bc17057f9756 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149035 May 10 21:37:29.115349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2435/3211] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:28 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:29.458654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5b075ff6-bac9-4a53-b192-c2faaa4da966 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:29.459237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5b075ff6-bac9-4a53-b192-c2faaa4da966 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:29.465798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b075ff6-bac9-4a53-b192-c2faaa4da966 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:29.466246 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b075ff6-bac9-4a53-b192-c2faaa4da966 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:29.467006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b075ff6-bac9-4a53-b192-c2faaa4da966 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:29.467464 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b075ff6-bac9-4a53-b192-c2faaa4da966 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:29.599741 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5b075ff6-bac9-4a53-b192-c2faaa4da966 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:29.607930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5b075ff6-bac9-4a53-b192-c2faaa4da966 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.153145 May 10 21:37:29.608421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2436/3212] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:29 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:29.746585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cb1253fe-58ab-42f8-8482-6df2a97b8889 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:29.747113 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cb1253fe-58ab-42f8-8482-6df2a97b8889 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:29.753729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb1253fe-58ab-42f8-8482-6df2a97b8889 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:29.754183 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb1253fe-58ab-42f8-8482-6df2a97b8889 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:29.754953 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb1253fe-58ab-42f8-8482-6df2a97b8889 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:29.755435 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb1253fe-58ab-42f8-8482-6df2a97b8889 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:29.884893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cb1253fe-58ab-42f8-8482-6df2a97b8889 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:29.892876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cb1253fe-58ab-42f8-8482-6df2a97b8889 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.154040 May 10 21:37:29.893441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2437/3213] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:29 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:30.132773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-74ce3f62-cfcb-435f-a5ee-92ba86ac88b1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:30.133443 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-74ce3f62-cfcb-435f-a5ee-92ba86ac88b1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:30.139847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74ce3f62-cfcb-435f-a5ee-92ba86ac88b1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:30.140307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74ce3f62-cfcb-435f-a5ee-92ba86ac88b1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:30.141074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74ce3f62-cfcb-435f-a5ee-92ba86ac88b1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:30.141641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74ce3f62-cfcb-435f-a5ee-92ba86ac88b1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:30.271051 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-74ce3f62-cfcb-435f-a5ee-92ba86ac88b1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:30.278810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-74ce3f62-cfcb-435f-a5ee-92ba86ac88b1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149940 May 10 21:37:30.279420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2438/3214] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:30 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:30.625431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-af34495b-5df8-4e22-bb05-d576c0594b48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:30.626115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-af34495b-5df8-4e22-bb05-d576c0594b48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:30.632173 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af34495b-5df8-4e22-bb05-d576c0594b48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:30.632628 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af34495b-5df8-4e22-bb05-d576c0594b48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:30.633388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af34495b-5df8-4e22-bb05-d576c0594b48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:30.633824 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af34495b-5df8-4e22-bb05-d576c0594b48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:30.765721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-af34495b-5df8-4e22-bb05-d576c0594b48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:30.773574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-af34495b-5df8-4e22-bb05-d576c0594b48 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.152050 May 10 21:37:30.774136 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2439/3215] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:30 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:30.909605 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d663743c-61b8-498e-b3c8-f2a1afc9f278 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:30.910216 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d663743c-61b8-498e-b3c8-f2a1afc9f278 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:30.916118 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d663743c-61b8-498e-b3c8-f2a1afc9f278 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:30.916574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d663743c-61b8-498e-b3c8-f2a1afc9f278 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:30.917345 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d663743c-61b8-498e-b3c8-f2a1afc9f278 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:30.917791 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d663743c-61b8-498e-b3c8-f2a1afc9f278 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:31.043962 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d663743c-61b8-498e-b3c8-f2a1afc9f278 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:31.052085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d663743c-61b8-498e-b3c8-f2a1afc9f278 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.146890 May 10 21:37:31.052657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2440/3216] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:30 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:31.295167 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-25ebb557-f44c-41c4-b0aa-8f7becd3cb78 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:31.295804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-25ebb557-f44c-41c4-b0aa-8f7becd3cb78 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:31.302202 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-25ebb557-f44c-41c4-b0aa-8f7becd3cb78 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:31.302660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-25ebb557-f44c-41c4-b0aa-8f7becd3cb78 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:31.303469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-25ebb557-f44c-41c4-b0aa-8f7becd3cb78 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:31.303912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-25ebb557-f44c-41c4-b0aa-8f7becd3cb78 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:31.437785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-25ebb557-f44c-41c4-b0aa-8f7becd3cb78 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:31.446190 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-25ebb557-f44c-41c4-b0aa-8f7becd3cb78 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.155114 May 10 21:37:31.446757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2441/3217] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:31 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:31.791154 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3138f8ab-5d66-4014-a363-7e2b9d7fb0e5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:31.791767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3138f8ab-5d66-4014-a363-7e2b9d7fb0e5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:31.798222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3138f8ab-5d66-4014-a363-7e2b9d7fb0e5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:31.798758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3138f8ab-5d66-4014-a363-7e2b9d7fb0e5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:31.799550 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3138f8ab-5d66-4014-a363-7e2b9d7fb0e5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:31.799990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3138f8ab-5d66-4014-a363-7e2b9d7fb0e5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:31.926305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3138f8ab-5d66-4014-a363-7e2b9d7fb0e5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:31.934157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3138f8ab-5d66-4014-a363-7e2b9d7fb0e5 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.146901 May 10 21:37:31.934721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2442/3218] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:31 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:32.068680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4ffdf5cd-c33d-4e73-83c2-3c4c8f691910 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:32.069293 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4ffdf5cd-c33d-4e73-83c2-3c4c8f691910 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:32.075264 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4ffdf5cd-c33d-4e73-83c2-3c4c8f691910 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:32.075711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4ffdf5cd-c33d-4e73-83c2-3c4c8f691910 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:32.076460 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4ffdf5cd-c33d-4e73-83c2-3c4c8f691910 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:32.076892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4ffdf5cd-c33d-4e73-83c2-3c4c8f691910 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:32.203619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4ffdf5cd-c33d-4e73-83c2-3c4c8f691910 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:32.211725 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4ffdf5cd-c33d-4e73-83c2-3c4c8f691910 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.146940 May 10 21:37:32.212304 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2443/3219] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:32 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:37:32.464194 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-09c68a37-f838-441e-b907-c4e8561afb8a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:32.464824 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-09c68a37-f838-441e-b907-c4e8561afb8a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:32.471951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-09c68a37-f838-441e-b907-c4e8561afb8a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:32.472405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-09c68a37-f838-441e-b907-c4e8561afb8a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:32.473172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-09c68a37-f838-441e-b907-c4e8561afb8a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:32.473611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-09c68a37-f838-441e-b907-c4e8561afb8a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:32.604174 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-09c68a37-f838-441e-b907-c4e8561afb8a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:32.610799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-09c68a37-f838-441e-b907-c4e8561afb8a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150754 May 10 21:37:32.611422 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2444/3220] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:32 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:32.951205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fefb9605-1e33-4d38-82a9-1027879866f2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:32.951816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fefb9605-1e33-4d38-82a9-1027879866f2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:32.958771 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fefb9605-1e33-4d38-82a9-1027879866f2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:32.959269 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fefb9605-1e33-4d38-82a9-1027879866f2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:32.960038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fefb9605-1e33-4d38-82a9-1027879866f2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:32.960483 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fefb9605-1e33-4d38-82a9-1027879866f2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:33.088822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fefb9605-1e33-4d38-82a9-1027879866f2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:33.096615 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fefb9605-1e33-4d38-82a9-1027879866f2 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.149458 May 10 21:37:33.097181 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2445/3221] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:32 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:33.229833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e62eb232-5f11-4e95-8ba6-8618a5b388ac tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:33.230435 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e62eb232-5f11-4e95-8ba6-8618a5b388ac tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:33.237139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e62eb232-5f11-4e95-8ba6-8618a5b388ac tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:33.237593 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e62eb232-5f11-4e95-8ba6-8618a5b388ac tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:33.238369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e62eb232-5f11-4e95-8ba6-8618a5b388ac tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:33.238814 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e62eb232-5f11-4e95-8ba6-8618a5b388ac tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:33.374420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e62eb232-5f11-4e95-8ba6-8618a5b388ac tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:33.384827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e62eb232-5f11-4e95-8ba6-8618a5b388ac tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.159118 May 10 21:37:33.385413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2446/3222] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:33 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:33.628364 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a710912e-a5ec-480d-a170-a60749c2764e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:33.629108 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a710912e-a5ec-480d-a170-a60749c2764e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:33.635368 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a710912e-a5ec-480d-a170-a60749c2764e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:33.635816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a710912e-a5ec-480d-a170-a60749c2764e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:33.636588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a710912e-a5ec-480d-a170-a60749c2764e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:33.637021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a710912e-a5ec-480d-a170-a60749c2764e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:33.773824 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a710912e-a5ec-480d-a170-a60749c2764e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:33.785141 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a710912e-a5ec-480d-a170-a60749c2764e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.159865 May 10 21:37:33.785731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2447/3223] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:33 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:34.114271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-386b81ca-84e3-45d9-8126-a8eee8e15a76 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:34.114881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-386b81ca-84e3-45d9-8126-a8eee8e15a76 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:34.121014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-386b81ca-84e3-45d9-8126-a8eee8e15a76 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:34.121459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-386b81ca-84e3-45d9-8126-a8eee8e15a76 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:34.122213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-386b81ca-84e3-45d9-8126-a8eee8e15a76 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:34.122646 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-386b81ca-84e3-45d9-8126-a8eee8e15a76 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:34.252890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-386b81ca-84e3-45d9-8126-a8eee8e15a76 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:34.260839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-386b81ca-84e3-45d9-8126-a8eee8e15a76 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.150827 May 10 21:37:34.261416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2448/3224] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:34 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:34.404391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c76a6c5e-376c-4d67-a9d0-12d3c82f00e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:34.404921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c76a6c5e-376c-4d67-a9d0-12d3c82f00e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:34.410910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c76a6c5e-376c-4d67-a9d0-12d3c82f00e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:34.411389 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c76a6c5e-376c-4d67-a9d0-12d3c82f00e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:34.412145 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c76a6c5e-376c-4d67-a9d0-12d3c82f00e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:34.412606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c76a6c5e-376c-4d67-a9d0-12d3c82f00e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:34.537511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c76a6c5e-376c-4d67-a9d0-12d3c82f00e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:34.545227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c76a6c5e-376c-4d67-a9d0-12d3c82f00e7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.144735 May 10 21:37:34.548596 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2449/3225] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:34 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:34.805177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1293ca0d-6d0f-4ba4-8f79-422deaeb21f5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:34.805815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1293ca0d-6d0f-4ba4-8f79-422deaeb21f5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:34.811996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1293ca0d-6d0f-4ba4-8f79-422deaeb21f5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:34.812442 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1293ca0d-6d0f-4ba4-8f79-422deaeb21f5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:34.813776 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1293ca0d-6d0f-4ba4-8f79-422deaeb21f5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:34.814434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1293ca0d-6d0f-4ba4-8f79-422deaeb21f5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:34.942388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1293ca0d-6d0f-4ba4-8f79-422deaeb21f5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:34.950129 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1293ca0d-6d0f-4ba4-8f79-422deaeb21f5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148881 May 10 21:37:34.950698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2450/3226] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:34 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:35.277803 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-165f040c-174d-4e31-910a-34d4ecb44c2a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:35.278431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-165f040c-174d-4e31-910a-34d4ecb44c2a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:35.284575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-165f040c-174d-4e31-910a-34d4ecb44c2a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:35.285034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-165f040c-174d-4e31-910a-34d4ecb44c2a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:35.285804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-165f040c-174d-4e31-910a-34d4ecb44c2a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:35.286249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-165f040c-174d-4e31-910a-34d4ecb44c2a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:35.414691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-165f040c-174d-4e31-910a-34d4ecb44c2a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:35.423052 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-165f040c-174d-4e31-910a-34d4ecb44c2a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148652 May 10 21:37:35.423743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2451/3227] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:35 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:35.561846 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e904a495-7cae-4e23-8b21-76977917c355 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:35.562390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e904a495-7cae-4e23-8b21-76977917c355 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:35.569088 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e904a495-7cae-4e23-8b21-76977917c355 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:35.569557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e904a495-7cae-4e23-8b21-76977917c355 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:35.570314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e904a495-7cae-4e23-8b21-76977917c355 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:35.570759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e904a495-7cae-4e23-8b21-76977917c355 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:35.697126 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e904a495-7cae-4e23-8b21-76977917c355 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:35.705636 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e904a495-7cae-4e23-8b21-76977917c355 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147608 May 10 21:37:35.706207 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2452/3228] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:35 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:35.967997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bebead8c-bd39-4621-a973-fafd095f0f4a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:35.968668 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bebead8c-bd39-4621-a973-fafd095f0f4a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:35.975495 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bebead8c-bd39-4621-a973-fafd095f0f4a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:35.975944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bebead8c-bd39-4621-a973-fafd095f0f4a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:35.976702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bebead8c-bd39-4621-a973-fafd095f0f4a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:35.977135 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bebead8c-bd39-4621-a973-fafd095f0f4a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:36.104818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bebead8c-bd39-4621-a973-fafd095f0f4a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:36.112984 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bebead8c-bd39-4621-a973-fafd095f0f4a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148834 May 10 21:37:36.113573 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2453/3229] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:35 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:36.440796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4a721478-440c-4a72-ac0c-9d9812f2462a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:36.441408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4a721478-440c-4a72-ac0c-9d9812f2462a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:36.447308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a721478-440c-4a72-ac0c-9d9812f2462a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:36.447754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a721478-440c-4a72-ac0c-9d9812f2462a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:36.448508 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a721478-440c-4a72-ac0c-9d9812f2462a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:36.448944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a721478-440c-4a72-ac0c-9d9812f2462a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:36.575303 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4a721478-440c-4a72-ac0c-9d9812f2462a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:36.583826 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4a721478-440c-4a72-ac0c-9d9812f2462a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.147521 May 10 21:37:36.584388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2454/3230] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:36 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:36.727860 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-68db3d37-758f-4796-b57a-648459fb82cd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:36.727860 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-68db3d37-758f-4796-b57a-648459fb82cd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:36.729758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-68db3d37-758f-4796-b57a-648459fb82cd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:36.730206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-68db3d37-758f-4796-b57a-648459fb82cd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:36.730963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-68db3d37-758f-4796-b57a-648459fb82cd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:36.731463 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-68db3d37-758f-4796-b57a-648459fb82cd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:36.861221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-68db3d37-758f-4796-b57a-648459fb82cd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:36.869163 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-68db3d37-758f-4796-b57a-648459fb82cd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150041 May 10 21:37:36.873091 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2455/3231] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:36 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:37.129928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c4a562e8-3673-41d6-9766-832c92271847 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:37.130535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c4a562e8-3673-41d6-9766-832c92271847 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:37.136891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4a562e8-3673-41d6-9766-832c92271847 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:37.137346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4a562e8-3673-41d6-9766-832c92271847 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:37.138115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4a562e8-3673-41d6-9766-832c92271847 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:37.138559 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4a562e8-3673-41d6-9766-832c92271847 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:37.269397 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c4a562e8-3673-41d6-9766-832c92271847 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:37.277098 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c4a562e8-3673-41d6-9766-832c92271847 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151143 May 10 21:37:37.277668 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2456/3232] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:37 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:37.600806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-eb20fc0b-76b7-4cd4-90e0-3da8d1a1c837 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:37.601423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-eb20fc0b-76b7-4cd4-90e0-3da8d1a1c837 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:37.607618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eb20fc0b-76b7-4cd4-90e0-3da8d1a1c837 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:37.608324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eb20fc0b-76b7-4cd4-90e0-3da8d1a1c837 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:37.608820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eb20fc0b-76b7-4cd4-90e0-3da8d1a1c837 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:37.609255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eb20fc0b-76b7-4cd4-90e0-3da8d1a1c837 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:37.736604 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-eb20fc0b-76b7-4cd4-90e0-3da8d1a1c837 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:37.744505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-eb20fc0b-76b7-4cd4-90e0-3da8d1a1c837 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.147622 May 10 21:37:37.745074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2457/3233] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:37 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:37.885995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-40620cc6-47b6-4edf-8ce8-ffc77fa496fd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:37.886525 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-40620cc6-47b6-4edf-8ce8-ffc77fa496fd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:37.892575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-40620cc6-47b6-4edf-8ce8-ffc77fa496fd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:37.893022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-40620cc6-47b6-4edf-8ce8-ffc77fa496fd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:37.893776 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-40620cc6-47b6-4edf-8ce8-ffc77fa496fd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:37.894215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-40620cc6-47b6-4edf-8ce8-ffc77fa496fd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:38.024672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-40620cc6-47b6-4edf-8ce8-ffc77fa496fd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:38.033193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-40620cc6-47b6-4edf-8ce8-ffc77fa496fd tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151011 May 10 21:37:38.033756 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2458/3234] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:37 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:38.293673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9448a640-aabc-43b1-9834-828ce9b41997 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:38.294302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9448a640-aabc-43b1-9834-828ce9b41997 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:38.300677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9448a640-aabc-43b1-9834-828ce9b41997 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:38.301127 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9448a640-aabc-43b1-9834-828ce9b41997 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:38.301891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9448a640-aabc-43b1-9834-828ce9b41997 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:38.302327 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9448a640-aabc-43b1-9834-828ce9b41997 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:38.429341 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9448a640-aabc-43b1-9834-828ce9b41997 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:38.437123 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9448a640-aabc-43b1-9834-828ce9b41997 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.147345 May 10 21:37:38.437691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2459/3235] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:38 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:38.762346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d70fed91-2672-4d7f-aa1e-3760cd3d3b85 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:38.762958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d70fed91-2672-4d7f-aa1e-3760cd3d3b85 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:38.769688 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d70fed91-2672-4d7f-aa1e-3760cd3d3b85 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:38.770131 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d70fed91-2672-4d7f-aa1e-3760cd3d3b85 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:38.770923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d70fed91-2672-4d7f-aa1e-3760cd3d3b85 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:38.771393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d70fed91-2672-4d7f-aa1e-3760cd3d3b85 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:38.899204 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d70fed91-2672-4d7f-aa1e-3760cd3d3b85 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:38.906911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d70fed91-2672-4d7f-aa1e-3760cd3d3b85 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.148401 May 10 21:37:38.907650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2460/3236] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:38 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:39.050337 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c5953fcb-dc66-4a7d-80b6-df9e4b6e6dd4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:39.050945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c5953fcb-dc66-4a7d-80b6-df9e4b6e6dd4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:39.056866 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5953fcb-dc66-4a7d-80b6-df9e4b6e6dd4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:39.057318 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5953fcb-dc66-4a7d-80b6-df9e4b6e6dd4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:39.058071 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5953fcb-dc66-4a7d-80b6-df9e4b6e6dd4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:39.058505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5953fcb-dc66-4a7d-80b6-df9e4b6e6dd4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:39.184505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c5953fcb-dc66-4a7d-80b6-df9e4b6e6dd4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:39.193045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c5953fcb-dc66-4a7d-80b6-df9e4b6e6dd4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147174 May 10 21:37:39.193617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2461/3237] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:39 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:39.453999 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5ffd38aa-f943-4a76-ba9b-1f46c33373ee tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:39.455577 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5ffd38aa-f943-4a76-ba9b-1f46c33373ee tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:39.462489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ffd38aa-f943-4a76-ba9b-1f46c33373ee tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:39.463285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ffd38aa-f943-4a76-ba9b-1f46c33373ee tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:39.464147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ffd38aa-f943-4a76-ba9b-1f46c33373ee tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:39.464652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ffd38aa-f943-4a76-ba9b-1f46c33373ee tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:39.604947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5ffd38aa-f943-4a76-ba9b-1f46c33373ee tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:39.616364 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5ffd38aa-f943-4a76-ba9b-1f46c33373ee tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.166254 May 10 21:37:39.617515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2462/3238] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:39 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:39.924232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9b91b38a-4f1e-48c9-b3c9-893666872ac3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:39.924857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9b91b38a-4f1e-48c9-b3c9-893666872ac3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:39.930884 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9b91b38a-4f1e-48c9-b3c9-893666872ac3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:39.931384 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9b91b38a-4f1e-48c9-b3c9-893666872ac3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:39.932156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9b91b38a-4f1e-48c9-b3c9-893666872ac3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:39.932598 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9b91b38a-4f1e-48c9-b3c9-893666872ac3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:40.302125 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9b91b38a-4f1e-48c9-b3c9-893666872ac3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:40.309787 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9b91b38a-4f1e-48c9-b3c9-893666872ac3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1728 microversion: 2.1 time: 0.389570 May 10 21:37:40.310358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2463/3239] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:39 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1728 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:40.315632 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8c3a5360-a1cf-4170-b4c9-a13f5d81dc06 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:40.316219 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8c3a5360-a1cf-4170-b4c9-a13f5d81dc06 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:40.321701 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c3a5360-a1cf-4170-b4c9-a13f5d81dc06 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:40.322151 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c3a5360-a1cf-4170-b4c9-a13f5d81dc06 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:40.322937 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c3a5360-a1cf-4170-b4c9-a13f5d81dc06 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:40.323399 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c3a5360-a1cf-4170-b4c9-a13f5d81dc06 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:40.537814 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8c3a5360-a1cf-4170-b4c9-a13f5d81dc06 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:40.545995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8c3a5360-a1cf-4170-b4c9-a13f5d81dc06 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.234615 May 10 21:37:40.546652 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2464/3240] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:40 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:37:40.634026 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-db7f0b54-f57b-4fc3-877b-1e570afc2402 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:40.634647 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-db7f0b54-f57b-4fc3-877b-1e570afc2402 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:40.640708 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-db7f0b54-f57b-4fc3-877b-1e570afc2402 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:40.641170 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-db7f0b54-f57b-4fc3-877b-1e570afc2402 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:40.642134 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-db7f0b54-f57b-4fc3-877b-1e570afc2402 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:40.642579 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-db7f0b54-f57b-4fc3-877b-1e570afc2402 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:40.887478 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-db7f0b54-f57b-4fc3-877b-1e570afc2402 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:40.895524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-db7f0b54-f57b-4fc3-877b-1e570afc2402 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.265424 May 10 21:37:40.896101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2465/3241] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:40 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:41.327633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fd0dbc88-314c-4c4e-b866-63ce5a3125f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:41.328160 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fd0dbc88-314c-4c4e-b866-63ce5a3125f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:41.334357 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fd0dbc88-314c-4c4e-b866-63ce5a3125f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:41.334806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fd0dbc88-314c-4c4e-b866-63ce5a3125f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:41.335613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fd0dbc88-314c-4c4e-b866-63ce5a3125f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:41.336072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fd0dbc88-314c-4c4e-b866-63ce5a3125f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:41.419826 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fd0dbc88-314c-4c4e-b866-63ce5a3125f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:41.432182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fd0dbc88-314c-4c4e-b866-63ce5a3125f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1660 microversion: 2.1 time: 0.108458 May 10 21:37:41.432772 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2466/3242] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:41 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1660 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:41.505509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-36e69a3d-fe50-47ac-b5a3-3a81918ee81c req-05e00c61-c82c-4a89-82d3-14dbebce1a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b28c992-788d-4e37-b194-aaf2fb61577b", "name": "network-vif-deleted", "tag": "f92cd78e-033b-4a35-8495-6a1fd5b8ba63"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:37:41.513765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-36e69a3d-fe50-47ac-b5a3-3a81918ee81c req-05e00c61-c82c-4a89-82d3-14dbebce1a9b service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:41.514214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-36e69a3d-fe50-47ac-b5a3-3a81918ee81c req-05e00c61-c82c-4a89-82d3-14dbebce1a9b service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:41.526390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-36e69a3d-fe50-47ac-b5a3-3a81918ee81c req-05e00c61-c82c-4a89-82d3-14dbebce1a9b service nova] Creating event network-vif-deleted:f92cd78e-033b-4a35-8495-6a1fd5b8ba63 for instance 4b28c992-788d-4e37-b194-aaf2fb61577b on hv-cinder-82880 May 10 21:37:41.533362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-36e69a3d-fe50-47ac-b5a3-3a81918ee81c req-05e00c61-c82c-4a89-82d3-14dbebce1a9b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099090 May 10 21:37:41.533906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2467/3243] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:37:41.566170 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5f5111f0-6339-48b4-90cf-91a681e7e418 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:41.566882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5f5111f0-6339-48b4-90cf-91a681e7e418 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:41.573707 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f5111f0-6339-48b4-90cf-91a681e7e418 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:41.574157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f5111f0-6339-48b4-90cf-91a681e7e418 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:41.574964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f5111f0-6339-48b4-90cf-91a681e7e418 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:41.575427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f5111f0-6339-48b4-90cf-91a681e7e418 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:41.717979 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5f5111f0-6339-48b4-90cf-91a681e7e418 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:41.726762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5f5111f0-6339-48b4-90cf-91a681e7e418 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.165082 May 10 21:37:41.727455 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2468/3244] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:41 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:37:41.919485 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1f196b46-8dd9-4c1b-a96f-553c6a5bab35 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:41.920129 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1f196b46-8dd9-4c1b-a96f-553c6a5bab35 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:41.926624 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1f196b46-8dd9-4c1b-a96f-553c6a5bab35 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:41.927076 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1f196b46-8dd9-4c1b-a96f-553c6a5bab35 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:41.927875 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1f196b46-8dd9-4c1b-a96f-553c6a5bab35 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:41.928308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1f196b46-8dd9-4c1b-a96f-553c6a5bab35 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:42.063810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1f196b46-8dd9-4c1b-a96f-553c6a5bab35 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:42.071676 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1f196b46-8dd9-4c1b-a96f-553c6a5bab35 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.156108 May 10 21:37:42.072249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2469/3245] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:41 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:42.449819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e95e47f3-f3ca-4bd3-b523-3216866ee668 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:42.450492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e95e47f3-f3ca-4bd3-b523-3216866ee668 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:42.456612 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e95e47f3-f3ca-4bd3-b523-3216866ee668 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:42.457142 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e95e47f3-f3ca-4bd3-b523-3216866ee668 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:42.457924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e95e47f3-f3ca-4bd3-b523-3216866ee668 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:42.458366 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e95e47f3-f3ca-4bd3-b523-3216866ee668 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:42.522852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e95e47f3-f3ca-4bd3-b523-3216866ee668 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:42.530778 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e95e47f3-f3ca-4bd3-b523-3216866ee668 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1372 microversion: 2.1 time: 0.085020 May 10 21:37:42.531392 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2470/3246] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:42 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:42.744651 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-69d2d9e5-4e68-4d10-831f-ee3a944a5065 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:42.745264 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-69d2d9e5-4e68-4d10-831f-ee3a944a5065 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:42.751212 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-69d2d9e5-4e68-4d10-831f-ee3a944a5065 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:42.751699 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-69d2d9e5-4e68-4d10-831f-ee3a944a5065 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:42.752458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-69d2d9e5-4e68-4d10-831f-ee3a944a5065 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:42.752895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-69d2d9e5-4e68-4d10-831f-ee3a944a5065 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:42.883084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-69d2d9e5-4e68-4d10-831f-ee3a944a5065 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:42.890913 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-69d2d9e5-4e68-4d10-831f-ee3a944a5065 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150254 May 10 21:37:42.892191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2471/3247] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:42 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:43.088881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-47c3507a-86c8-4d32-b3f4-7eccdd77c336 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:43.089511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-47c3507a-86c8-4d32-b3f4-7eccdd77c336 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:43.096201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47c3507a-86c8-4d32-b3f4-7eccdd77c336 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:43.096657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47c3507a-86c8-4d32-b3f4-7eccdd77c336 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:43.097429 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47c3507a-86c8-4d32-b3f4-7eccdd77c336 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:43.097875 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-47c3507a-86c8-4d32-b3f4-7eccdd77c336 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:43.224634 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-47c3507a-86c8-4d32-b3f4-7eccdd77c336 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:43.232518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-47c3507a-86c8-4d32-b3f4-7eccdd77c336 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.147756 May 10 21:37:43.233089 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2472/3248] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:43 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:43.548859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c349237b-79e3-4acf-ab69-3ba28d801765 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:43.549468 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c349237b-79e3-4acf-ab69-3ba28d801765 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:43.555830 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c349237b-79e3-4acf-ab69-3ba28d801765 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:43.556282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c349237b-79e3-4acf-ab69-3ba28d801765 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:43.557047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c349237b-79e3-4acf-ab69-3ba28d801765 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:43.557484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c349237b-79e3-4acf-ab69-3ba28d801765 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:43.620728 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c349237b-79e3-4acf-ab69-3ba28d801765 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:43.629424 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c349237b-79e3-4acf-ab69-3ba28d801765 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1372 microversion: 2.1 time: 0.085102 May 10 21:37:43.629992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2473/3249] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:43 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:43.908919 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-36fadafc-a1fd-4b2b-aa5b-ad9a65a73030 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:43.909575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-36fadafc-a1fd-4b2b-aa5b-ad9a65a73030 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:43.915570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-36fadafc-a1fd-4b2b-aa5b-ad9a65a73030 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:43.916027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-36fadafc-a1fd-4b2b-aa5b-ad9a65a73030 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:43.916836 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-36fadafc-a1fd-4b2b-aa5b-ad9a65a73030 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:43.917284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-36fadafc-a1fd-4b2b-aa5b-ad9a65a73030 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:44.045959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-36fadafc-a1fd-4b2b-aa5b-ad9a65a73030 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:44.054457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-36fadafc-a1fd-4b2b-aa5b-ad9a65a73030 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149969 May 10 21:37:44.055042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2474/3250] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:43 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:44.249348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c9a90b49-6ee6-4956-a57b-8ae7c9a23996 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:44.249893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c9a90b49-6ee6-4956-a57b-8ae7c9a23996 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:44.255996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9a90b49-6ee6-4956-a57b-8ae7c9a23996 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:44.256448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9a90b49-6ee6-4956-a57b-8ae7c9a23996 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:44.257224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9a90b49-6ee6-4956-a57b-8ae7c9a23996 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:44.257663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9a90b49-6ee6-4956-a57b-8ae7c9a23996 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:44.383539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c9a90b49-6ee6-4956-a57b-8ae7c9a23996 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:44.391951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c9a90b49-6ee6-4956-a57b-8ae7c9a23996 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.145826 May 10 21:37:44.392519 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2475/3251] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:44 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:44.646063 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d0b6f74e-e146-4913-9779-0292256cee8c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:44.646674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d0b6f74e-e146-4913-9779-0292256cee8c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:44.652977 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0b6f74e-e146-4913-9779-0292256cee8c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:44.653425 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0b6f74e-e146-4913-9779-0292256cee8c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:44.654178 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0b6f74e-e146-4913-9779-0292256cee8c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:44.654611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0b6f74e-e146-4913-9779-0292256cee8c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:44.716571 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d0b6f74e-e146-4913-9779-0292256cee8c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:44.724492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d0b6f74e-e146-4913-9779-0292256cee8c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1372 microversion: 2.1 time: 0.082325 May 10 21:37:44.725057 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2476/3252] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:44 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:45.070997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e4ec9f47-7863-499a-a695-4371ac983233 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:45.071678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e4ec9f47-7863-499a-a695-4371ac983233 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:45.077617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4ec9f47-7863-499a-a695-4371ac983233 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:45.078068 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4ec9f47-7863-499a-a695-4371ac983233 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:45.079454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4ec9f47-7863-499a-a695-4371ac983233 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:45.079894 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e4ec9f47-7863-499a-a695-4371ac983233 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:45.211251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e4ec9f47-7863-499a-a695-4371ac983233 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:45.220085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e4ec9f47-7863-499a-a695-4371ac983233 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.152109 May 10 21:37:45.220736 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2477/3253] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:45 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:45.409949 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d09df727-11d6-4d5c-9d26-f954cf7d024c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:45.410555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d09df727-11d6-4d5c-9d26-f954cf7d024c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:45.416409 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d09df727-11d6-4d5c-9d26-f954cf7d024c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:45.416855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d09df727-11d6-4d5c-9d26-f954cf7d024c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:45.417605 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d09df727-11d6-4d5c-9d26-f954cf7d024c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:45.418041 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d09df727-11d6-4d5c-9d26-f954cf7d024c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:45.545711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d09df727-11d6-4d5c-9d26-f954cf7d024c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:45.553880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d09df727-11d6-4d5c-9d26-f954cf7d024c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148437 May 10 21:37:45.554452 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2478/3254] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:45 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:45.741726 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-02874f20-eacb-4543-97e6-9a12e699f4ac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:45.742262 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-02874f20-eacb-4543-97e6-9a12e699f4ac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:45.748558 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-02874f20-eacb-4543-97e6-9a12e699f4ac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:45.749012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-02874f20-eacb-4543-97e6-9a12e699f4ac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:45.749774 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-02874f20-eacb-4543-97e6-9a12e699f4ac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:45.750211 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-02874f20-eacb-4543-97e6-9a12e699f4ac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:45.812200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-02874f20-eacb-4543-97e6-9a12e699f4ac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:45.820597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-02874f20-eacb-4543-97e6-9a12e699f4ac tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1372 microversion: 2.1 time: 0.082739 May 10 21:37:45.821160 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2479/3255] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:45 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:37:46.237163 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2d86c814-e31d-482a-b717-d85b1be3ebe3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:46.237877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2d86c814-e31d-482a-b717-d85b1be3ebe3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:46.243828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d86c814-e31d-482a-b717-d85b1be3ebe3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:46.244279 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d86c814-e31d-482a-b717-d85b1be3ebe3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:46.245057 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d86c814-e31d-482a-b717-d85b1be3ebe3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:46.245496 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d86c814-e31d-482a-b717-d85b1be3ebe3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:46.374473 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2d86c814-e31d-482a-b717-d85b1be3ebe3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:46.383053 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2d86c814-e31d-482a-b717-d85b1be3ebe3 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149903 May 10 21:37:46.383646 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2480/3256] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:46 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:46.571814 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f6f402b4-4941-42c1-95e9-002b3580dc5f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:46.572343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f6f402b4-4941-42c1-95e9-002b3580dc5f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:46.578251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6f402b4-4941-42c1-95e9-002b3580dc5f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:46.579112 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6f402b4-4941-42c1-95e9-002b3580dc5f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:46.579925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6f402b4-4941-42c1-95e9-002b3580dc5f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:46.580376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6f402b4-4941-42c1-95e9-002b3580dc5f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:46.708307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f6f402b4-4941-42c1-95e9-002b3580dc5f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:46.716420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f6f402b4-4941-42c1-95e9-002b3580dc5f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148517 May 10 21:37:46.716975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2481/3257] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:46 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:46.838538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-187bd85a-1614-4364-97b6-2f87478c2b3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:46.839204 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-187bd85a-1614-4364-97b6-2f87478c2b3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:46.846387 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-187bd85a-1614-4364-97b6-2f87478c2b3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:46.846834 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-187bd85a-1614-4364-97b6-2f87478c2b3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:46.847629 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-187bd85a-1614-4364-97b6-2f87478c2b3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:46.848068 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-187bd85a-1614-4364-97b6-2f87478c2b3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:46.910566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-187bd85a-1614-4364-97b6-2f87478c2b3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:46.918412 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-187bd85a-1614-4364-97b6-2f87478c2b3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1372 microversion: 2.1 time: 0.083966 May 10 21:37:46.918986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2482/3258] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:46 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:47.400714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3baddd12-991c-4ed5-9550-6651798e8fd5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:47.401405 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3baddd12-991c-4ed5-9550-6651798e8fd5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:47.407517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3baddd12-991c-4ed5-9550-6651798e8fd5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:47.408079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3baddd12-991c-4ed5-9550-6651798e8fd5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:47.408839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3baddd12-991c-4ed5-9550-6651798e8fd5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:47.409305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3baddd12-991c-4ed5-9550-6651798e8fd5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:47.540206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3baddd12-991c-4ed5-9550-6651798e8fd5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:47.548877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3baddd12-991c-4ed5-9550-6651798e8fd5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.152026 May 10 21:37:47.549441 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2483/3259] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:47 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:47.732730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-61b55d4d-9668-4b0c-a5ea-18e655ed0f4c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:47.733362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-61b55d4d-9668-4b0c-a5ea-18e655ed0f4c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:47.739800 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-61b55d4d-9668-4b0c-a5ea-18e655ed0f4c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:47.740243 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-61b55d4d-9668-4b0c-a5ea-18e655ed0f4c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:47.740995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-61b55d4d-9668-4b0c-a5ea-18e655ed0f4c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:47.741429 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-61b55d4d-9668-4b0c-a5ea-18e655ed0f4c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:47.868619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-61b55d4d-9668-4b0c-a5ea-18e655ed0f4c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:47.876580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-61b55d4d-9668-4b0c-a5ea-18e655ed0f4c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.147762 May 10 21:37:47.877154 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2484/3260] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:47 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:47.934152 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a6919875-cd63-4217-856d-62ab060840f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:47.934770 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a6919875-cd63-4217-856d-62ab060840f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:47.940806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a6919875-cd63-4217-856d-62ab060840f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:47.941258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a6919875-cd63-4217-856d-62ab060840f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:47.942026 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a6919875-cd63-4217-856d-62ab060840f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:47.942464 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a6919875-cd63-4217-856d-62ab060840f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:48.006602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a6919875-cd63-4217-856d-62ab060840f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:48.014429 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a6919875-cd63-4217-856d-62ab060840f1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1372 microversion: 2.1 time: 0.083965 May 10 21:37:48.014995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2485/3261] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:47 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:48.566722 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e8f08e3f-c9a1-4d84-9b5f-6c2d184bd75d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:48.567416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e8f08e3f-c9a1-4d84-9b5f-6c2d184bd75d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:48.573383 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e8f08e3f-c9a1-4d84-9b5f-6c2d184bd75d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:48.573836 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e8f08e3f-c9a1-4d84-9b5f-6c2d184bd75d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:48.574598 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e8f08e3f-c9a1-4d84-9b5f-6c2d184bd75d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:48.575038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e8f08e3f-c9a1-4d84-9b5f-6c2d184bd75d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:48.704384 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e8f08e3f-c9a1-4d84-9b5f-6c2d184bd75d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:48.712267 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e8f08e3f-c9a1-4d84-9b5f-6c2d184bd75d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150338 May 10 21:37:48.712842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2486/3262] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:48 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:48.894201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0ca7194d-43b3-4cb3-bde9-ea6c9a463b1b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:48.894850 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0ca7194d-43b3-4cb3-bde9-ea6c9a463b1b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:48.901218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ca7194d-43b3-4cb3-bde9-ea6c9a463b1b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:48.901672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ca7194d-43b3-4cb3-bde9-ea6c9a463b1b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:48.902436 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ca7194d-43b3-4cb3-bde9-ea6c9a463b1b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:48.902876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ca7194d-43b3-4cb3-bde9-ea6c9a463b1b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:49.030133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0ca7194d-43b3-4cb3-bde9-ea6c9a463b1b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:49.038524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0ca7194d-43b3-4cb3-bde9-ea6c9a463b1b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148724 May 10 21:37:49.039090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2487/3263] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:48 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:49.043416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b04a41af-1659-420e-96d9-7a8ab24ab361 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:49.044019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b04a41af-1659-420e-96d9-7a8ab24ab361 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:49.050414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b04a41af-1659-420e-96d9-7a8ab24ab361 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:49.050880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b04a41af-1659-420e-96d9-7a8ab24ab361 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:49.051657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b04a41af-1659-420e-96d9-7a8ab24ab361 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:49.052101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b04a41af-1659-420e-96d9-7a8ab24ab361 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:49.118526 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b04a41af-1659-420e-96d9-7a8ab24ab361 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:49.126677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b04a41af-1659-420e-96d9-7a8ab24ab361 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1372 microversion: 2.1 time: 0.086640 May 10 21:37:49.127262 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2488/3264] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:49 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:37:49.729523 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-46ded780-3b16-452e-8d41-af02cc99146f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:49.730170 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-46ded780-3b16-452e-8d41-af02cc99146f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:49.737232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-46ded780-3b16-452e-8d41-af02cc99146f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:49.738483 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-46ded780-3b16-452e-8d41-af02cc99146f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:49.738483 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-46ded780-3b16-452e-8d41-af02cc99146f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:49.738943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-46ded780-3b16-452e-8d41-af02cc99146f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:49.867555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-46ded780-3b16-452e-8d41-af02cc99146f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:49.875353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-46ded780-3b16-452e-8d41-af02cc99146f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149650 May 10 21:37:49.876112 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2489/3265] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:49 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:50.055473 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ca53dfc7-fb10-4e41-a33a-d2214a2a49b7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:50.056095 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ca53dfc7-fb10-4e41-a33a-d2214a2a49b7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:50.062450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ca53dfc7-fb10-4e41-a33a-d2214a2a49b7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:50.063554 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ca53dfc7-fb10-4e41-a33a-d2214a2a49b7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:50.064428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ca53dfc7-fb10-4e41-a33a-d2214a2a49b7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:50.064886 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ca53dfc7-fb10-4e41-a33a-d2214a2a49b7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:50.194577 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ca53dfc7-fb10-4e41-a33a-d2214a2a49b7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:50.202333 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ca53dfc7-fb10-4e41-a33a-d2214a2a49b7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150683 May 10 21:37:50.202898 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2490/3266] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:50 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:50.207897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7c68176a-da21-46da-aba3-fa342b9e32b8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:50.208505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7c68176a-da21-46da-aba3-fa342b9e32b8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:50.214266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c68176a-da21-46da-aba3-fa342b9e32b8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:50.214719 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c68176a-da21-46da-aba3-fa342b9e32b8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:50.215503 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c68176a-da21-46da-aba3-fa342b9e32b8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:50.215943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c68176a-da21-46da-aba3-fa342b9e32b8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:50.280789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7c68176a-da21-46da-aba3-fa342b9e32b8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:50.288766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7c68176a-da21-46da-aba3-fa342b9e32b8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1372 microversion: 2.1 time: 0.084899 May 10 21:37:50.289331 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2491/3267] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:50 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:37:50.892603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c68b2d6a-3c60-4b49-a7f1-baff672410dc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:50.893259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c68b2d6a-3c60-4b49-a7f1-baff672410dc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:50.899098 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c68b2d6a-3c60-4b49-a7f1-baff672410dc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:50.899589 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c68b2d6a-3c60-4b49-a7f1-baff672410dc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:50.900358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c68b2d6a-3c60-4b49-a7f1-baff672410dc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:50.900804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c68b2d6a-3c60-4b49-a7f1-baff672410dc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:51.030869 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c68b2d6a-3c60-4b49-a7f1-baff672410dc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:51.039355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c68b2d6a-3c60-4b49-a7f1-baff672410dc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150801 May 10 21:37:51.039917 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2492/3268] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:50 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:51.220903 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5b104a1b-4609-4798-89a6-42063a935cc8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:51.221443 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5b104a1b-4609-4798-89a6-42063a935cc8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:51.227861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b104a1b-4609-4798-89a6-42063a935cc8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:51.228315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b104a1b-4609-4798-89a6-42063a935cc8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:51.229085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b104a1b-4609-4798-89a6-42063a935cc8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:51.229525 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5b104a1b-4609-4798-89a6-42063a935cc8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:51.358286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5b104a1b-4609-4798-89a6-42063a935cc8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:51.366200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5b104a1b-4609-4798-89a6-42063a935cc8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149854 May 10 21:37:51.366766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2493/3269] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:51 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:51.371212 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-89eb0632-fa0c-4e0f-bca6-61077885163f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:51.371810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-89eb0632-fa0c-4e0f-bca6-61077885163f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:51.377758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89eb0632-fa0c-4e0f-bca6-61077885163f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:51.378205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89eb0632-fa0c-4e0f-bca6-61077885163f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:51.378995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89eb0632-fa0c-4e0f-bca6-61077885163f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:51.379457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-89eb0632-fa0c-4e0f-bca6-61077885163f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:51.443149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-89eb0632-fa0c-4e0f-bca6-61077885163f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:51.451239 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-89eb0632-fa0c-4e0f-bca6-61077885163f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1372 microversion: 2.1 time: 0.083451 May 10 21:37:51.451810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2494/3270] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:51 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:37:52.056750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-55cfe55f-6ab7-4ee6-a564-174830a6ae2e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:52.057409 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-55cfe55f-6ab7-4ee6-a564-174830a6ae2e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:52.064009 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-55cfe55f-6ab7-4ee6-a564-174830a6ae2e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:52.064476 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-55cfe55f-6ab7-4ee6-a564-174830a6ae2e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:52.065255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-55cfe55f-6ab7-4ee6-a564-174830a6ae2e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:52.065702 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-55cfe55f-6ab7-4ee6-a564-174830a6ae2e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:52.194010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-55cfe55f-6ab7-4ee6-a564-174830a6ae2e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:52.201855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-55cfe55f-6ab7-4ee6-a564-174830a6ae2e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149094 May 10 21:37:52.202416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2495/3271] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:52 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:52.383083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-78436308-0f80-4f7c-8e39-1927aa073522 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:52.383713 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-78436308-0f80-4f7c-8e39-1927aa073522 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:52.389979 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-78436308-0f80-4f7c-8e39-1927aa073522 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:52.390427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-78436308-0f80-4f7c-8e39-1927aa073522 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:52.391202 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-78436308-0f80-4f7c-8e39-1927aa073522 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:52.391865 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-78436308-0f80-4f7c-8e39-1927aa073522 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:52.520622 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-78436308-0f80-4f7c-8e39-1927aa073522 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:52.528483 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-78436308-0f80-4f7c-8e39-1927aa073522 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149308 May 10 21:37:52.529157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2496/3272] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:52 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:52.534781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a8f21847-c879-4f70-a321-65255ed37c51 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:52.535851 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a8f21847-c879-4f70-a321-65255ed37c51 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:52.541801 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a8f21847-c879-4f70-a321-65255ed37c51 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:52.542245 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a8f21847-c879-4f70-a321-65255ed37c51 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:52.543010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a8f21847-c879-4f70-a321-65255ed37c51 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:52.543507 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a8f21847-c879-4f70-a321-65255ed37c51 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:52.608043 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a8f21847-c879-4f70-a321-65255ed37c51 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:52.616635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a8f21847-c879-4f70-a321-65255ed37c51 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1372 microversion: 2.1 time: 0.086539 May 10 21:37:52.617199 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2497/3273] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:52 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:37:53.219147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-17e15395-16dc-4d5f-81a1-811c2576168c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:53.220308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-17e15395-16dc-4d5f-81a1-811c2576168c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:53.225854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17e15395-16dc-4d5f-81a1-811c2576168c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:53.226296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17e15395-16dc-4d5f-81a1-811c2576168c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:53.227051 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17e15395-16dc-4d5f-81a1-811c2576168c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:53.227507 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17e15395-16dc-4d5f-81a1-811c2576168c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:53.355442 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-17e15395-16dc-4d5f-81a1-811c2576168c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:53.363928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-17e15395-16dc-4d5f-81a1-811c2576168c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148731 May 10 21:37:53.364486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2498/3274] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:53 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:53.546216 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9359b13e-dcb8-4f3e-b9d9-f08252e42b38 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:53.546822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9359b13e-dcb8-4f3e-b9d9-f08252e42b38 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:53.553629 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9359b13e-dcb8-4f3e-b9d9-f08252e42b38 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:53.554163 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9359b13e-dcb8-4f3e-b9d9-f08252e42b38 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:53.554859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9359b13e-dcb8-4f3e-b9d9-f08252e42b38 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:53.555324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9359b13e-dcb8-4f3e-b9d9-f08252e42b38 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:53.685342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9359b13e-dcb8-4f3e-b9d9-f08252e42b38 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:53.693627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9359b13e-dcb8-4f3e-b9d9-f08252e42b38 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151208 May 10 21:37:53.694182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2499/3275] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:53 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:53.698466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4a1cadec-26f3-4c56-ae24-627d8c6ec7ff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:53.705322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4a1cadec-26f3-4c56-ae24-627d8c6ec7ff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:53.705322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a1cadec-26f3-4c56-ae24-627d8c6ec7ff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:53.705726 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a1cadec-26f3-4c56-ae24-627d8c6ec7ff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:53.706502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a1cadec-26f3-4c56-ae24-627d8c6ec7ff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:53.706977 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4a1cadec-26f3-4c56-ae24-627d8c6ec7ff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:53.772230 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4a1cadec-26f3-4c56-ae24-627d8c6ec7ff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:53.780009 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4a1cadec-26f3-4c56-ae24-627d8c6ec7ff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1372 microversion: 2.1 time: 0.084900 May 10 21:37:53.780573 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2500/3276] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:53 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:37:54.381350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c285a44c-f7e2-49a7-be42-f796ffcdd323 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:54.382037 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c285a44c-f7e2-49a7-be42-f796ffcdd323 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:54.387947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c285a44c-f7e2-49a7-be42-f796ffcdd323 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:54.388399 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c285a44c-f7e2-49a7-be42-f796ffcdd323 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:54.389160 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c285a44c-f7e2-49a7-be42-f796ffcdd323 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:54.389599 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c285a44c-f7e2-49a7-be42-f796ffcdd323 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:54.522661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c285a44c-f7e2-49a7-be42-f796ffcdd323 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:54.526114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c285a44c-f7e2-49a7-be42-f796ffcdd323 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148668 May 10 21:37:54.526690 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2501/3277] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:54 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:54.710708 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b6eb1eea-c6b2-423b-8771-d5b4197b0e49 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:54.711615 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b6eb1eea-c6b2-423b-8771-d5b4197b0e49 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:54.718694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b6eb1eea-c6b2-423b-8771-d5b4197b0e49 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:54.719177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b6eb1eea-c6b2-423b-8771-d5b4197b0e49 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:54.720462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b6eb1eea-c6b2-423b-8771-d5b4197b0e49 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:54.720927 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b6eb1eea-c6b2-423b-8771-d5b4197b0e49 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:54.848850 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b6eb1eea-c6b2-423b-8771-d5b4197b0e49 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:54.856690 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b6eb1eea-c6b2-423b-8771-d5b4197b0e49 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149908 May 10 21:37:54.857249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2502/3278] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:54 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:54.861762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-35a91be4-4e14-47bd-92bc-c7afbcefb1fd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:54.862357 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-35a91be4-4e14-47bd-92bc-c7afbcefb1fd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:54.867906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-35a91be4-4e14-47bd-92bc-c7afbcefb1fd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:54.868353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-35a91be4-4e14-47bd-92bc-c7afbcefb1fd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:54.869104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-35a91be4-4e14-47bd-92bc-c7afbcefb1fd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:54.869541 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-35a91be4-4e14-47bd-92bc-c7afbcefb1fd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:54.932392 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-35a91be4-4e14-47bd-92bc-c7afbcefb1fd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:54.940273 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-35a91be4-4e14-47bd-92bc-c7afbcefb1fd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1372 microversion: 2.1 time: 0.082057 May 10 21:37:54.940836 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2503/3279] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:54 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:37:55.546200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4979bdd5-f5c3-4d54-81a2-e0737d860a21 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:55.546861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4979bdd5-f5c3-4d54-81a2-e0737d860a21 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:55.558200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4979bdd5-f5c3-4d54-81a2-e0737d860a21 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:55.558661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4979bdd5-f5c3-4d54-81a2-e0737d860a21 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:55.559480 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4979bdd5-f5c3-4d54-81a2-e0737d860a21 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:55.559920 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4979bdd5-f5c3-4d54-81a2-e0737d860a21 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:55.689470 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4979bdd5-f5c3-4d54-81a2-e0737d860a21 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:55.697342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4979bdd5-f5c3-4d54-81a2-e0737d860a21 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.155436 May 10 21:37:55.697911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2504/3280] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:55 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:55.873720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-25cadb0d-60f2-4805-8243-a214da530859 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:55.874327 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-25cadb0d-60f2-4805-8243-a214da530859 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:55.881333 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-25cadb0d-60f2-4805-8243-a214da530859 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:55.881782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-25cadb0d-60f2-4805-8243-a214da530859 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:55.882536 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-25cadb0d-60f2-4805-8243-a214da530859 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:55.882967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-25cadb0d-60f2-4805-8243-a214da530859 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:56.011554 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-25cadb0d-60f2-4805-8243-a214da530859 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:56.019466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-25cadb0d-60f2-4805-8243-a214da530859 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149579 May 10 21:37:56.020042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2505/3281] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:55 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:56.024390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cd893c35-828f-4266-9bdd-7b22635ff911 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:56.025000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cd893c35-828f-4266-9bdd-7b22635ff911 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:56.030502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd893c35-828f-4266-9bdd-7b22635ff911 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:56.030959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd893c35-828f-4266-9bdd-7b22635ff911 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:56.031769 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd893c35-828f-4266-9bdd-7b22635ff911 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:56.032879 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd893c35-828f-4266-9bdd-7b22635ff911 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:56.095879 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cd893c35-828f-4266-9bdd-7b22635ff911 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:56.104074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cd893c35-828f-4266-9bdd-7b22635ff911 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1372 microversion: 2.1 time: 0.083068 May 10 21:37:56.104645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2506/3282] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:56 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:37:56.714467 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-be96162d-eb0a-4975-8551-b89213e1ad22 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:56.715100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-be96162d-eb0a-4975-8551-b89213e1ad22 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:56.721291 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be96162d-eb0a-4975-8551-b89213e1ad22 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:56.721745 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be96162d-eb0a-4975-8551-b89213e1ad22 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:56.722516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be96162d-eb0a-4975-8551-b89213e1ad22 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:56.722960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be96162d-eb0a-4975-8551-b89213e1ad22 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:56.848910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-be96162d-eb0a-4975-8551-b89213e1ad22 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:56.856622 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-be96162d-eb0a-4975-8551-b89213e1ad22 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.146326 May 10 21:37:56.857189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2507/3283] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:56 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:57.036859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0a1aa3ce-57e4-47df-a814-5202e01c338c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:57.037470 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0a1aa3ce-57e4-47df-a814-5202e01c338c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:57.044076 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0a1aa3ce-57e4-47df-a814-5202e01c338c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:57.044526 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0a1aa3ce-57e4-47df-a814-5202e01c338c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:57.045288 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0a1aa3ce-57e4-47df-a814-5202e01c338c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:57.045721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0a1aa3ce-57e4-47df-a814-5202e01c338c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:57.173972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0a1aa3ce-57e4-47df-a814-5202e01c338c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:57.181718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0a1aa3ce-57e4-47df-a814-5202e01c338c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148685 May 10 21:37:57.182282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2508/3284] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:57 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:57.186654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dd5bc3a4-8f67-42f9-b3ab-6dec0ae628f3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:57.187277 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dd5bc3a4-8f67-42f9-b3ab-6dec0ae628f3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:57.193353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dd5bc3a4-8f67-42f9-b3ab-6dec0ae628f3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:57.193798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dd5bc3a4-8f67-42f9-b3ab-6dec0ae628f3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:57.194552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dd5bc3a4-8f67-42f9-b3ab-6dec0ae628f3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:57.194985 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dd5bc3a4-8f67-42f9-b3ab-6dec0ae628f3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:57.257897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dd5bc3a4-8f67-42f9-b3ab-6dec0ae628f3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:57.265754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dd5bc3a4-8f67-42f9-b3ab-6dec0ae628f3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1372 microversion: 2.1 time: 0.082495 May 10 21:37:57.266752 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2509/3285] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:57 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:37:57.873381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0d1662e3-e3e9-4c15-84d8-6c074e79c54e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:57.874048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0d1662e3-e3e9-4c15-84d8-6c074e79c54e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:57.880827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d1662e3-e3e9-4c15-84d8-6c074e79c54e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:57.881276 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d1662e3-e3e9-4c15-84d8-6c074e79c54e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:57.882034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d1662e3-e3e9-4c15-84d8-6c074e79c54e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:57.882466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d1662e3-e3e9-4c15-84d8-6c074e79c54e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:58.008894 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0d1662e3-e3e9-4c15-84d8-6c074e79c54e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:58.016662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0d1662e3-e3e9-4c15-84d8-6c074e79c54e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147159 May 10 21:37:58.017374 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2510/3286] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:57 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:58.199476 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-233fc6df-030c-4455-8e89-56b8907d33b2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:58.200048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-233fc6df-030c-4455-8e89-56b8907d33b2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:58.206925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-233fc6df-030c-4455-8e89-56b8907d33b2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:58.207407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-233fc6df-030c-4455-8e89-56b8907d33b2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:58.208167 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-233fc6df-030c-4455-8e89-56b8907d33b2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:58.208611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-233fc6df-030c-4455-8e89-56b8907d33b2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:58.336008 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-233fc6df-030c-4455-8e89-56b8907d33b2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:58.344124 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-233fc6df-030c-4455-8e89-56b8907d33b2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148569 May 10 21:37:58.345445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2511/3287] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:58 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:58.350046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-dfe760a1-2cb3-4276-92d8-e0f1fc83a46c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:58.350647 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-dfe760a1-2cb3-4276-92d8-e0f1fc83a46c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:58.356255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dfe760a1-2cb3-4276-92d8-e0f1fc83a46c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:58.356714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dfe760a1-2cb3-4276-92d8-e0f1fc83a46c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:58.357475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dfe760a1-2cb3-4276-92d8-e0f1fc83a46c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:58.357913 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-dfe760a1-2cb3-4276-92d8-e0f1fc83a46c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:58.422314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-dfe760a1-2cb3-4276-92d8-e0f1fc83a46c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:58.430311 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-dfe760a1-2cb3-4276-92d8-e0f1fc83a46c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 200 len: 1372 microversion: 2.1 time: 0.083801 May 10 21:37:58.430871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2512/3288] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:58 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:37:58.447594 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-622dd95f-64ac-4a05-9330-ac74b614982a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '.version_select at 0x7f85d54760d0>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:58.513426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-622dd95f-64ac-4a05-9330-ac74b614982a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1097456563" status: 202 len: 0 microversion: 2.1 time: 0.069556 May 10 21:37:58.513927 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2513/3289] 10.222.0.49 () {58 vars in 1220 bytes} [Tue May 10 21:37:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1097456563 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 21:37:59.034144 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-07afe2ae-9d9d-45fa-9f6d-f36ab1961a6a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:59.034785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-07afe2ae-9d9d-45fa-9f6d-f36ab1961a6a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:59.040557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07afe2ae-9d9d-45fa-9f6d-f36ab1961a6a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:59.041012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07afe2ae-9d9d-45fa-9f6d-f36ab1961a6a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:59.041780 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07afe2ae-9d9d-45fa-9f6d-f36ab1961a6a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:59.042223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-07afe2ae-9d9d-45fa-9f6d-f36ab1961a6a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:59.184995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-07afe2ae-9d9d-45fa-9f6d-f36ab1961a6a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:59.195707 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-07afe2ae-9d9d-45fa-9f6d-f36ab1961a6a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.166052 May 10 21:37:59.196524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2514/3290] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:59 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:37:59.365939 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-419be1cd-e692-488a-868d-175bb55d5d13 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:37:59.371968 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-419be1cd-e692-488a-868d-175bb55d5d13 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:37:59.373078 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-419be1cd-e692-488a-868d-175bb55d5d13 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:59.373538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-419be1cd-e692-488a-868d-175bb55d5d13 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:59.374306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-419be1cd-e692-488a-868d-175bb55d5d13 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:37:59.374749 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-419be1cd-e692-488a-868d-175bb55d5d13 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:37:59.510567 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-419be1cd-e692-488a-868d-175bb55d5d13 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:37:59.518988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-419be1cd-e692-488a-868d-175bb55d5d13 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.157008 May 10 21:37:59.519597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2515/3291] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:37:59 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:37:59.523999 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f00c1cdd-3b9a-4f61-88be-0f39a6a5fc65 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Action: 'create', calling method: .version_select at 0x7f85d54f2d30>, body: {"keypair": {"name": "tempest-keypair-145764112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlm25x0ZK9kZbXoMWgvG1UCj0e5f0kiFEteRRBK3oPUL2QgYUnJmiRW0ttiUwdkk57XAzKOgZ/FSLQweQrLjTNex0dEjv700s+X42L5LuBEAUTO8lIa4ki1d+DjK5Vs7w=="}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:37:59.538052 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-f00c1cdd-3b9a-4f61-88be-0f39a6a5fc65 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Getting quotas for project 9582743483fa4fb88f4e91d3f787c945. Resources: {'key_pairs'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:37:59.543782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-f00c1cdd-3b9a-4f61-88be-0f39a6a5fc65 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Getting quotas for user 62bc5605a22d408f9b4bac69a0f5f486 and project 9582743483fa4fb88f4e91d3f787c945. Resources: {'key_pairs'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:37:59.622620 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f00c1cdd-3b9a-4f61-88be-0f39a6a5fc65 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.101972 May 10 21:37:59.623240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2516/3292] 10.222.0.49 () {60 vars in 1158 bytes} [Tue May 10 21:37:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:38:00.213725 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-796b8d24-9f18-4a0d-83f6-3ca0a06abc2e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:00.214395 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-796b8d24-9f18-4a0d-83f6-3ca0a06abc2e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:00.220757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-796b8d24-9f18-4a0d-83f6-3ca0a06abc2e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:00.221237 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-796b8d24-9f18-4a0d-83f6-3ca0a06abc2e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:00.222007 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-796b8d24-9f18-4a0d-83f6-3ca0a06abc2e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:00.222515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-796b8d24-9f18-4a0d-83f6-3ca0a06abc2e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:00.360844 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-796b8d24-9f18-4a0d-83f6-3ca0a06abc2e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:00.368804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-796b8d24-9f18-4a0d-83f6-3ca0a06abc2e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.159225 May 10 21:38:00.369363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2517/3293] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:00 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:00.536775 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-60333406-780b-4b3b-9c3d-61987855d56f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:00.537403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-60333406-780b-4b3b-9c3d-61987855d56f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:00.543762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-60333406-780b-4b3b-9c3d-61987855d56f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:00.544213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-60333406-780b-4b3b-9c3d-61987855d56f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:00.544973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-60333406-780b-4b3b-9c3d-61987855d56f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:00.545411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-60333406-780b-4b3b-9c3d-61987855d56f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:00.693869 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-60333406-780b-4b3b-9c3d-61987855d56f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:00.701695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-60333406-780b-4b3b-9c3d-61987855d56f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.169277 May 10 21:38:00.702269 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2518/3294] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:00 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:01.389833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8c5fa9cb-aa64-44d3-b187-5b1c3a57777b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:01.390462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8c5fa9cb-aa64-44d3-b187-5b1c3a57777b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:01.396554 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c5fa9cb-aa64-44d3-b187-5b1c3a57777b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:01.397005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c5fa9cb-aa64-44d3-b187-5b1c3a57777b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:01.397766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c5fa9cb-aa64-44d3-b187-5b1c3a57777b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:01.398203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c5fa9cb-aa64-44d3-b187-5b1c3a57777b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:01.842613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8c5fa9cb-aa64-44d3-b187-5b1c3a57777b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:01.851346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8c5fa9cb-aa64-44d3-b187-5b1c3a57777b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.465455 May 10 21:38:01.851933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2519/3295] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:01 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:01.856439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a801769f-7f78-4551-9324-5975664e3dff tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:01.857056 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a801769f-7f78-4551-9324-5975664e3dff tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:01.862909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a801769f-7f78-4551-9324-5975664e3dff tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:01.863336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a801769f-7f78-4551-9324-5975664e3dff tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:01.864114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a801769f-7f78-4551-9324-5975664e3dff tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:01.864558 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a801769f-7f78-4551-9324-5975664e3dff tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:02.066831 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a801769f-7f78-4551-9324-5975664e3dff tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:02.074774 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a801769f-7f78-4551-9324-5975664e3dff tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.221868 May 10 21:38:02.075832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2520/3296] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:01 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:38:02.236050 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-efc0b0d3-8799-4a69-bc88-69898905f2d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1910938935", "imageRef": "cb321ccf-1ce7-4dda-90d0-f05332eb6fe1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a67b65bc-d215-4b97-b229-e2132409a79d"}], "security_groups": [{"name": "tempest-securitygroup--795254878"}], "key_name": "tempest-keypair-145764112", "user_data": "}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:38:02.333965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.network.neutron [None req-efc0b0d3-8799-4a69-bc88-69898905f2d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] validate_networks() for [('a67b65bc-d215-4b97-b229-e2132409a79d', None, None, None, None, None)] {{(pid=117714) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:38:02.744593 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-efc0b0d3-8799-4a69-bc88-69898905f2d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Flavor limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:38:02.745185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-efc0b0d3-8799-4a69-bc88-69898905f2d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Image limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:38:02.745478 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-efc0b0d3-8799-4a69-bc88-69898905f2d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Flavor pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:38:02.745885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-efc0b0d3-8799-4a69-bc88-69898905f2d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Image pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:38:02.746294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-efc0b0d3-8799-4a69-bc88-69898905f2d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:38:02.754950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-efc0b0d3-8799-4a69-bc88-69898905f2d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:02.755451 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-efc0b0d3-8799-4a69-bc88-69898905f2d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:02.756239 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-efc0b0d3-8799-4a69-bc88-69898905f2d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:02.756677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-efc0b0d3-8799-4a69-bc88-69898905f2d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:02.772651 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-efc0b0d3-8799-4a69-bc88-69898905f2d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Getting quotas for project 9582743483fa4fb88f4e91d3f787c945. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:38:02.776575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-efc0b0d3-8799-4a69-bc88-69898905f2d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Getting quotas for user 62bc5605a22d408f9b4bac69a0f5f486 and project 9582743483fa4fb88f4e91d3f787c945. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:38:02.787941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-efc0b0d3-8799-4a69-bc88-69898905f2d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Going to run 1 instances... {{(pid=117714) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:38:02.790170 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-efc0b0d3-8799-4a69-bc88-69898905f2d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4674fb54-efa1-4bed-a2a2-49f3b1184874] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb321ccf-1ce7-4dda-90d0-f05332eb6fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117714) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:38:02.955727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-efc0b0d3-8799-4a69-bc88-69898905f2d1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.724554 May 10 21:38:02.956545 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2521/3297] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 21:38:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 21:38:02.965324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-76096c22-5b09-4134-986d-c1ae5794849b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:02.965941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-76096c22-5b09-4134-986d-c1ae5794849b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:02.972551 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76096c22-5b09-4134-986d-c1ae5794849b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:02.972985 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76096c22-5b09-4134-986d-c1ae5794849b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:02.973769 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76096c22-5b09-4134-986d-c1ae5794849b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:02.974214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76096c22-5b09-4134-986d-c1ae5794849b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:03.108249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-76096c22-5b09-4134-986d-c1ae5794849b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:03.117079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-76096c22-5b09-4134-986d-c1ae5794849b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.159521 May 10 21:38:03.117659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2522/3298] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:02 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:38:03.122129 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c8a7715e-ef3c-406b-b3c4-48c2abac110c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:03.122932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c8a7715e-ef3c-406b-b3c4-48c2abac110c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4674fb54-efa1-4bed-a2a2-49f3b1184874] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:03.176396 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c8a7715e-ef3c-406b-b3c4-48c2abac110c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:03.182994 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c8a7715e-ef3c-406b-b3c4-48c2abac110c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874" status: 200 len: 1241 microversion: 2.1 time: 0.064398 May 10 21:38:03.183621 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2523/3299] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:03 2022] GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:38:03.188050 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-13d5eedd-3dce-43ce-8b2d-85f99842fe7f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:03.189030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-13d5eedd-3dce-43ce-8b2d-85f99842fe7f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:03.194616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-13d5eedd-3dce-43ce-8b2d-85f99842fe7f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:03.195071 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-13d5eedd-3dce-43ce-8b2d-85f99842fe7f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:03.195890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-13d5eedd-3dce-43ce-8b2d-85f99842fe7f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:03.196314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-13d5eedd-3dce-43ce-8b2d-85f99842fe7f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:03.325648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-13d5eedd-3dce-43ce-8b2d-85f99842fe7f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:03.334289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-13d5eedd-3dce-43ce-8b2d-85f99842fe7f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149724 May 10 21:38:03.334861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2524/3300] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:03 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:38:04.133941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-87d3eeb1-db98-43de-8749-15481c254176 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:04.134587 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-87d3eeb1-db98-43de-8749-15481c254176 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:04.140995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87d3eeb1-db98-43de-8749-15481c254176 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:04.142103 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87d3eeb1-db98-43de-8749-15481c254176 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:04.142889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87d3eeb1-db98-43de-8749-15481c254176 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:04.143512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-87d3eeb1-db98-43de-8749-15481c254176 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:04.276556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-87d3eeb1-db98-43de-8749-15481c254176 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:04.284570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-87d3eeb1-db98-43de-8749-15481c254176 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.154685 May 10 21:38:04.285117 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2525/3301] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:04 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:04.289481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-641c3b07-bcd5-46e8-a3ae-eac11e4c3485 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:04.290081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-641c3b07-bcd5-46e8-a3ae-eac11e4c3485 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4674fb54-efa1-4bed-a2a2-49f3b1184874] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:04.295737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-641c3b07-bcd5-46e8-a3ae-eac11e4c3485 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:04.296240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-641c3b07-bcd5-46e8-a3ae-eac11e4c3485 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:04.297643 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-641c3b07-bcd5-46e8-a3ae-eac11e4c3485 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:04.298182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-641c3b07-bcd5-46e8-a3ae-eac11e4c3485 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:04.359589 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-641c3b07-bcd5-46e8-a3ae-eac11e4c3485 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:04.367206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-641c3b07-bcd5-46e8-a3ae-eac11e4c3485 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874" status: 200 len: 1237 microversion: 2.1 time: 0.081120 May 10 21:38:04.367773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2526/3302] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:04 2022] GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874 => generated 1237 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:38:04.372114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f432c2b4-26d7-4230-83bd-1dd320330d27 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:04.372717 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f432c2b4-26d7-4230-83bd-1dd320330d27 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:04.378912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f432c2b4-26d7-4230-83bd-1dd320330d27 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:04.379542 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f432c2b4-26d7-4230-83bd-1dd320330d27 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:04.380313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f432c2b4-26d7-4230-83bd-1dd320330d27 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:04.380752 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f432c2b4-26d7-4230-83bd-1dd320330d27 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:04.511596 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f432c2b4-26d7-4230-83bd-1dd320330d27 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:04.523932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f432c2b4-26d7-4230-83bd-1dd320330d27 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.154832 May 10 21:38:04.524510 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2527/3303] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:04 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:38:05.302340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6bcdcd99-95b3-4062-b1a3-e092bacb5cba tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:05.303032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6bcdcd99-95b3-4062-b1a3-e092bacb5cba tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:05.309512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6bcdcd99-95b3-4062-b1a3-e092bacb5cba tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:05.309961 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6bcdcd99-95b3-4062-b1a3-e092bacb5cba tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:05.310783 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6bcdcd99-95b3-4062-b1a3-e092bacb5cba tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:05.311241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6bcdcd99-95b3-4062-b1a3-e092bacb5cba tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:05.492697 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6bcdcd99-95b3-4062-b1a3-e092bacb5cba tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:05.500728 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6bcdcd99-95b3-4062-b1a3-e092bacb5cba tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.203028 May 10 21:38:05.501891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2528/3304] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:05 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:05.506407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-594ea18d-d323-4f46-9eca-5a73875780ff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:05.507003 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-594ea18d-d323-4f46-9eca-5a73875780ff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4674fb54-efa1-4bed-a2a2-49f3b1184874] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:05.512678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-594ea18d-d323-4f46-9eca-5a73875780ff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:05.513134 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-594ea18d-d323-4f46-9eca-5a73875780ff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:05.513901 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-594ea18d-d323-4f46-9eca-5a73875780ff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:05.514338 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-594ea18d-d323-4f46-9eca-5a73875780ff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:05.586792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-594ea18d-d323-4f46-9eca-5a73875780ff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:05.594408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-594ea18d-d323-4f46-9eca-5a73875780ff tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874" status: 200 len: 1299 microversion: 2.1 time: 0.091565 May 10 21:38:05.595212 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2529/3305] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:05 2022] GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874 => generated 1299 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:38:05.600169 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2ff15708-ba51-4628-ae4f-a48519e3accc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:05.600779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2ff15708-ba51-4628-ae4f-a48519e3accc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:05.609040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ff15708-ba51-4628-ae4f-a48519e3accc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:05.609493 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ff15708-ba51-4628-ae4f-a48519e3accc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:05.610827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ff15708-ba51-4628-ae4f-a48519e3accc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:05.611581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2ff15708-ba51-4628-ae4f-a48519e3accc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:05.743958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2ff15708-ba51-4628-ae4f-a48519e3accc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:05.752260 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2ff15708-ba51-4628-ae4f-a48519e3accc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.155992 May 10 21:38:05.752786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2530/3306] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:05 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:38:06.519107 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5664c8ba-680d-4935-b3cf-083014f9f182 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:06.519893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5664c8ba-680d-4935-b3cf-083014f9f182 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:06.526765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5664c8ba-680d-4935-b3cf-083014f9f182 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:06.527420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5664c8ba-680d-4935-b3cf-083014f9f182 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:06.528262 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5664c8ba-680d-4935-b3cf-083014f9f182 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:06.529070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5664c8ba-680d-4935-b3cf-083014f9f182 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:06.716826 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5664c8ba-680d-4935-b3cf-083014f9f182 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:06.725150 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5664c8ba-680d-4935-b3cf-083014f9f182 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.211188 May 10 21:38:06.725728 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2531/3307] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:06 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:06.730315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-15ac251f-5ad1-4349-a8f3-7fe4906b3730 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:06.730915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-15ac251f-5ad1-4349-a8f3-7fe4906b3730 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4674fb54-efa1-4bed-a2a2-49f3b1184874] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:06.737378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-15ac251f-5ad1-4349-a8f3-7fe4906b3730 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:06.737900 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-15ac251f-5ad1-4349-a8f3-7fe4906b3730 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:06.738923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-15ac251f-5ad1-4349-a8f3-7fe4906b3730 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:06.739458 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-15ac251f-5ad1-4349-a8f3-7fe4906b3730 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:06.932621 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-15ac251f-5ad1-4349-a8f3-7fe4906b3730 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:06.951194 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-15ac251f-5ad1-4349-a8f3-7fe4906b3730 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874" status: 200 len: 1366 microversion: 2.1 time: 0.224346 May 10 21:38:06.951985 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2532/3308] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:06 2022] GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:38:06.956731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f6352d20-1327-4d51-bb51-b5f64fa51068 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:06.957354 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f6352d20-1327-4d51-bb51-b5f64fa51068 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:06.963919 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6352d20-1327-4d51-bb51-b5f64fa51068 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:06.964379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6352d20-1327-4d51-bb51-b5f64fa51068 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:06.965171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6352d20-1327-4d51-bb51-b5f64fa51068 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:06.965616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6352d20-1327-4d51-bb51-b5f64fa51068 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:07.203067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f6352d20-1327-4d51-bb51-b5f64fa51068 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:07.211711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f6352d20-1327-4d51-bb51-b5f64fa51068 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.258922 May 10 21:38:07.212284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2533/3309] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:06 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:38:07.216869 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-341c05d8-58cb-48d8-99d1-4779122ff434 req-ca28ce5a-68d3-4443-a23b-95450e5c2f66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4674fb54-efa1-4bed-a2a2-49f3b1184874", "tag": "b7123b7e-3e48-4b36-891c-f17108289161"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:38:07.225025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-341c05d8-58cb-48d8-99d1-4779122ff434 req-ca28ce5a-68d3-4443-a23b-95450e5c2f66 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:07.225462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-341c05d8-58cb-48d8-99d1-4779122ff434 req-ca28ce5a-68d3-4443-a23b-95450e5c2f66 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:07.236600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-341c05d8-58cb-48d8-99d1-4779122ff434 req-ca28ce5a-68d3-4443-a23b-95450e5c2f66 service nova] Creating event network-changed:b7123b7e-3e48-4b36-891c-f17108289161 for instance 4674fb54-efa1-4bed-a2a2-49f3b1184874 on hv-cinder-82880 May 10 21:38:07.241513 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-341c05d8-58cb-48d8-99d1-4779122ff434 req-ca28ce5a-68d3-4443-a23b-95450e5c2f66 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028150 May 10 21:38:07.242098 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2534/3310] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:38:07.743309 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1310df7c-4ef9-4903-9b34-5f87027a3165 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:07.743980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1310df7c-4ef9-4903-9b34-5f87027a3165 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:07.750096 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1310df7c-4ef9-4903-9b34-5f87027a3165 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:07.750542 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1310df7c-4ef9-4903-9b34-5f87027a3165 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:07.751963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1310df7c-4ef9-4903-9b34-5f87027a3165 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:07.752399 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1310df7c-4ef9-4903-9b34-5f87027a3165 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:07.879537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1310df7c-4ef9-4903-9b34-5f87027a3165 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:07.887279 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1310df7c-4ef9-4903-9b34-5f87027a3165 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148809 May 10 21:38:07.887838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2535/3311] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:07 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:07.969362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f6dde021-d284-41de-9b95-416c7a7ef0a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:07.970563 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f6dde021-d284-41de-9b95-416c7a7ef0a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4674fb54-efa1-4bed-a2a2-49f3b1184874] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:07.976482 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6dde021-d284-41de-9b95-416c7a7ef0a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:07.976942 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6dde021-d284-41de-9b95-416c7a7ef0a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:07.977740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6dde021-d284-41de-9b95-416c7a7ef0a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:07.978178 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6dde021-d284-41de-9b95-416c7a7ef0a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:08.105969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f6dde021-d284-41de-9b95-416c7a7ef0a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:08.113258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f6dde021-d284-41de-9b95-416c7a7ef0a7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874" status: 200 len: 1366 microversion: 2.1 time: 0.147740 May 10 21:38:08.113819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2536/3312] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:07 2022] GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:08.227922 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7e27f750-b681-4f27-b8df-4c2569fcbe53 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:08.228535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7e27f750-b681-4f27-b8df-4c2569fcbe53 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:08.234433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7e27f750-b681-4f27-b8df-4c2569fcbe53 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:08.234881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7e27f750-b681-4f27-b8df-4c2569fcbe53 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:08.236153 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7e27f750-b681-4f27-b8df-4c2569fcbe53 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:08.236596 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7e27f750-b681-4f27-b8df-4c2569fcbe53 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:08.437354 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7e27f750-b681-4f27-b8df-4c2569fcbe53 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:08.445888 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7e27f750-b681-4f27-b8df-4c2569fcbe53 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.221675 May 10 21:38:08.446463 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2537/3313] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:08 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:08.904285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bacee3d6-67e5-4288-a208-7ef38c5c2914 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:08.904926 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bacee3d6-67e5-4288-a208-7ef38c5c2914 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:08.912028 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bacee3d6-67e5-4288-a208-7ef38c5c2914 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:08.912561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bacee3d6-67e5-4288-a208-7ef38c5c2914 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:08.913232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bacee3d6-67e5-4288-a208-7ef38c5c2914 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:08.913669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bacee3d6-67e5-4288-a208-7ef38c5c2914 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:09.046736 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bacee3d6-67e5-4288-a208-7ef38c5c2914 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:09.055399 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bacee3d6-67e5-4288-a208-7ef38c5c2914 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.155068 May 10 21:38:09.055994 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2538/3314] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:08 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:09.130543 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9f4a7792-38b1-446d-a4cd-c07843e0182e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:09.131197 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9f4a7792-38b1-446d-a4cd-c07843e0182e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4674fb54-efa1-4bed-a2a2-49f3b1184874] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:09.136975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9f4a7792-38b1-446d-a4cd-c07843e0182e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:09.137430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9f4a7792-38b1-446d-a4cd-c07843e0182e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:09.138196 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9f4a7792-38b1-446d-a4cd-c07843e0182e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:09.138636 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9f4a7792-38b1-446d-a4cd-c07843e0182e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:09.270082 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9f4a7792-38b1-446d-a4cd-c07843e0182e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:09.277286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9f4a7792-38b1-446d-a4cd-c07843e0182e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874" status: 200 len: 1366 microversion: 2.1 time: 0.151526 May 10 21:38:09.277856 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2539/3315] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:09 2022] GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:09.463072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-04882f9e-8f2a-4f74-9d40-788ff8027ddf tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:09.463879 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-04882f9e-8f2a-4f74-9d40-788ff8027ddf tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:09.470568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04882f9e-8f2a-4f74-9d40-788ff8027ddf tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:09.470995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04882f9e-8f2a-4f74-9d40-788ff8027ddf tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:09.471790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04882f9e-8f2a-4f74-9d40-788ff8027ddf tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:09.472235 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04882f9e-8f2a-4f74-9d40-788ff8027ddf tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:09.597336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-04882f9e-8f2a-4f74-9d40-788ff8027ddf tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:09.605286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-04882f9e-8f2a-4f74-9d40-788ff8027ddf tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.146037 May 10 21:38:09.605923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2540/3316] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:09 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:10.073090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3c3ea34a-3144-4e26-9bf8-dd802fd138fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:10.073762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3c3ea34a-3144-4e26-9bf8-dd802fd138fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:10.080544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3c3ea34a-3144-4e26-9bf8-dd802fd138fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:10.080989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3c3ea34a-3144-4e26-9bf8-dd802fd138fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:10.081745 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3c3ea34a-3144-4e26-9bf8-dd802fd138fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:10.082180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3c3ea34a-3144-4e26-9bf8-dd802fd138fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:10.211267 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3c3ea34a-3144-4e26-9bf8-dd802fd138fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:10.219310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3c3ea34a-3144-4e26-9bf8-dd802fd138fe tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150079 May 10 21:38:10.220448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2541/3317] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:10 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:10.293809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-be8bab4a-c4e0-4a35-accd-7b2fa41107c3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:10.294421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-be8bab4a-c4e0-4a35-accd-7b2fa41107c3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4674fb54-efa1-4bed-a2a2-49f3b1184874] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:10.300869 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be8bab4a-c4e0-4a35-accd-7b2fa41107c3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:10.301317 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be8bab4a-c4e0-4a35-accd-7b2fa41107c3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:10.302079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be8bab4a-c4e0-4a35-accd-7b2fa41107c3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:10.302522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-be8bab4a-c4e0-4a35-accd-7b2fa41107c3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:10.428589 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-be8bab4a-c4e0-4a35-accd-7b2fa41107c3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:10.435880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-be8bab4a-c4e0-4a35-accd-7b2fa41107c3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874" status: 200 len: 1366 microversion: 2.1 time: 0.145730 May 10 21:38:10.436446 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2542/3318] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:10 2022] GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:10.622736 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a67cdf67-264f-4263-9796-a3488d0e0c38 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:10.623376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a67cdf67-264f-4263-9796-a3488d0e0c38 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:10.630333 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a67cdf67-264f-4263-9796-a3488d0e0c38 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:10.630708 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a67cdf67-264f-4263-9796-a3488d0e0c38 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:10.631499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a67cdf67-264f-4263-9796-a3488d0e0c38 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:10.631940 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a67cdf67-264f-4263-9796-a3488d0e0c38 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:10.763662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a67cdf67-264f-4263-9796-a3488d0e0c38 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:10.772143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a67cdf67-264f-4263-9796-a3488d0e0c38 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.153208 May 10 21:38:10.772727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2543/3319] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:10 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:10.889338 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-21704da4-945b-4c98-a9a1-53b51a6aa21e req-8e418ff7-3b21-4cb1-8b4f-84af5e726b1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4674fb54-efa1-4bed-a2a2-49f3b1184874", "name": "network-vif-plugged", "status": "completed", "tag": "b7123b7e-3e48-4b36-891c-f17108289161"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:38:10.898041 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-21704da4-945b-4c98-a9a1-53b51a6aa21e req-8e418ff7-3b21-4cb1-8b4f-84af5e726b1c service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:10.898488 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-21704da4-945b-4c98-a9a1-53b51a6aa21e req-8e418ff7-3b21-4cb1-8b4f-84af5e726b1c service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:10.910866 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-21704da4-945b-4c98-a9a1-53b51a6aa21e req-8e418ff7-3b21-4cb1-8b4f-84af5e726b1c service nova] Creating event network-vif-plugged:b7123b7e-3e48-4b36-891c-f17108289161 for instance 4674fb54-efa1-4bed-a2a2-49f3b1184874 on hv-cinder-82880 May 10 21:38:10.915891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-21704da4-945b-4c98-a9a1-53b51a6aa21e req-8e418ff7-3b21-4cb1-8b4f-84af5e726b1c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080698 May 10 21:38:10.916678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2544/3320] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:38:11.238425 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-de3c8490-94ee-4545-86e9-ea8cf7e3c778 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:11.239262 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-de3c8490-94ee-4545-86e9-ea8cf7e3c778 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:11.245460 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de3c8490-94ee-4545-86e9-ea8cf7e3c778 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:11.246008 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de3c8490-94ee-4545-86e9-ea8cf7e3c778 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:11.246779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de3c8490-94ee-4545-86e9-ea8cf7e3c778 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:11.247244 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de3c8490-94ee-4545-86e9-ea8cf7e3c778 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:11.376870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-de3c8490-94ee-4545-86e9-ea8cf7e3c778 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:11.384672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-de3c8490-94ee-4545-86e9-ea8cf7e3c778 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151668 May 10 21:38:11.385242 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2545/3321] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:11 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:11.452851 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-67f6e0f0-67c9-4354-b2c6-6fb5f1f734ef tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:11.453457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-67f6e0f0-67c9-4354-b2c6-6fb5f1f734ef tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4674fb54-efa1-4bed-a2a2-49f3b1184874] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:11.459863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-67f6e0f0-67c9-4354-b2c6-6fb5f1f734ef tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:11.460252 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-67f6e0f0-67c9-4354-b2c6-6fb5f1f734ef tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:11.461016 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-67f6e0f0-67c9-4354-b2c6-6fb5f1f734ef tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:11.461455 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-67f6e0f0-67c9-4354-b2c6-6fb5f1f734ef tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:11.591693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-67f6e0f0-67c9-4354-b2c6-6fb5f1f734ef tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:11.599744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-67f6e0f0-67c9-4354-b2c6-6fb5f1f734ef tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874" status: 200 len: 1366 microversion: 2.1 time: 0.150626 May 10 21:38:11.600313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2546/3322] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:11 2022] GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:11.789232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9fea6e6a-2cf4-402b-ab26-968f04d1a42e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:11.789805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9fea6e6a-2cf4-402b-ab26-968f04d1a42e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:11.795733 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9fea6e6a-2cf4-402b-ab26-968f04d1a42e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:11.796184 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9fea6e6a-2cf4-402b-ab26-968f04d1a42e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:11.796944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9fea6e6a-2cf4-402b-ab26-968f04d1a42e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:11.797376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9fea6e6a-2cf4-402b-ab26-968f04d1a42e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:11.925236 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9fea6e6a-2cf4-402b-ab26-968f04d1a42e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:11.933015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9fea6e6a-2cf4-402b-ab26-968f04d1a42e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.147659 May 10 21:38:11.933605 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2547/3323] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:11 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:12.401768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-83a65977-472d-47d3-9692-ddf6df4adb2f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:12.402487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-83a65977-472d-47d3-9692-ddf6df4adb2f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:12.408927 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-83a65977-472d-47d3-9692-ddf6df4adb2f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:12.409385 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-83a65977-472d-47d3-9692-ddf6df4adb2f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:12.410173 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-83a65977-472d-47d3-9692-ddf6df4adb2f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:12.410616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-83a65977-472d-47d3-9692-ddf6df4adb2f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:12.540114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-83a65977-472d-47d3-9692-ddf6df4adb2f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:12.547948 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-83a65977-472d-47d3-9692-ddf6df4adb2f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150031 May 10 21:38:12.548563 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2548/3324] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:12 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:12.616243 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-79aa5c65-1205-49f3-964a-f9ea7c7ed944 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:12.616852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-79aa5c65-1205-49f3-964a-f9ea7c7ed944 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4674fb54-efa1-4bed-a2a2-49f3b1184874] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:12.622861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-79aa5c65-1205-49f3-964a-f9ea7c7ed944 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:12.623340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-79aa5c65-1205-49f3-964a-f9ea7c7ed944 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:12.624135 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-79aa5c65-1205-49f3-964a-f9ea7c7ed944 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:12.624630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-79aa5c65-1205-49f3-964a-f9ea7c7ed944 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:12.753743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-79aa5c65-1205-49f3-964a-f9ea7c7ed944 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:12.761233 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-79aa5c65-1205-49f3-964a-f9ea7c7ed944 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874" status: 200 len: 1366 microversion: 2.1 time: 0.148774 May 10 21:38:12.761807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2549/3325] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:12 2022] GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:12.949773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a24a8bcb-c13a-4d1d-9066-07aed88bfe66 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:12.950387 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a24a8bcb-c13a-4d1d-9066-07aed88bfe66 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:12.956396 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a24a8bcb-c13a-4d1d-9066-07aed88bfe66 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:12.956841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a24a8bcb-c13a-4d1d-9066-07aed88bfe66 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:12.957620 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a24a8bcb-c13a-4d1d-9066-07aed88bfe66 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:12.958033 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a24a8bcb-c13a-4d1d-9066-07aed88bfe66 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:13.102217 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a24a8bcb-c13a-4d1d-9066-07aed88bfe66 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:13.109956 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a24a8bcb-c13a-4d1d-9066-07aed88bfe66 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.164062 May 10 21:38:13.110661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2550/3326] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:12 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:13.564561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-55444156-9082-4505-865b-951055f841fb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:13.565291 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-55444156-9082-4505-865b-951055f841fb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:13.571552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-55444156-9082-4505-865b-951055f841fb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:13.572006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-55444156-9082-4505-865b-951055f841fb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:13.572760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-55444156-9082-4505-865b-951055f841fb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:13.573195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-55444156-9082-4505-865b-951055f841fb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:13.700088 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-55444156-9082-4505-865b-951055f841fb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:13.708381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-55444156-9082-4505-865b-951055f841fb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148266 May 10 21:38:13.708939 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2551/3327] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:13 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:13.778130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-988ffc25-33e2-4987-a4fe-ccb21bca3471 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:13.778732 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-988ffc25-33e2-4987-a4fe-ccb21bca3471 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4674fb54-efa1-4bed-a2a2-49f3b1184874] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:13.785079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-988ffc25-33e2-4987-a4fe-ccb21bca3471 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:13.785522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-988ffc25-33e2-4987-a4fe-ccb21bca3471 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:13.786280 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-988ffc25-33e2-4987-a4fe-ccb21bca3471 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:13.786715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-988ffc25-33e2-4987-a4fe-ccb21bca3471 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:13.913094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-988ffc25-33e2-4987-a4fe-ccb21bca3471 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:13.920537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-988ffc25-33e2-4987-a4fe-ccb21bca3471 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874" status: 200 len: 1557 microversion: 2.1 time: 0.146035 May 10 21:38:13.921109 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2552/3328] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:13 2022] GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:13.936327 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1ae420c6-10da-4217-8f65-07ffbfe0a392 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:13.936825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1ae420c6-10da-4217-8f65-07ffbfe0a392 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4674fb54-efa1-4bed-a2a2-49f3b1184874] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:13.943335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1ae420c6-10da-4217-8f65-07ffbfe0a392 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:13.943792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1ae420c6-10da-4217-8f65-07ffbfe0a392 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:13.944660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1ae420c6-10da-4217-8f65-07ffbfe0a392 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:13.945386 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1ae420c6-10da-4217-8f65-07ffbfe0a392 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:14.025052 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1ae420c6-10da-4217-8f65-07ffbfe0a392 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092341 May 10 21:38:14.025642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2553/3329] 10.222.0.49 () {58 vars in 1274 bytes} [Tue May 10 21:38:13 2022] GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:38:14.127653 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ecd810b3-55b0-4d8f-a8bc-58cf67406f6c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:14.128213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ecd810b3-55b0-4d8f-a8bc-58cf67406f6c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:14.134197 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ecd810b3-55b0-4d8f-a8bc-58cf67406f6c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:14.134643 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ecd810b3-55b0-4d8f-a8bc-58cf67406f6c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:14.135433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ecd810b3-55b0-4d8f-a8bc-58cf67406f6c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:14.135872 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ecd810b3-55b0-4d8f-a8bc-58cf67406f6c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:14.351509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ecd810b3-55b0-4d8f-a8bc-58cf67406f6c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:14.359377 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ecd810b3-55b0-4d8f-a8bc-58cf67406f6c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.236152 May 10 21:38:14.359944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2554/3330] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:14 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:14.725535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6f3d790a-4d38-453c-be9c-dede81468c51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:14.726220 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6f3d790a-4d38-453c-be9c-dede81468c51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:14.732666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6f3d790a-4d38-453c-be9c-dede81468c51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:14.737189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6f3d790a-4d38-453c-be9c-dede81468c51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:14.737189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6f3d790a-4d38-453c-be9c-dede81468c51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:14.737189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6f3d790a-4d38-453c-be9c-dede81468c51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:15.190146 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6f3d790a-4d38-453c-be9c-dede81468c51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:15.198196 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6f3d790a-4d38-453c-be9c-dede81468c51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.476534 May 10 21:38:15.198774 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2555/3331] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:14 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:15.377690 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e54f122c-b38b-47c6-9d0e-4c3d3738f4b8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:15.378300 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e54f122c-b38b-47c6-9d0e-4c3d3738f4b8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:15.384214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e54f122c-b38b-47c6-9d0e-4c3d3738f4b8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:15.384660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e54f122c-b38b-47c6-9d0e-4c3d3738f4b8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:15.385426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e54f122c-b38b-47c6-9d0e-4c3d3738f4b8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:15.385857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e54f122c-b38b-47c6-9d0e-4c3d3738f4b8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:15.539410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e54f122c-b38b-47c6-9d0e-4c3d3738f4b8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:15.547144 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e54f122c-b38b-47c6-9d0e-4c3d3738f4b8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.173944 May 10 21:38:15.547934 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2556/3332] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:15 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:15.552568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-4d0648a5-c46b-4c99-88ba-0471afdc1860 req-3308d85c-edbf-40c8-af08-f2b4b4959cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4674fb54-efa1-4bed-a2a2-49f3b1184874", "tag": "b7123b7e-3e48-4b36-891c-f17108289161"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:38:15.560413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-4d0648a5-c46b-4c99-88ba-0471afdc1860 req-3308d85c-edbf-40c8-af08-f2b4b4959cb6 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:15.560886 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-4d0648a5-c46b-4c99-88ba-0471afdc1860 req-3308d85c-edbf-40c8-af08-f2b4b4959cb6 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:15.572549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-4d0648a5-c46b-4c99-88ba-0471afdc1860 req-3308d85c-edbf-40c8-af08-f2b4b4959cb6 service nova] Creating event network-changed:b7123b7e-3e48-4b36-891c-f17108289161 for instance 4674fb54-efa1-4bed-a2a2-49f3b1184874 on hv-cinder-82880 May 10 21:38:15.578268 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-4d0648a5-c46b-4c99-88ba-0471afdc1860 req-3308d85c-edbf-40c8-af08-f2b4b4959cb6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028684 May 10 21:38:15.579774 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2557/3333] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:38:16.217120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-54141694-8a89-403a-b27b-681fbb85ce9b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:16.217887 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-54141694-8a89-403a-b27b-681fbb85ce9b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:16.228551 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54141694-8a89-403a-b27b-681fbb85ce9b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:16.240122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54141694-8a89-403a-b27b-681fbb85ce9b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:16.240122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54141694-8a89-403a-b27b-681fbb85ce9b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:16.240122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54141694-8a89-403a-b27b-681fbb85ce9b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:16.372536 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-54141694-8a89-403a-b27b-681fbb85ce9b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:16.382699 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-54141694-8a89-403a-b27b-681fbb85ce9b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.170729 May 10 21:38:16.383357 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2558/3334] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:16 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:16.564104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-84ef111d-3a48-49da-9731-e2d44fc18417 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:16.564672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-84ef111d-3a48-49da-9731-e2d44fc18417 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:16.570614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-84ef111d-3a48-49da-9731-e2d44fc18417 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:16.571071 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-84ef111d-3a48-49da-9731-e2d44fc18417 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:16.571864 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-84ef111d-3a48-49da-9731-e2d44fc18417 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:16.572301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-84ef111d-3a48-49da-9731-e2d44fc18417 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:16.702191 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-84ef111d-3a48-49da-9731-e2d44fc18417 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:16.710780 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-84ef111d-3a48-49da-9731-e2d44fc18417 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150786 May 10 21:38:16.711366 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2559/3335] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:16 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:17.400426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5f52cff0-a625-4f0f-88bd-7ad5a1838d53 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:17.401072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5f52cff0-a625-4f0f-88bd-7ad5a1838d53 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:17.408302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f52cff0-a625-4f0f-88bd-7ad5a1838d53 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:17.409054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f52cff0-a625-4f0f-88bd-7ad5a1838d53 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:17.409863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f52cff0-a625-4f0f-88bd-7ad5a1838d53 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:17.410301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f52cff0-a625-4f0f-88bd-7ad5a1838d53 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:17.537355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5f52cff0-a625-4f0f-88bd-7ad5a1838d53 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:17.545221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5f52cff0-a625-4f0f-88bd-7ad5a1838d53 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148684 May 10 21:38:17.545784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2560/3336] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:17 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:17.728562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e93274c8-9c32-44d6-9568-c8f2187b4020 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:17.729136 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e93274c8-9c32-44d6-9568-c8f2187b4020 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:17.735043 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e93274c8-9c32-44d6-9568-c8f2187b4020 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:17.736009 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e93274c8-9c32-44d6-9568-c8f2187b4020 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:17.736789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e93274c8-9c32-44d6-9568-c8f2187b4020 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:17.737231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e93274c8-9c32-44d6-9568-c8f2187b4020 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:17.868129 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e93274c8-9c32-44d6-9568-c8f2187b4020 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:17.876821 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e93274c8-9c32-44d6-9568-c8f2187b4020 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151238 May 10 21:38:17.877398 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2561/3337] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:17 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:18.562595 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b9acd0ef-93be-406d-ae65-329614b8b145 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:18.563746 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b9acd0ef-93be-406d-ae65-329614b8b145 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:18.570129 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b9acd0ef-93be-406d-ae65-329614b8b145 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:18.570582 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b9acd0ef-93be-406d-ae65-329614b8b145 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:18.571376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b9acd0ef-93be-406d-ae65-329614b8b145 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:18.571819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b9acd0ef-93be-406d-ae65-329614b8b145 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:18.699280 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b9acd0ef-93be-406d-ae65-329614b8b145 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:18.707424 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b9acd0ef-93be-406d-ae65-329614b8b145 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148666 May 10 21:38:18.707997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2562/3338] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:18 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:18.895077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-823d9dbe-2a97-4934-8696-e79a28568a47 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:18.895713 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-823d9dbe-2a97-4934-8696-e79a28568a47 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:18.901591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-823d9dbe-2a97-4934-8696-e79a28568a47 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:18.902046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-823d9dbe-2a97-4934-8696-e79a28568a47 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:18.902809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-823d9dbe-2a97-4934-8696-e79a28568a47 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:18.903290 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-823d9dbe-2a97-4934-8696-e79a28568a47 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:19.033138 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-823d9dbe-2a97-4934-8696-e79a28568a47 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:19.040875 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-823d9dbe-2a97-4934-8696-e79a28568a47 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150210 May 10 21:38:19.041444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2563/3339] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:18 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:19.724386 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f5c785e2-c1f5-43d7-94f3-9478a0667fd1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:19.725019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f5c785e2-c1f5-43d7-94f3-9478a0667fd1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:19.731430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5c785e2-c1f5-43d7-94f3-9478a0667fd1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:19.735996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5c785e2-c1f5-43d7-94f3-9478a0667fd1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:19.735996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5c785e2-c1f5-43d7-94f3-9478a0667fd1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:19.735996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5c785e2-c1f5-43d7-94f3-9478a0667fd1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:19.861309 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f5c785e2-c1f5-43d7-94f3-9478a0667fd1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:19.872469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f5c785e2-c1f5-43d7-94f3-9478a0667fd1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.152076 May 10 21:38:19.874911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2564/3340] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:19 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:20.058102 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-559f6ea1-890f-4709-ab2e-60c85957e299 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:20.058818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-559f6ea1-890f-4709-ab2e-60c85957e299 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:20.064893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-559f6ea1-890f-4709-ab2e-60c85957e299 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:20.065354 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-559f6ea1-890f-4709-ab2e-60c85957e299 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:20.066130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-559f6ea1-890f-4709-ab2e-60c85957e299 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:20.066657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-559f6ea1-890f-4709-ab2e-60c85957e299 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:20.268863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-559f6ea1-890f-4709-ab2e-60c85957e299 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:20.276648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-559f6ea1-890f-4709-ab2e-60c85957e299 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.222435 May 10 21:38:20.277219 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2565/3341] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:20 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:20.892843 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-158dc4e9-1e8f-4fe1-bee1-48d565b78d1a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:20.893505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-158dc4e9-1e8f-4fe1-bee1-48d565b78d1a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:20.899778 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-158dc4e9-1e8f-4fe1-bee1-48d565b78d1a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:20.900234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-158dc4e9-1e8f-4fe1-bee1-48d565b78d1a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:20.900990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-158dc4e9-1e8f-4fe1-bee1-48d565b78d1a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:20.901425 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-158dc4e9-1e8f-4fe1-bee1-48d565b78d1a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:21.027516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-158dc4e9-1e8f-4fe1-bee1-48d565b78d1a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:21.035501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-158dc4e9-1e8f-4fe1-bee1-48d565b78d1a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147134 May 10 21:38:21.036063 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2566/3342] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:20 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:21.294472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-05cbd9f5-1475-4033-b532-bf44243efeac tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:21.294998 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-05cbd9f5-1475-4033-b532-bf44243efeac tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:21.301616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-05cbd9f5-1475-4033-b532-bf44243efeac tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:21.309993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-05cbd9f5-1475-4033-b532-bf44243efeac tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:21.309993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-05cbd9f5-1475-4033-b532-bf44243efeac tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:21.309993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-05cbd9f5-1475-4033-b532-bf44243efeac tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:21.435157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-05cbd9f5-1475-4033-b532-bf44243efeac tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:21.443413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-05cbd9f5-1475-4033-b532-bf44243efeac tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.152811 May 10 21:38:21.443984 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2567/3343] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:21 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:22.053340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fc049218-040e-48bc-87dd-76a2c31f0d02 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:22.053999 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fc049218-040e-48bc-87dd-76a2c31f0d02 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:22.060265 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fc049218-040e-48bc-87dd-76a2c31f0d02 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:22.060712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fc049218-040e-48bc-87dd-76a2c31f0d02 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:22.061465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fc049218-040e-48bc-87dd-76a2c31f0d02 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:22.061907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fc049218-040e-48bc-87dd-76a2c31f0d02 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:22.188866 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fc049218-040e-48bc-87dd-76a2c31f0d02 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:22.196775 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fc049218-040e-48bc-87dd-76a2c31f0d02 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147444 May 10 21:38:22.197340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2568/3344] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:22 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:22.461312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c6063608-d67d-4df4-a683-29576e645cb6 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:22.461920 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c6063608-d67d-4df4-a683-29576e645cb6 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:22.468164 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c6063608-d67d-4df4-a683-29576e645cb6 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:22.468611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c6063608-d67d-4df4-a683-29576e645cb6 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:22.469376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c6063608-d67d-4df4-a683-29576e645cb6 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:22.469810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c6063608-d67d-4df4-a683-29576e645cb6 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:22.598929 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c6063608-d67d-4df4-a683-29576e645cb6 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:22.607264 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c6063608-d67d-4df4-a683-29576e645cb6 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149802 May 10 21:38:22.607874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2569/3345] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:22 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:23.214167 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5176d412-97e8-4461-81ac-0279e24effe1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:23.214817 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5176d412-97e8-4461-81ac-0279e24effe1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:23.221817 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5176d412-97e8-4461-81ac-0279e24effe1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:23.222267 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5176d412-97e8-4461-81ac-0279e24effe1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:23.223024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5176d412-97e8-4461-81ac-0279e24effe1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:23.223487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5176d412-97e8-4461-81ac-0279e24effe1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:23.353352 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5176d412-97e8-4461-81ac-0279e24effe1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:23.361083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5176d412-97e8-4461-81ac-0279e24effe1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151206 May 10 21:38:23.361645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2570/3346] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:23 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:23.626269 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f7f43fce-6d71-49b0-8a3e-aef5a0b162d4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:23.627318 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f7f43fce-6d71-49b0-8a3e-aef5a0b162d4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:23.633384 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f7f43fce-6d71-49b0-8a3e-aef5a0b162d4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:23.633829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f7f43fce-6d71-49b0-8a3e-aef5a0b162d4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:23.634582 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f7f43fce-6d71-49b0-8a3e-aef5a0b162d4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:23.635017 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f7f43fce-6d71-49b0-8a3e-aef5a0b162d4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:23.764665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f7f43fce-6d71-49b0-8a3e-aef5a0b162d4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:23.773103 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f7f43fce-6d71-49b0-8a3e-aef5a0b162d4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151446 May 10 21:38:23.773668 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2571/3347] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:23 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:24.377980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2e41e310-26b8-4ae6-9640-c2d480ce2fa5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:24.378602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2e41e310-26b8-4ae6-9640-c2d480ce2fa5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:24.384976 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e41e310-26b8-4ae6-9640-c2d480ce2fa5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:24.385422 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e41e310-26b8-4ae6-9640-c2d480ce2fa5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:24.386179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e41e310-26b8-4ae6-9640-c2d480ce2fa5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:24.386614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2e41e310-26b8-4ae6-9640-c2d480ce2fa5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:24.521395 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2e41e310-26b8-4ae6-9640-c2d480ce2fa5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:24.529215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2e41e310-26b8-4ae6-9640-c2d480ce2fa5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.155860 May 10 21:38:24.530835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2572/3348] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:24 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:24.790195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cb9c9925-eaf1-4bc3-96d8-5c3c844e3300 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:24.790811 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cb9c9925-eaf1-4bc3-96d8-5c3c844e3300 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:24.796825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb9c9925-eaf1-4bc3-96d8-5c3c844e3300 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:24.797285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb9c9925-eaf1-4bc3-96d8-5c3c844e3300 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:24.798056 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb9c9925-eaf1-4bc3-96d8-5c3c844e3300 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:24.798500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cb9c9925-eaf1-4bc3-96d8-5c3c844e3300 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:24.924585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cb9c9925-eaf1-4bc3-96d8-5c3c844e3300 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:24.932698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cb9c9925-eaf1-4bc3-96d8-5c3c844e3300 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.146411 May 10 21:38:24.939852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2573/3349] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:24 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:25.547044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9d948c02-1d67-4f43-b454-eeee2e6a3a60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:25.547714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9d948c02-1d67-4f43-b454-eeee2e6a3a60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:25.555350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9d948c02-1d67-4f43-b454-eeee2e6a3a60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:25.555806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9d948c02-1d67-4f43-b454-eeee2e6a3a60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:25.556581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9d948c02-1d67-4f43-b454-eeee2e6a3a60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:25.557062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9d948c02-1d67-4f43-b454-eeee2e6a3a60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:25.691475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9d948c02-1d67-4f43-b454-eeee2e6a3a60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:25.699729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9d948c02-1d67-4f43-b454-eeee2e6a3a60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.156660 May 10 21:38:25.700294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2574/3350] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:25 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:25.949672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b27af0f0-6747-478f-a520-90892e819692 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:25.950431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b27af0f0-6747-478f-a520-90892e819692 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:25.956600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b27af0f0-6747-478f-a520-90892e819692 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:25.957050 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b27af0f0-6747-478f-a520-90892e819692 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:25.957832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b27af0f0-6747-478f-a520-90892e819692 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:25.958263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b27af0f0-6747-478f-a520-90892e819692 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:26.083548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b27af0f0-6747-478f-a520-90892e819692 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:26.091635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b27af0f0-6747-478f-a520-90892e819692 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.145839 May 10 21:38:26.092203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2575/3351] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:25 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:26.716887 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e9dfef70-38b2-45df-a2a9-877c8a0236d1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:26.717486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e9dfef70-38b2-45df-a2a9-877c8a0236d1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:26.724042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e9dfef70-38b2-45df-a2a9-877c8a0236d1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:26.724494 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e9dfef70-38b2-45df-a2a9-877c8a0236d1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:26.725255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e9dfef70-38b2-45df-a2a9-877c8a0236d1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:26.725689 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e9dfef70-38b2-45df-a2a9-877c8a0236d1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:26.855727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e9dfef70-38b2-45df-a2a9-877c8a0236d1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:26.863578 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e9dfef70-38b2-45df-a2a9-877c8a0236d1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150812 May 10 21:38:26.864147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2576/3352] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:26 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:27.109343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e181693b-82e8-4217-a840-31d59370a5ab tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:27.109964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e181693b-82e8-4217-a840-31d59370a5ab tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:27.116046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e181693b-82e8-4217-a840-31d59370a5ab tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:27.116500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e181693b-82e8-4217-a840-31d59370a5ab tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:27.117299 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e181693b-82e8-4217-a840-31d59370a5ab tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:27.117744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e181693b-82e8-4217-a840-31d59370a5ab tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:27.250788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e181693b-82e8-4217-a840-31d59370a5ab tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:27.258774 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e181693b-82e8-4217-a840-31d59370a5ab tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.153289 May 10 21:38:27.259370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2577/3353] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:27 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:27.881280 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c99e3dbe-61eb-4734-862e-0beecc9a56de tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:27.881971 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c99e3dbe-61eb-4734-862e-0beecc9a56de tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:27.888581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c99e3dbe-61eb-4734-862e-0beecc9a56de tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:27.889302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c99e3dbe-61eb-4734-862e-0beecc9a56de tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:27.890324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c99e3dbe-61eb-4734-862e-0beecc9a56de tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:27.890791 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c99e3dbe-61eb-4734-862e-0beecc9a56de tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:28.017809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c99e3dbe-61eb-4734-862e-0beecc9a56de tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:28.025688 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c99e3dbe-61eb-4734-862e-0beecc9a56de tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149050 May 10 21:38:28.026252 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2578/3354] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:27 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:28.275727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-13557b45-2758-456b-8777-4fd46ca7d707 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:28.276263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-13557b45-2758-456b-8777-4fd46ca7d707 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:28.282196 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-13557b45-2758-456b-8777-4fd46ca7d707 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:28.282657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-13557b45-2758-456b-8777-4fd46ca7d707 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:28.283444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-13557b45-2758-456b-8777-4fd46ca7d707 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:28.283882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-13557b45-2758-456b-8777-4fd46ca7d707 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:28.414965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-13557b45-2758-456b-8777-4fd46ca7d707 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:28.422907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-13557b45-2758-456b-8777-4fd46ca7d707 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151066 May 10 21:38:28.423570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2579/3355] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:28 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:29.042974 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ab1c6690-b0e3-42ff-9b0e-86ea34a58683 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:29.043634 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ab1c6690-b0e3-42ff-9b0e-86ea34a58683 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:29.050630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab1c6690-b0e3-42ff-9b0e-86ea34a58683 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:29.051297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab1c6690-b0e3-42ff-9b0e-86ea34a58683 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:29.052062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab1c6690-b0e3-42ff-9b0e-86ea34a58683 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:29.052501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab1c6690-b0e3-42ff-9b0e-86ea34a58683 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:29.181167 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ab1c6690-b0e3-42ff-9b0e-86ea34a58683 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:29.188988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ab1c6690-b0e3-42ff-9b0e-86ea34a58683 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149917 May 10 21:38:29.189550 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2580/3356] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:29 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:29.440887 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-30127176-b1d5-4dc5-9be1-d6a62f594a2b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:29.441419 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-30127176-b1d5-4dc5-9be1-d6a62f594a2b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:29.447430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-30127176-b1d5-4dc5-9be1-d6a62f594a2b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:29.447886 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-30127176-b1d5-4dc5-9be1-d6a62f594a2b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:29.448646 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-30127176-b1d5-4dc5-9be1-d6a62f594a2b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:29.449103 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-30127176-b1d5-4dc5-9be1-d6a62f594a2b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:29.577138 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-30127176-b1d5-4dc5-9be1-d6a62f594a2b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:29.585574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-30127176-b1d5-4dc5-9be1-d6a62f594a2b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148741 May 10 21:38:29.586135 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2581/3357] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:29 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:30.206483 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fb25bf9d-e2f2-4586-b00c-fe3f5d01f09e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:30.207198 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fb25bf9d-e2f2-4586-b00c-fe3f5d01f09e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:30.213519 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb25bf9d-e2f2-4586-b00c-fe3f5d01f09e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:30.214224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb25bf9d-e2f2-4586-b00c-fe3f5d01f09e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:30.214986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb25bf9d-e2f2-4586-b00c-fe3f5d01f09e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:30.215456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fb25bf9d-e2f2-4586-b00c-fe3f5d01f09e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:30.348949 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fb25bf9d-e2f2-4586-b00c-fe3f5d01f09e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:30.356708 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fb25bf9d-e2f2-4586-b00c-fe3f5d01f09e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.154178 May 10 21:38:30.357271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2582/3358] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:30 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:30.606042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-65ef2cb8-b45b-40d2-af18-68b3bd6412c3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:30.606042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-65ef2cb8-b45b-40d2-af18-68b3bd6412c3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:30.611060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65ef2cb8-b45b-40d2-af18-68b3bd6412c3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:30.611545 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65ef2cb8-b45b-40d2-af18-68b3bd6412c3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:30.613205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65ef2cb8-b45b-40d2-af18-68b3bd6412c3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:30.613841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65ef2cb8-b45b-40d2-af18-68b3bd6412c3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:30.745256 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-65ef2cb8-b45b-40d2-af18-68b3bd6412c3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:30.753180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-65ef2cb8-b45b-40d2-af18-68b3bd6412c3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.153156 May 10 21:38:30.753784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2583/3359] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:30 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:38:31.373708 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4207f7e0-32f8-4287-9620-13d8bfe6af7e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:31.374358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4207f7e0-32f8-4287-9620-13d8bfe6af7e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:31.381199 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4207f7e0-32f8-4287-9620-13d8bfe6af7e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:31.381644 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4207f7e0-32f8-4287-9620-13d8bfe6af7e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:31.382425 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4207f7e0-32f8-4287-9620-13d8bfe6af7e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:31.382872 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4207f7e0-32f8-4287-9620-13d8bfe6af7e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:31.515849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4207f7e0-32f8-4287-9620-13d8bfe6af7e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:31.523727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4207f7e0-32f8-4287-9620-13d8bfe6af7e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.153891 May 10 21:38:31.524292 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2584/3360] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:31 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:31.770188 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7c38ea44-bb14-401a-bfee-266f470b7416 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:31.770729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7c38ea44-bb14-401a-bfee-266f470b7416 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:31.776757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c38ea44-bb14-401a-bfee-266f470b7416 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:31.777201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c38ea44-bb14-401a-bfee-266f470b7416 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:31.777962 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c38ea44-bb14-401a-bfee-266f470b7416 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:31.778452 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7c38ea44-bb14-401a-bfee-266f470b7416 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:31.904443 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7c38ea44-bb14-401a-bfee-266f470b7416 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:31.912846 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7c38ea44-bb14-401a-bfee-266f470b7416 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.146734 May 10 21:38:31.913420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2585/3361] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:31 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:32.542085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8f088405-6700-469b-ae44-8d28eed401d9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:32.542769 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8f088405-6700-469b-ae44-8d28eed401d9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:32.549041 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8f088405-6700-469b-ae44-8d28eed401d9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:32.549488 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8f088405-6700-469b-ae44-8d28eed401d9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:32.550274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8f088405-6700-469b-ae44-8d28eed401d9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:32.550703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8f088405-6700-469b-ae44-8d28eed401d9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:32.680504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8f088405-6700-469b-ae44-8d28eed401d9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:32.688378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8f088405-6700-469b-ae44-8d28eed401d9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150127 May 10 21:38:32.688946 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2586/3362] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:32 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:38:32.930152 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-621c2bbb-c237-4124-9335-5152279197c3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:32.930792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-621c2bbb-c237-4124-9335-5152279197c3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:32.936909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-621c2bbb-c237-4124-9335-5152279197c3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:32.937362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-621c2bbb-c237-4124-9335-5152279197c3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:32.938119 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-621c2bbb-c237-4124-9335-5152279197c3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:32.938552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-621c2bbb-c237-4124-9335-5152279197c3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:33.064205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-621c2bbb-c237-4124-9335-5152279197c3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:33.072764 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-621c2bbb-c237-4124-9335-5152279197c3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.146440 May 10 21:38:33.073324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2587/3363] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:32 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:33.706391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-af3b10eb-0108-4c43-8059-487fa14dead6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:33.707080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-af3b10eb-0108-4c43-8059-487fa14dead6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:33.714072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af3b10eb-0108-4c43-8059-487fa14dead6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:33.714524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af3b10eb-0108-4c43-8059-487fa14dead6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:33.715489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af3b10eb-0108-4c43-8059-487fa14dead6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:33.715932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af3b10eb-0108-4c43-8059-487fa14dead6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:33.862584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-af3b10eb-0108-4c43-8059-487fa14dead6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:33.872373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-af3b10eb-0108-4c43-8059-487fa14dead6 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.170434 May 10 21:38:33.873192 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2588/3364] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:33 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:34.090011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fcc81c2c-716b-4d69-8f98-72ed8a6e1be1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:34.090654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fcc81c2c-716b-4d69-8f98-72ed8a6e1be1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:34.096695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fcc81c2c-716b-4d69-8f98-72ed8a6e1be1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:34.097182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fcc81c2c-716b-4d69-8f98-72ed8a6e1be1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:34.097950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fcc81c2c-716b-4d69-8f98-72ed8a6e1be1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:34.098387 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fcc81c2c-716b-4d69-8f98-72ed8a6e1be1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:34.229875 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fcc81c2c-716b-4d69-8f98-72ed8a6e1be1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:34.238891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fcc81c2c-716b-4d69-8f98-72ed8a6e1be1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.153016 May 10 21:38:34.239498 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2589/3365] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:34 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:34.890103 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-981b6698-9498-438f-a520-2203cf694f1d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:34.890754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-981b6698-9498-438f-a520-2203cf694f1d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:34.897242 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-981b6698-9498-438f-a520-2203cf694f1d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:34.897694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-981b6698-9498-438f-a520-2203cf694f1d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:34.898457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-981b6698-9498-438f-a520-2203cf694f1d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:34.898889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-981b6698-9498-438f-a520-2203cf694f1d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:35.028012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-981b6698-9498-438f-a520-2203cf694f1d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:35.037189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-981b6698-9498-438f-a520-2203cf694f1d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151249 May 10 21:38:35.037770 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2590/3366] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:34 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:35.256221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ee9338b0-7a3d-445b-a119-bd64a1211de3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:35.256749 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ee9338b0-7a3d-445b-a119-bd64a1211de3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:35.263363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee9338b0-7a3d-445b-a119-bd64a1211de3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:35.263810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee9338b0-7a3d-445b-a119-bd64a1211de3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:35.264563 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee9338b0-7a3d-445b-a119-bd64a1211de3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:35.264999 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee9338b0-7a3d-445b-a119-bd64a1211de3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:35.393605 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ee9338b0-7a3d-445b-a119-bd64a1211de3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:35.401884 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ee9338b0-7a3d-445b-a119-bd64a1211de3 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149784 May 10 21:38:35.402453 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2591/3367] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:35 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:36.054608 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c9ac2a6e-eb07-4b6d-a5c2-c00f2f02b1bb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:36.055259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c9ac2a6e-eb07-4b6d-a5c2-c00f2f02b1bb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:36.061669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9ac2a6e-eb07-4b6d-a5c2-c00f2f02b1bb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:36.062127 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9ac2a6e-eb07-4b6d-a5c2-c00f2f02b1bb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:36.062903 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9ac2a6e-eb07-4b6d-a5c2-c00f2f02b1bb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:36.063381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c9ac2a6e-eb07-4b6d-a5c2-c00f2f02b1bb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:36.193199 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c9ac2a6e-eb07-4b6d-a5c2-c00f2f02b1bb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:36.201043 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c9ac2a6e-eb07-4b6d-a5c2-c00f2f02b1bb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150910 May 10 21:38:36.201609 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2592/3368] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:36 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:36.419515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f4f4c302-1d4f-4377-ab45-c65e7b702efd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:36.420151 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f4f4c302-1d4f-4377-ab45-c65e7b702efd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:36.426962 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4f4c302-1d4f-4377-ab45-c65e7b702efd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:36.427434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4f4c302-1d4f-4377-ab45-c65e7b702efd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:36.428199 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4f4c302-1d4f-4377-ab45-c65e7b702efd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:36.428634 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f4f4c302-1d4f-4377-ab45-c65e7b702efd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:36.553198 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f4f4c302-1d4f-4377-ab45-c65e7b702efd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:36.561536 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f4f4c302-1d4f-4377-ab45-c65e7b702efd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.145921 May 10 21:38:36.562111 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2593/3369] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:36 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:37.217682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f2bcef72-4ea1-47a9-b909-91fffcfac6ec tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:37.218320 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f2bcef72-4ea1-47a9-b909-91fffcfac6ec tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:37.224897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2bcef72-4ea1-47a9-b909-91fffcfac6ec tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:37.225342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2bcef72-4ea1-47a9-b909-91fffcfac6ec tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:37.226096 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2bcef72-4ea1-47a9-b909-91fffcfac6ec tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:37.226528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f2bcef72-4ea1-47a9-b909-91fffcfac6ec tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:37.354443 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f2bcef72-4ea1-47a9-b909-91fffcfac6ec tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:37.362222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f2bcef72-4ea1-47a9-b909-91fffcfac6ec tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148618 May 10 21:38:37.362792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2594/3370] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:37 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:37.579179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8fdfd986-1aa0-483f-b649-2aef9c629c46 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:37.579716 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8fdfd986-1aa0-483f-b649-2aef9c629c46 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:37.585741 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8fdfd986-1aa0-483f-b649-2aef9c629c46 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:37.586187 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8fdfd986-1aa0-483f-b649-2aef9c629c46 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:37.586947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8fdfd986-1aa0-483f-b649-2aef9c629c46 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:37.587404 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8fdfd986-1aa0-483f-b649-2aef9c629c46 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:37.717106 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8fdfd986-1aa0-483f-b649-2aef9c629c46 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:37.725788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8fdfd986-1aa0-483f-b649-2aef9c629c46 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150470 May 10 21:38:37.726359 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2595/3371] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:37 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:38.380157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5c764ecd-4c4c-4d49-809f-86805359d345 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:38.380825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5c764ecd-4c4c-4d49-809f-86805359d345 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:38.387046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5c764ecd-4c4c-4d49-809f-86805359d345 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:38.387524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5c764ecd-4c4c-4d49-809f-86805359d345 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:38.388279 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5c764ecd-4c4c-4d49-809f-86805359d345 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:38.388711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5c764ecd-4c4c-4d49-809f-86805359d345 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:38.517716 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5c764ecd-4c4c-4d49-809f-86805359d345 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:38.525414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5c764ecd-4c4c-4d49-809f-86805359d345 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149779 May 10 21:38:38.525992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2596/3372] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:38 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:38.787377 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2c19bf6b-968f-4de8-a0c0-0ed75234501a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:38.788027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2c19bf6b-968f-4de8-a0c0-0ed75234501a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:38.793973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c19bf6b-968f-4de8-a0c0-0ed75234501a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:38.794420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c19bf6b-968f-4de8-a0c0-0ed75234501a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:38.795212 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c19bf6b-968f-4de8-a0c0-0ed75234501a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:38.795654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c19bf6b-968f-4de8-a0c0-0ed75234501a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:38.921432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2c19bf6b-968f-4de8-a0c0-0ed75234501a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:38.929849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2c19bf6b-968f-4de8-a0c0-0ed75234501a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.190422 May 10 21:38:38.930408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2597/3373] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:38 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:39.541666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-41c8db55-0065-4d35-b09c-b2aa50b5d9f9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:39.542378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-41c8db55-0065-4d35-b09c-b2aa50b5d9f9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:39.548654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-41c8db55-0065-4d35-b09c-b2aa50b5d9f9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:39.549100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-41c8db55-0065-4d35-b09c-b2aa50b5d9f9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:39.549858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-41c8db55-0065-4d35-b09c-b2aa50b5d9f9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:39.550292 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-41c8db55-0065-4d35-b09c-b2aa50b5d9f9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:39.682492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-41c8db55-0065-4d35-b09c-b2aa50b5d9f9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:39.690244 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-41c8db55-0065-4d35-b09c-b2aa50b5d9f9 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.152406 May 10 21:38:39.690810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2598/3374] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:39 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:39.947567 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-53a5a81e-5db1-457b-8af7-de3eb4e9be24 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:39.948186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-53a5a81e-5db1-457b-8af7-de3eb4e9be24 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:39.954394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-53a5a81e-5db1-457b-8af7-de3eb4e9be24 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:39.954849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-53a5a81e-5db1-457b-8af7-de3eb4e9be24 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:39.955647 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-53a5a81e-5db1-457b-8af7-de3eb4e9be24 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:39.956087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-53a5a81e-5db1-457b-8af7-de3eb4e9be24 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:40.083847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-53a5a81e-5db1-457b-8af7-de3eb4e9be24 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:40.091837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-53a5a81e-5db1-457b-8af7-de3eb4e9be24 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148185 May 10 21:38:40.092409 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2599/3375] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:39 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:40.708763 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4c918b34-fc5d-449b-85e0-16938b3adcb4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:40.709438 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4c918b34-fc5d-449b-85e0-16938b3adcb4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:40.716129 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4c918b34-fc5d-449b-85e0-16938b3adcb4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:40.716578 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4c918b34-fc5d-449b-85e0-16938b3adcb4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:40.717333 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4c918b34-fc5d-449b-85e0-16938b3adcb4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:40.717772 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4c918b34-fc5d-449b-85e0-16938b3adcb4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:40.845306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4c918b34-fc5d-449b-85e0-16938b3adcb4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:40.853615 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4c918b34-fc5d-449b-85e0-16938b3adcb4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149290 May 10 21:38:40.854187 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2600/3376] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:40 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:41.109506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d6866f00-e27d-4013-b97c-5f535f3841be tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:41.110114 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d6866f00-e27d-4013-b97c-5f535f3841be tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:41.116301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6866f00-e27d-4013-b97c-5f535f3841be tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:41.116868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6866f00-e27d-4013-b97c-5f535f3841be tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:41.117644 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6866f00-e27d-4013-b97c-5f535f3841be tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:41.118087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d6866f00-e27d-4013-b97c-5f535f3841be tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:41.248767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d6866f00-e27d-4013-b97c-5f535f3841be tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:41.257677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d6866f00-e27d-4013-b97c-5f535f3841be tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.152008 May 10 21:38:41.258423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2601/3377] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:41 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:41.870172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d7ff4a11-422f-4665-9b33-de1e3b5f9a42 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:41.870822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d7ff4a11-422f-4665-9b33-de1e3b5f9a42 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:41.877079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d7ff4a11-422f-4665-9b33-de1e3b5f9a42 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:41.877522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d7ff4a11-422f-4665-9b33-de1e3b5f9a42 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:41.878270 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d7ff4a11-422f-4665-9b33-de1e3b5f9a42 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:41.878845 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d7ff4a11-422f-4665-9b33-de1e3b5f9a42 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:42.005819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d7ff4a11-422f-4665-9b33-de1e3b5f9a42 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:42.013650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d7ff4a11-422f-4665-9b33-de1e3b5f9a42 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147401 May 10 21:38:42.014225 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2602/3378] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:41 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:42.273912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a302fd5f-2c65-4c9f-ae35-3e11542017b9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:42.274447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a302fd5f-2c65-4c9f-ae35-3e11542017b9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:42.280478 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a302fd5f-2c65-4c9f-ae35-3e11542017b9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:42.280930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a302fd5f-2c65-4c9f-ae35-3e11542017b9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:42.281692 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a302fd5f-2c65-4c9f-ae35-3e11542017b9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:42.282138 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a302fd5f-2c65-4c9f-ae35-3e11542017b9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:42.413239 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a302fd5f-2c65-4c9f-ae35-3e11542017b9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:42.420958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a302fd5f-2c65-4c9f-ae35-3e11542017b9 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151111 May 10 21:38:42.421520 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2603/3379] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:42 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:43.031297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7f3d5db5-01e3-4e3a-8ea6-42843aa75c2a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:43.031982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7f3d5db5-01e3-4e3a-8ea6-42843aa75c2a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:43.038329 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7f3d5db5-01e3-4e3a-8ea6-42843aa75c2a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:43.038997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7f3d5db5-01e3-4e3a-8ea6-42843aa75c2a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:43.039548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7f3d5db5-01e3-4e3a-8ea6-42843aa75c2a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:43.039989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7f3d5db5-01e3-4e3a-8ea6-42843aa75c2a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:43.167876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7f3d5db5-01e3-4e3a-8ea6-42843aa75c2a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:43.176591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7f3d5db5-01e3-4e3a-8ea6-42843aa75c2a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148418 May 10 21:38:43.177158 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2604/3380] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:43 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:43.438074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-281a9bfa-b97a-4927-b5af-50564c5e8dde tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:43.438682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-281a9bfa-b97a-4927-b5af-50564c5e8dde tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:43.444677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-281a9bfa-b97a-4927-b5af-50564c5e8dde tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:43.445119 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-281a9bfa-b97a-4927-b5af-50564c5e8dde tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:43.445868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-281a9bfa-b97a-4927-b5af-50564c5e8dde tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:43.446300 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-281a9bfa-b97a-4927-b5af-50564c5e8dde tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:43.572657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-281a9bfa-b97a-4927-b5af-50564c5e8dde tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:43.580413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-281a9bfa-b97a-4927-b5af-50564c5e8dde tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.146283 May 10 21:38:43.580983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2605/3381] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:43 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:44.193839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c47f04ab-7ee5-4a31-b473-800d17d7471d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:44.194624 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c47f04ab-7ee5-4a31-b473-800d17d7471d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:44.200536 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c47f04ab-7ee5-4a31-b473-800d17d7471d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:44.200983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c47f04ab-7ee5-4a31-b473-800d17d7471d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:44.201732 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c47f04ab-7ee5-4a31-b473-800d17d7471d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:44.202164 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c47f04ab-7ee5-4a31-b473-800d17d7471d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:44.333445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c47f04ab-7ee5-4a31-b473-800d17d7471d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:44.341387 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c47f04ab-7ee5-4a31-b473-800d17d7471d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151646 May 10 21:38:44.341948 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2606/3382] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:44 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:44.598700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5ba66a13-10ea-48f4-ac76-9413a8e09a76 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:44.599947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5ba66a13-10ea-48f4-ac76-9413a8e09a76 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:44.606276 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ba66a13-10ea-48f4-ac76-9413a8e09a76 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:44.606916 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ba66a13-10ea-48f4-ac76-9413a8e09a76 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:44.607499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ba66a13-10ea-48f4-ac76-9413a8e09a76 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:44.607950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ba66a13-10ea-48f4-ac76-9413a8e09a76 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:44.735941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5ba66a13-10ea-48f4-ac76-9413a8e09a76 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:44.744014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5ba66a13-10ea-48f4-ac76-9413a8e09a76 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149831 May 10 21:38:44.744580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2607/3383] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:44 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:44.912212 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-351f4126-67aa-4cf1-a399-81dcd53372ea tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:44.912656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-351f4126-67aa-4cf1-a399-81dcd53372ea tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4674fb54-efa1-4bed-a2a2-49f3b1184874] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:44.918543 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-351f4126-67aa-4cf1-a399-81dcd53372ea tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:44.919000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-351f4126-67aa-4cf1-a399-81dcd53372ea tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:44.919793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-351f4126-67aa-4cf1-a399-81dcd53372ea tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:44.920234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-351f4126-67aa-4cf1-a399-81dcd53372ea tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:44.944195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-351f4126-67aa-4cf1-a399-81dcd53372ea tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874/ips" status: 200 len: 151 microversion: 2.1 time: 0.036021 May 10 21:38:44.944762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2608/3384] 10.222.0.49 () {58 vars in 1247 bytes} [Tue May 10 21:38:44 2022] GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:38:45.359044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c52b31b0-e9af-4768-8ca6-a6595b60f3b1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:45.359807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c52b31b0-e9af-4768-8ca6-a6595b60f3b1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:45.366767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c52b31b0-e9af-4768-8ca6-a6595b60f3b1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:45.367260 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c52b31b0-e9af-4768-8ca6-a6595b60f3b1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:45.368038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c52b31b0-e9af-4768-8ca6-a6595b60f3b1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:45.368487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c52b31b0-e9af-4768-8ca6-a6595b60f3b1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:45.498038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c52b31b0-e9af-4768-8ca6-a6595b60f3b1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:45.506221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c52b31b0-e9af-4768-8ca6-a6595b60f3b1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151051 May 10 21:38:45.506794 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2609/3385] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:45 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:45.762044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c40cef4a-8a18-4b99-a3e5-1485db551d92 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:45.762574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c40cef4a-8a18-4b99-a3e5-1485db551d92 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:45.768752 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c40cef4a-8a18-4b99-a3e5-1485db551d92 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:45.769766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c40cef4a-8a18-4b99-a3e5-1485db551d92 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:45.770585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c40cef4a-8a18-4b99-a3e5-1485db551d92 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:45.771018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c40cef4a-8a18-4b99-a3e5-1485db551d92 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:45.898885 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c40cef4a-8a18-4b99-a3e5-1485db551d92 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:45.906712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c40cef4a-8a18-4b99-a3e5-1485db551d92 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148758 May 10 21:38:45.907312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2610/3386] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:45 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:46.523284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2badb7cb-bd7e-4cbc-8fd0-7a69eb5a4e6e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:46.523976 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2badb7cb-bd7e-4cbc-8fd0-7a69eb5a4e6e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:46.530256 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2badb7cb-bd7e-4cbc-8fd0-7a69eb5a4e6e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:46.530712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2badb7cb-bd7e-4cbc-8fd0-7a69eb5a4e6e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:46.531516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2badb7cb-bd7e-4cbc-8fd0-7a69eb5a4e6e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:46.531957 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2badb7cb-bd7e-4cbc-8fd0-7a69eb5a4e6e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:46.661745 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2badb7cb-bd7e-4cbc-8fd0-7a69eb5a4e6e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:46.669498 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2badb7cb-bd7e-4cbc-8fd0-7a69eb5a4e6e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150259 May 10 21:38:46.670053 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2611/3387] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:46 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:46.924415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ff385a13-c1c8-4dbe-abab-557348e14ad7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:46.925028 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ff385a13-c1c8-4dbe-abab-557348e14ad7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:46.932134 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ff385a13-c1c8-4dbe-abab-557348e14ad7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:46.932572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ff385a13-c1c8-4dbe-abab-557348e14ad7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:46.933335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ff385a13-c1c8-4dbe-abab-557348e14ad7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:46.933773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ff385a13-c1c8-4dbe-abab-557348e14ad7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:47.060952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ff385a13-c1c8-4dbe-abab-557348e14ad7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:47.069640 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ff385a13-c1c8-4dbe-abab-557348e14ad7 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149195 May 10 21:38:47.070205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2612/3388] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:46 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:47.687182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6fd3ae2d-d788-40c8-8865-c447634d20cb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:47.687842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6fd3ae2d-d788-40c8-8865-c447634d20cb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:47.694423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6fd3ae2d-d788-40c8-8865-c447634d20cb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:47.697890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6fd3ae2d-d788-40c8-8865-c447634d20cb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:47.697890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6fd3ae2d-d788-40c8-8865-c447634d20cb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:47.697890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6fd3ae2d-d788-40c8-8865-c447634d20cb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:47.825270 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6fd3ae2d-d788-40c8-8865-c447634d20cb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:47.833174 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6fd3ae2d-d788-40c8-8865-c447634d20cb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149849 May 10 21:38:47.833743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2613/3389] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:47 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:48.087147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ab743209-4c92-4b3a-aec0-9cc265d672d2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:48.087797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ab743209-4c92-4b3a-aec0-9cc265d672d2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:48.093927 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab743209-4c92-4b3a-aec0-9cc265d672d2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:48.094533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab743209-4c92-4b3a-aec0-9cc265d672d2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:48.095321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab743209-4c92-4b3a-aec0-9cc265d672d2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:48.095754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab743209-4c92-4b3a-aec0-9cc265d672d2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:48.227488 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ab743209-4c92-4b3a-aec0-9cc265d672d2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:48.235171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ab743209-4c92-4b3a-aec0-9cc265d672d2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151944 May 10 21:38:48.235732 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2614/3390] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:48 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:48.849896 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-15e59096-8f40-42de-bf80-de36e1189351 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:48.850618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-15e59096-8f40-42de-bf80-de36e1189351 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:48.856964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-15e59096-8f40-42de-bf80-de36e1189351 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:48.857417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-15e59096-8f40-42de-bf80-de36e1189351 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:48.858266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-15e59096-8f40-42de-bf80-de36e1189351 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:48.858646 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-15e59096-8f40-42de-bf80-de36e1189351 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:48.988630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-15e59096-8f40-42de-bf80-de36e1189351 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:48.996417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-15e59096-8f40-42de-bf80-de36e1189351 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150507 May 10 21:38:48.996978 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2615/3391] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:48 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:49.252288 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2d6763ad-ef41-456c-87c8-4ae22b56f691 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:49.252834 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2d6763ad-ef41-456c-87c8-4ae22b56f691 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:49.258876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d6763ad-ef41-456c-87c8-4ae22b56f691 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:49.259365 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d6763ad-ef41-456c-87c8-4ae22b56f691 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:49.260136 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d6763ad-ef41-456c-87c8-4ae22b56f691 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:49.260578 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2d6763ad-ef41-456c-87c8-4ae22b56f691 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:49.389409 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2d6763ad-ef41-456c-87c8-4ae22b56f691 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:49.397736 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2d6763ad-ef41-456c-87c8-4ae22b56f691 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149449 May 10 21:38:49.398299 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2616/3392] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:49 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:50.013740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-51af69dc-4629-4452-a3ec-aedf33ad7820 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:50.014437 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-51af69dc-4629-4452-a3ec-aedf33ad7820 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:50.021559 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51af69dc-4629-4452-a3ec-aedf33ad7820 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:50.021998 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51af69dc-4629-4452-a3ec-aedf33ad7820 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:50.022754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51af69dc-4629-4452-a3ec-aedf33ad7820 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:50.023287 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-51af69dc-4629-4452-a3ec-aedf33ad7820 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:50.149767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-51af69dc-4629-4452-a3ec-aedf33ad7820 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:50.157484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-51af69dc-4629-4452-a3ec-aedf33ad7820 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147618 May 10 21:38:50.158057 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2617/3393] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:50 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:50.414123 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-52eb9616-52a8-4c97-bd68-9eba799bb000 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:50.414740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-52eb9616-52a8-4c97-bd68-9eba799bb000 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:50.420745 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52eb9616-52a8-4c97-bd68-9eba799bb000 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:50.421201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52eb9616-52a8-4c97-bd68-9eba799bb000 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:50.421968 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52eb9616-52a8-4c97-bd68-9eba799bb000 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:50.422411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52eb9616-52a8-4c97-bd68-9eba799bb000 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:50.549227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-52eb9616-52a8-4c97-bd68-9eba799bb000 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:50.557564 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-52eb9616-52a8-4c97-bd68-9eba799bb000 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.147645 May 10 21:38:50.558130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2618/3394] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:50 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:51.173989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7bd1f84c-e00e-4013-a804-9d6ff520dd51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:51.174620 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7bd1f84c-e00e-4013-a804-9d6ff520dd51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:51.181351 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7bd1f84c-e00e-4013-a804-9d6ff520dd51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:51.181805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7bd1f84c-e00e-4013-a804-9d6ff520dd51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:51.182580 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7bd1f84c-e00e-4013-a804-9d6ff520dd51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:51.183023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7bd1f84c-e00e-4013-a804-9d6ff520dd51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:51.313290 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7bd1f84c-e00e-4013-a804-9d6ff520dd51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:51.321673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7bd1f84c-e00e-4013-a804-9d6ff520dd51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151559 May 10 21:38:51.322244 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2619/3395] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:51 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:51.575442 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-885b6f50-be16-48ce-aa28-aaa211bdbe24 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:51.575971 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-885b6f50-be16-48ce-aa28-aaa211bdbe24 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:51.581795 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-885b6f50-be16-48ce-aa28-aaa211bdbe24 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:51.582243 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-885b6f50-be16-48ce-aa28-aaa211bdbe24 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:51.583718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-885b6f50-be16-48ce-aa28-aaa211bdbe24 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:51.584156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-885b6f50-be16-48ce-aa28-aaa211bdbe24 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:51.713277 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-885b6f50-be16-48ce-aa28-aaa211bdbe24 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:51.721301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-885b6f50-be16-48ce-aa28-aaa211bdbe24 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149782 May 10 21:38:51.721881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2620/3396] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:51 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:52.339394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-444f99b2-9539-4ef5-82ab-666e2b3832b4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:52.340081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-444f99b2-9539-4ef5-82ab-666e2b3832b4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:52.346423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-444f99b2-9539-4ef5-82ab-666e2b3832b4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:52.346874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-444f99b2-9539-4ef5-82ab-666e2b3832b4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:52.347675 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-444f99b2-9539-4ef5-82ab-666e2b3832b4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:52.348643 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-444f99b2-9539-4ef5-82ab-666e2b3832b4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:52.489053 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-444f99b2-9539-4ef5-82ab-666e2b3832b4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:52.489801 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-444f99b2-9539-4ef5-82ab-666e2b3832b4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.154587 May 10 21:38:52.490370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2621/3397] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:52 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:52.737602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ea42c09c-d93b-4f90-998e-ed3342cb51ba tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:52.738218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ea42c09c-d93b-4f90-998e-ed3342cb51ba tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:52.744336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ea42c09c-d93b-4f90-998e-ed3342cb51ba tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:52.744807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ea42c09c-d93b-4f90-998e-ed3342cb51ba tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:52.745559 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ea42c09c-d93b-4f90-998e-ed3342cb51ba tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:52.746004 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ea42c09c-d93b-4f90-998e-ed3342cb51ba tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:52.871517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ea42c09c-d93b-4f90-998e-ed3342cb51ba tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:52.879910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ea42c09c-d93b-4f90-998e-ed3342cb51ba tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.145653 May 10 21:38:52.880568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2622/3398] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:52 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:53.507375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-09d728f7-459e-4623-82db-a0677e159e43 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:53.508081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-09d728f7-459e-4623-82db-a0677e159e43 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:53.514379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-09d728f7-459e-4623-82db-a0677e159e43 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:53.514828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-09d728f7-459e-4623-82db-a0677e159e43 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:53.515617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-09d728f7-459e-4623-82db-a0677e159e43 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:53.516047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-09d728f7-459e-4623-82db-a0677e159e43 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:53.648120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-09d728f7-459e-4623-82db-a0677e159e43 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:53.656047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-09d728f7-459e-4623-82db-a0677e159e43 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.152976 May 10 21:38:53.656640 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2623/3399] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:53 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:53.896554 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c8259354-f3c0-4dca-8519-157ebfd1c531 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:53.897163 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c8259354-f3c0-4dca-8519-157ebfd1c531 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:53.903055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c8259354-f3c0-4dca-8519-157ebfd1c531 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:53.903533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c8259354-f3c0-4dca-8519-157ebfd1c531 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:53.904287 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c8259354-f3c0-4dca-8519-157ebfd1c531 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:53.904719 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c8259354-f3c0-4dca-8519-157ebfd1c531 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:54.030506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c8259354-f3c0-4dca-8519-157ebfd1c531 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:54.038894 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c8259354-f3c0-4dca-8519-157ebfd1c531 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.146694 May 10 21:38:54.039488 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2624/3400] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:53 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:54.672626 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c80ce070-5804-4639-aa0d-a379f30bf8b8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:54.673350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c80ce070-5804-4639-aa0d-a379f30bf8b8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:54.680097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c80ce070-5804-4639-aa0d-a379f30bf8b8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:54.680550 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c80ce070-5804-4639-aa0d-a379f30bf8b8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:54.681320 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c80ce070-5804-4639-aa0d-a379f30bf8b8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:54.681765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c80ce070-5804-4639-aa0d-a379f30bf8b8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:54.810231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c80ce070-5804-4639-aa0d-a379f30bf8b8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:54.818397 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c80ce070-5804-4639-aa0d-a379f30bf8b8 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149845 May 10 21:38:54.818963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2625/3401] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:54 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:55.055620 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8e05fef8-6b85-4675-aad0-cc686ac748ee tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:55.056229 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8e05fef8-6b85-4675-aad0-cc686ac748ee tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:55.062459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e05fef8-6b85-4675-aad0-cc686ac748ee tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:55.062905 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e05fef8-6b85-4675-aad0-cc686ac748ee tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:55.063689 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e05fef8-6b85-4675-aad0-cc686ac748ee tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:55.064138 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e05fef8-6b85-4675-aad0-cc686ac748ee tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:55.195818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8e05fef8-6b85-4675-aad0-cc686ac748ee tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:55.203676 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8e05fef8-6b85-4675-aad0-cc686ac748ee tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.152050 May 10 21:38:55.204235 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2626/3402] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:55 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:55.836443 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5509b26e-9c29-444a-a57b-53769fa6c311 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:55.837122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5509b26e-9c29-444a-a57b-53769fa6c311 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:55.844684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5509b26e-9c29-444a-a57b-53769fa6c311 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:55.845603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5509b26e-9c29-444a-a57b-53769fa6c311 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:55.846374 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5509b26e-9c29-444a-a57b-53769fa6c311 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:55.846811 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5509b26e-9c29-444a-a57b-53769fa6c311 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:55.976542 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5509b26e-9c29-444a-a57b-53769fa6c311 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:55.984676 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5509b26e-9c29-444a-a57b-53769fa6c311 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.153126 May 10 21:38:55.985240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2627/3403] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:55 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:56.222248 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4b1c5a9f-35d3-4c1d-91c2-dd0dc2976453 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:56.223077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4b1c5a9f-35d3-4c1d-91c2-dd0dc2976453 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:56.229707 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4b1c5a9f-35d3-4c1d-91c2-dd0dc2976453 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:56.230156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4b1c5a9f-35d3-4c1d-91c2-dd0dc2976453 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:56.230920 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4b1c5a9f-35d3-4c1d-91c2-dd0dc2976453 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:56.231382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4b1c5a9f-35d3-4c1d-91c2-dd0dc2976453 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:56.640943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4b1c5a9f-35d3-4c1d-91c2-dd0dc2976453 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:56.649403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4b1c5a9f-35d3-4c1d-91c2-dd0dc2976453 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.431334 May 10 21:38:56.650113 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2628/3404] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:56 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:57.001915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0d9d7841-85d7-427e-abbf-6310b277853b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:57.002570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0d9d7841-85d7-427e-abbf-6310b277853b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:57.009189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d9d7841-85d7-427e-abbf-6310b277853b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:57.009641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d9d7841-85d7-427e-abbf-6310b277853b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:57.010403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d9d7841-85d7-427e-abbf-6310b277853b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:57.010840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d9d7841-85d7-427e-abbf-6310b277853b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:57.136572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0d9d7841-85d7-427e-abbf-6310b277853b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:57.144257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0d9d7841-85d7-427e-abbf-6310b277853b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.146368 May 10 21:38:57.145317 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2629/3405] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:56 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:57.674304 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ef181f42-b0fc-4fdd-8276-6c1adb283185 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:57.674918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ef181f42-b0fc-4fdd-8276-6c1adb283185 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:57.681673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ef181f42-b0fc-4fdd-8276-6c1adb283185 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:57.682298 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ef181f42-b0fc-4fdd-8276-6c1adb283185 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:57.682935 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ef181f42-b0fc-4fdd-8276-6c1adb283185 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:57.683407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ef181f42-b0fc-4fdd-8276-6c1adb283185 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:57.814522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ef181f42-b0fc-4fdd-8276-6c1adb283185 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:57.822836 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ef181f42-b0fc-4fdd-8276-6c1adb283185 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.152553 May 10 21:38:57.823427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2630/3406] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:57 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:38:58.161740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-242a11ab-c7dd-494c-8a80-8a14ff6617e0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:58.162403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-242a11ab-c7dd-494c-8a80-8a14ff6617e0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:58.168651 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-242a11ab-c7dd-494c-8a80-8a14ff6617e0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:58.169098 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-242a11ab-c7dd-494c-8a80-8a14ff6617e0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:58.169884 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-242a11ab-c7dd-494c-8a80-8a14ff6617e0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:58.170321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-242a11ab-c7dd-494c-8a80-8a14ff6617e0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:58.295806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-242a11ab-c7dd-494c-8a80-8a14ff6617e0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:58.304933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-242a11ab-c7dd-494c-8a80-8a14ff6617e0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147112 May 10 21:38:58.305500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2631/3407] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:58 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:58.840102 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-62059fb6-97b5-43aa-9254-4a1cd332a1d2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:58.840701 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-62059fb6-97b5-43aa-9254-4a1cd332a1d2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:58.847686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-62059fb6-97b5-43aa-9254-4a1cd332a1d2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:58.848611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-62059fb6-97b5-43aa-9254-4a1cd332a1d2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:58.849385 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-62059fb6-97b5-43aa-9254-4a1cd332a1d2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:58.849820 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-62059fb6-97b5-43aa-9254-4a1cd332a1d2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:58.980492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-62059fb6-97b5-43aa-9254-4a1cd332a1d2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:58.988380 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-62059fb6-97b5-43aa-9254-4a1cd332a1d2 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.152399 May 10 21:38:58.989139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2632/3408] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:58 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:38:59.322703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-63b69b50-cbba-46d5-82cd-3afdd2a43a17 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:38:59.323362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-63b69b50-cbba-46d5-82cd-3afdd2a43a17 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:38:59.329663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-63b69b50-cbba-46d5-82cd-3afdd2a43a17 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:59.330109 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-63b69b50-cbba-46d5-82cd-3afdd2a43a17 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:59.330871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-63b69b50-cbba-46d5-82cd-3afdd2a43a17 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:38:59.331410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-63b69b50-cbba-46d5-82cd-3afdd2a43a17 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:38:59.460325 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-63b69b50-cbba-46d5-82cd-3afdd2a43a17 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:38:59.468286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-63b69b50-cbba-46d5-82cd-3afdd2a43a17 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149768 May 10 21:38:59.468849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2633/3409] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:38:59 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:39:00.006372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f49dbb10-2922-40f6-a70c-69b5ad6cb215 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:00.006907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f49dbb10-2922-40f6-a70c-69b5ad6cb215 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:00.012864 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f49dbb10-2922-40f6-a70c-69b5ad6cb215 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:00.013312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f49dbb10-2922-40f6-a70c-69b5ad6cb215 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:00.014072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f49dbb10-2922-40f6-a70c-69b5ad6cb215 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:00.014509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f49dbb10-2922-40f6-a70c-69b5ad6cb215 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:00.138918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f49dbb10-2922-40f6-a70c-69b5ad6cb215 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:00.146911 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f49dbb10-2922-40f6-a70c-69b5ad6cb215 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.145135 May 10 21:39:00.147519 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2634/3410] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:00 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:00.485034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-71cfe05e-eb45-436d-b1b7-ec8c68ec27f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:00.485782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-71cfe05e-eb45-436d-b1b7-ec8c68ec27f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:00.493207 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71cfe05e-eb45-436d-b1b7-ec8c68ec27f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:00.493651 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71cfe05e-eb45-436d-b1b7-ec8c68ec27f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:00.494409 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71cfe05e-eb45-436d-b1b7-ec8c68ec27f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:00.494848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-71cfe05e-eb45-436d-b1b7-ec8c68ec27f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:00.626641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-71cfe05e-eb45-436d-b1b7-ec8c68ec27f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:00.634863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-71cfe05e-eb45-436d-b1b7-ec8c68ec27f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.153822 May 10 21:39:00.635474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2635/3411] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:00 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:01.164113 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3cc242e6-9382-41f2-9691-b024585e07f0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:01.164722 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3cc242e6-9382-41f2-9691-b024585e07f0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:01.170667 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3cc242e6-9382-41f2-9691-b024585e07f0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:01.171142 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3cc242e6-9382-41f2-9691-b024585e07f0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:01.171894 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3cc242e6-9382-41f2-9691-b024585e07f0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:01.172326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3cc242e6-9382-41f2-9691-b024585e07f0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:01.298721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3cc242e6-9382-41f2-9691-b024585e07f0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:01.306634 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3cc242e6-9382-41f2-9691-b024585e07f0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.146594 May 10 21:39:01.307210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2636/3412] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:01 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:01.651028 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d07dadb6-4413-45c2-93da-ecec0a2a9e73 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:01.651663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d07dadb6-4413-45c2-93da-ecec0a2a9e73 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:01.657958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d07dadb6-4413-45c2-93da-ecec0a2a9e73 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:01.658407 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d07dadb6-4413-45c2-93da-ecec0a2a9e73 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:01.659185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d07dadb6-4413-45c2-93da-ecec0a2a9e73 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:01.659626 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d07dadb6-4413-45c2-93da-ecec0a2a9e73 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:01.787896 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d07dadb6-4413-45c2-93da-ecec0a2a9e73 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:01.795751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d07dadb6-4413-45c2-93da-ecec0a2a9e73 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148572 May 10 21:39:01.796320 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2637/3413] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:01 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:02.323802 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3d2350ed-713d-49c7-b30d-1c0a42b8323e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:02.324410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3d2350ed-713d-49c7-b30d-1c0a42b8323e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:02.330380 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d2350ed-713d-49c7-b30d-1c0a42b8323e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:02.330827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d2350ed-713d-49c7-b30d-1c0a42b8323e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:02.331617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d2350ed-713d-49c7-b30d-1c0a42b8323e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:02.332053 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d2350ed-713d-49c7-b30d-1c0a42b8323e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:02.462096 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3d2350ed-713d-49c7-b30d-1c0a42b8323e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:02.470058 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3d2350ed-713d-49c7-b30d-1c0a42b8323e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150135 May 10 21:39:02.470619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2638/3414] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:02 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:02.813171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2f4951b0-4895-4257-b153-d7f55f5c556a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:02.813847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2f4951b0-4895-4257-b153-d7f55f5c556a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:02.820609 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2f4951b0-4895-4257-b153-d7f55f5c556a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:02.821063 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2f4951b0-4895-4257-b153-d7f55f5c556a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:02.821816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2f4951b0-4895-4257-b153-d7f55f5c556a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:02.822249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2f4951b0-4895-4257-b153-d7f55f5c556a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:02.950362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2f4951b0-4895-4257-b153-d7f55f5c556a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:02.958806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2f4951b0-4895-4257-b153-d7f55f5c556a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149479 May 10 21:39:02.959416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2639/3415] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:02 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:03.487827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ed4886fd-e361-462a-98b1-faa886bef2f4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:03.488480 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ed4886fd-e361-462a-98b1-faa886bef2f4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:03.494577 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed4886fd-e361-462a-98b1-faa886bef2f4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:03.495047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed4886fd-e361-462a-98b1-faa886bef2f4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:03.495842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed4886fd-e361-462a-98b1-faa886bef2f4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:03.496280 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed4886fd-e361-462a-98b1-faa886bef2f4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:03.786392 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ed4886fd-e361-462a-98b1-faa886bef2f4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:03.794139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ed4886fd-e361-462a-98b1-faa886bef2f4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.310251 May 10 21:39:03.794700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2640/3416] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:03 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:03.976132 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c5d158bc-f9c8-4c57-b8a6-c8ab187c5351 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:03.976818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c5d158bc-f9c8-4c57-b8a6-c8ab187c5351 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:03.983033 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5d158bc-f9c8-4c57-b8a6-c8ab187c5351 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:03.983513 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5d158bc-f9c8-4c57-b8a6-c8ab187c5351 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:03.984297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5d158bc-f9c8-4c57-b8a6-c8ab187c5351 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:03.984796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c5d158bc-f9c8-4c57-b8a6-c8ab187c5351 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:04.113874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c5d158bc-f9c8-4c57-b8a6-c8ab187c5351 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:04.121718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c5d158bc-f9c8-4c57-b8a6-c8ab187c5351 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149708 May 10 21:39:04.122274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2641/3417] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:03 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:39:04.812165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-018214fe-6ad0-42cc-91e6-6dc67d3980af tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:04.812932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-018214fe-6ad0-42cc-91e6-6dc67d3980af tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:04.818976 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-018214fe-6ad0-42cc-91e6-6dc67d3980af tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:04.819466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-018214fe-6ad0-42cc-91e6-6dc67d3980af tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:04.820232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-018214fe-6ad0-42cc-91e6-6dc67d3980af tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:04.820671 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-018214fe-6ad0-42cc-91e6-6dc67d3980af tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:04.951669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-018214fe-6ad0-42cc-91e6-6dc67d3980af tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:04.959826 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-018214fe-6ad0-42cc-91e6-6dc67d3980af tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151503 May 10 21:39:04.961816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2642/3418] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:04 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:05.139019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cd533ac4-58bc-4232-9a54-663cd21eecb0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:05.139783 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cd533ac4-58bc-4232-9a54-663cd21eecb0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:05.147176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd533ac4-58bc-4232-9a54-663cd21eecb0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:05.147584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd533ac4-58bc-4232-9a54-663cd21eecb0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:05.148358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd533ac4-58bc-4232-9a54-663cd21eecb0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:05.148800 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cd533ac4-58bc-4232-9a54-663cd21eecb0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:05.277385 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cd533ac4-58bc-4232-9a54-663cd21eecb0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:05.285084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cd533ac4-58bc-4232-9a54-663cd21eecb0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150001 May 10 21:39:05.286305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2643/3419] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:05 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:05.978000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3bb345d0-0c4c-4db8-83c9-4263546b477f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:05.978529 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3bb345d0-0c4c-4db8-83c9-4263546b477f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:05.984455 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3bb345d0-0c4c-4db8-83c9-4263546b477f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:05.984906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3bb345d0-0c4c-4db8-83c9-4263546b477f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:05.985712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3bb345d0-0c4c-4db8-83c9-4263546b477f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:05.986221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3bb345d0-0c4c-4db8-83c9-4263546b477f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:06.114795 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3bb345d0-0c4c-4db8-83c9-4263546b477f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:06.122576 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3bb345d0-0c4c-4db8-83c9-4263546b477f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148531 May 10 21:39:06.123190 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2644/3420] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:05 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:06.303467 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a5447683-974d-4c6b-bb40-7824af344e4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:06.304124 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a5447683-974d-4c6b-bb40-7824af344e4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:06.310335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a5447683-974d-4c6b-bb40-7824af344e4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:06.310791 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a5447683-974d-4c6b-bb40-7824af344e4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:06.311595 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a5447683-974d-4c6b-bb40-7824af344e4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:06.312046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a5447683-974d-4c6b-bb40-7824af344e4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:06.442482 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a5447683-974d-4c6b-bb40-7824af344e4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:06.450293 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a5447683-974d-4c6b-bb40-7824af344e4a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151604 May 10 21:39:06.450861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2645/3421] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:06 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:07.140373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f508db0e-35e9-4a69-9bde-2826a79a2342 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:07.140980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f508db0e-35e9-4a69-9bde-2826a79a2342 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:07.147827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f508db0e-35e9-4a69-9bde-2826a79a2342 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:07.148450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f508db0e-35e9-4a69-9bde-2826a79a2342 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:07.149231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f508db0e-35e9-4a69-9bde-2826a79a2342 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:07.149674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f508db0e-35e9-4a69-9bde-2826a79a2342 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:07.277796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f508db0e-35e9-4a69-9bde-2826a79a2342 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:07.286185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f508db0e-35e9-4a69-9bde-2826a79a2342 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149165 May 10 21:39:07.286751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2646/3422] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:07 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:07.467115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6508d2e8-280c-42ed-8843-797381cdf801 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:07.467789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6508d2e8-280c-42ed-8843-797381cdf801 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:07.474241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6508d2e8-280c-42ed-8843-797381cdf801 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:07.474700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6508d2e8-280c-42ed-8843-797381cdf801 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:07.475517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6508d2e8-280c-42ed-8843-797381cdf801 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:07.475961 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6508d2e8-280c-42ed-8843-797381cdf801 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:07.607401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6508d2e8-280c-42ed-8843-797381cdf801 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:07.616013 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6508d2e8-280c-42ed-8843-797381cdf801 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.153081 May 10 21:39:07.616575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2647/3423] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:07 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:08.303769 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-724f3855-91f0-486e-b2d2-f84c334dfe61 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:08.304379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-724f3855-91f0-486e-b2d2-f84c334dfe61 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:08.310544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-724f3855-91f0-486e-b2d2-f84c334dfe61 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:08.310993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-724f3855-91f0-486e-b2d2-f84c334dfe61 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:08.311779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-724f3855-91f0-486e-b2d2-f84c334dfe61 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:08.312216 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-724f3855-91f0-486e-b2d2-f84c334dfe61 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:08.439230 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-724f3855-91f0-486e-b2d2-f84c334dfe61 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:08.447992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-724f3855-91f0-486e-b2d2-f84c334dfe61 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148689 May 10 21:39:08.448549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2648/3424] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:08 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:08.632893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-132149a3-fdf8-4fe3-b138-2fe954d49a9f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:08.633506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-132149a3-fdf8-4fe3-b138-2fe954d49a9f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:08.639900 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-132149a3-fdf8-4fe3-b138-2fe954d49a9f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:08.640356 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-132149a3-fdf8-4fe3-b138-2fe954d49a9f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:08.641121 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-132149a3-fdf8-4fe3-b138-2fe954d49a9f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:08.641562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-132149a3-fdf8-4fe3-b138-2fe954d49a9f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:08.768277 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-132149a3-fdf8-4fe3-b138-2fe954d49a9f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:08.776141 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-132149a3-fdf8-4fe3-b138-2fe954d49a9f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147477 May 10 21:39:08.776708 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2649/3425] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:08 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:09.465653 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d0961e89-8052-44d7-8473-5139b0096e7d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:09.466273 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d0961e89-8052-44d7-8473-5139b0096e7d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:09.472218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0961e89-8052-44d7-8473-5139b0096e7d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:09.472677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0961e89-8052-44d7-8473-5139b0096e7d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:09.474024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0961e89-8052-44d7-8473-5139b0096e7d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:09.474470 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d0961e89-8052-44d7-8473-5139b0096e7d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:09.606451 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d0961e89-8052-44d7-8473-5139b0096e7d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:09.614617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d0961e89-8052-44d7-8473-5139b0096e7d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.153183 May 10 21:39:09.615206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2650/3426] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:09 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:09.793469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b1a7ee5e-d5fa-4522-851b-2fc58ead52b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:09.794111 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b1a7ee5e-d5fa-4522-851b-2fc58ead52b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:09.800315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b1a7ee5e-d5fa-4522-851b-2fc58ead52b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:09.800770 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b1a7ee5e-d5fa-4522-851b-2fc58ead52b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:09.802375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b1a7ee5e-d5fa-4522-851b-2fc58ead52b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:09.802844 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b1a7ee5e-d5fa-4522-851b-2fc58ead52b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:09.930293 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b1a7ee5e-d5fa-4522-851b-2fc58ead52b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:09.938094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b1a7ee5e-d5fa-4522-851b-2fc58ead52b5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148456 May 10 21:39:09.938662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2651/3427] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:09 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:10.631331 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6984fb94-cb27-4956-a6ce-ecc929b97a46 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:10.631949 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6984fb94-cb27-4956-a6ce-ecc929b97a46 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:10.637937 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6984fb94-cb27-4956-a6ce-ecc929b97a46 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:10.638327 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6984fb94-cb27-4956-a6ce-ecc929b97a46 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:10.639087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6984fb94-cb27-4956-a6ce-ecc929b97a46 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:10.639545 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6984fb94-cb27-4956-a6ce-ecc929b97a46 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:10.770729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6984fb94-cb27-4956-a6ce-ecc929b97a46 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:10.778486 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6984fb94-cb27-4956-a6ce-ecc929b97a46 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151189 May 10 21:39:10.779046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2652/3428] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:10 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:10.955281 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0d2a88d6-e977-46f3-a761-34bb53fb3479 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:10.955954 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0d2a88d6-e977-46f3-a761-34bb53fb3479 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:10.962904 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d2a88d6-e977-46f3-a761-34bb53fb3479 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:10.963404 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d2a88d6-e977-46f3-a761-34bb53fb3479 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:10.964180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d2a88d6-e977-46f3-a761-34bb53fb3479 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:10.964894 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0d2a88d6-e977-46f3-a761-34bb53fb3479 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:11.094975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0d2a88d6-e977-46f3-a761-34bb53fb3479 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:11.103072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0d2a88d6-e977-46f3-a761-34bb53fb3479 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151696 May 10 21:39:11.103849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2653/3429] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:10 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:11.796336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-52922e04-7be4-451f-9ae4-95382620b47b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:11.796941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-52922e04-7be4-451f-9ae4-95382620b47b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:11.803004 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52922e04-7be4-451f-9ae4-95382620b47b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:11.803482 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52922e04-7be4-451f-9ae4-95382620b47b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:11.804271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52922e04-7be4-451f-9ae4-95382620b47b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:11.804705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-52922e04-7be4-451f-9ae4-95382620b47b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:11.936977 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-52922e04-7be4-451f-9ae4-95382620b47b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:11.945307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-52922e04-7be4-451f-9ae4-95382620b47b tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.152825 May 10 21:39:11.945856 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2654/3430] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:11 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:12.120382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c300c150-cefb-420c-9fc4-3d092796a113 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:12.121012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c300c150-cefb-420c-9fc4-3d092796a113 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:12.127517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c300c150-cefb-420c-9fc4-3d092796a113 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:12.127974 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c300c150-cefb-420c-9fc4-3d092796a113 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:12.128783 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c300c150-cefb-420c-9fc4-3d092796a113 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:12.129882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c300c150-cefb-420c-9fc4-3d092796a113 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:12.254641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c300c150-cefb-420c-9fc4-3d092796a113 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:12.262559 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c300c150-cefb-420c-9fc4-3d092796a113 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.146030 May 10 21:39:12.263162 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2655/3431] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:12 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:12.961840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0511b7f5-6d21-4a28-ad34-98a6059cf1a5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:12.962370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0511b7f5-6d21-4a28-ad34-98a6059cf1a5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:12.968530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0511b7f5-6d21-4a28-ad34-98a6059cf1a5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:12.968977 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0511b7f5-6d21-4a28-ad34-98a6059cf1a5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:12.969734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0511b7f5-6d21-4a28-ad34-98a6059cf1a5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:12.970168 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0511b7f5-6d21-4a28-ad34-98a6059cf1a5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:13.099534 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0511b7f5-6d21-4a28-ad34-98a6059cf1a5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:13.107378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0511b7f5-6d21-4a28-ad34-98a6059cf1a5 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149487 May 10 21:39:13.107933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2656/3432] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:12 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:13.279285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a2b5e3b5-d88f-42ee-8fe7-b7b6c7dcdc96 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:13.279933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a2b5e3b5-d88f-42ee-8fe7-b7b6c7dcdc96 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:13.286524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a2b5e3b5-d88f-42ee-8fe7-b7b6c7dcdc96 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:13.286967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a2b5e3b5-d88f-42ee-8fe7-b7b6c7dcdc96 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:13.287816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a2b5e3b5-d88f-42ee-8fe7-b7b6c7dcdc96 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:13.288256 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a2b5e3b5-d88f-42ee-8fe7-b7b6c7dcdc96 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:13.419077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a2b5e3b5-d88f-42ee-8fe7-b7b6c7dcdc96 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:13.426960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a2b5e3b5-d88f-42ee-8fe7-b7b6c7dcdc96 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151519 May 10 21:39:13.427557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2657/3433] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:13 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:14.124184 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0b904c62-2537-4df5-8257-961b02054599 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:14.124799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0b904c62-2537-4df5-8257-961b02054599 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:14.131433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0b904c62-2537-4df5-8257-961b02054599 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:14.131889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0b904c62-2537-4df5-8257-961b02054599 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:14.132657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0b904c62-2537-4df5-8257-961b02054599 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:14.133098 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0b904c62-2537-4df5-8257-961b02054599 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:14.260181 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0b904c62-2537-4df5-8257-961b02054599 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:14.267958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0b904c62-2537-4df5-8257-961b02054599 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.147715 May 10 21:39:14.268528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2658/3434] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:14 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:14.443995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4ded9bae-924f-4c25-879c-af58f9282319 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:14.444724 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4ded9bae-924f-4c25-879c-af58f9282319 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:14.450382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4ded9bae-924f-4c25-879c-af58f9282319 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:14.450827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4ded9bae-924f-4c25-879c-af58f9282319 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:14.451611 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4ded9bae-924f-4c25-879c-af58f9282319 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:14.452044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4ded9bae-924f-4c25-879c-af58f9282319 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:14.587858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4ded9bae-924f-4c25-879c-af58f9282319 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:14.595888 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4ded9bae-924f-4c25-879c-af58f9282319 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.155727 May 10 21:39:14.596444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2659/3435] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:14 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:15.286664 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c4b67356-9710-486e-b9d2-b3a709c50c9f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:15.287307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c4b67356-9710-486e-b9d2-b3a709c50c9f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:15.293648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4b67356-9710-486e-b9d2-b3a709c50c9f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:15.294099 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4b67356-9710-486e-b9d2-b3a709c50c9f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:15.294861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4b67356-9710-486e-b9d2-b3a709c50c9f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:15.295334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c4b67356-9710-486e-b9d2-b3a709c50c9f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:15.423559 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c4b67356-9710-486e-b9d2-b3a709c50c9f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:15.432059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c4b67356-9710-486e-b9d2-b3a709c50c9f tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150052 May 10 21:39:15.432627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2660/3436] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:15 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:15.612636 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fadef4b6-5068-4dab-b6cb-5da00f3bc47f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:15.613275 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fadef4b6-5068-4dab-b6cb-5da00f3bc47f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:15.619296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fadef4b6-5068-4dab-b6cb-5da00f3bc47f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:15.619745 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fadef4b6-5068-4dab-b6cb-5da00f3bc47f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:15.620499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fadef4b6-5068-4dab-b6cb-5da00f3bc47f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:15.620935 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fadef4b6-5068-4dab-b6cb-5da00f3bc47f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:15.746040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fadef4b6-5068-4dab-b6cb-5da00f3bc47f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:15.753960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fadef4b6-5068-4dab-b6cb-5da00f3bc47f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.145004 May 10 21:39:15.755104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2661/3437] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:15 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:16.449658 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-54a9248b-cd59-4070-a4a2-428d50e1abc1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:16.450277 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-54a9248b-cd59-4070-a4a2-428d50e1abc1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:16.456661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54a9248b-cd59-4070-a4a2-428d50e1abc1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:16.457131 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54a9248b-cd59-4070-a4a2-428d50e1abc1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:16.457945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54a9248b-cd59-4070-a4a2-428d50e1abc1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:16.458389 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-54a9248b-cd59-4070-a4a2-428d50e1abc1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:16.589148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-54a9248b-cd59-4070-a4a2-428d50e1abc1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:16.597069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-54a9248b-cd59-4070-a4a2-428d50e1abc1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151306 May 10 21:39:16.597673 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2662/3438] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:16 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:16.771749 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6018c837-0f6a-4971-9c33-2d39316deedf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:16.772409 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6018c837-0f6a-4971-9c33-2d39316deedf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:16.778115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6018c837-0f6a-4971-9c33-2d39316deedf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:16.778564 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6018c837-0f6a-4971-9c33-2d39316deedf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:16.779359 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6018c837-0f6a-4971-9c33-2d39316deedf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:16.779797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6018c837-0f6a-4971-9c33-2d39316deedf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:16.905966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6018c837-0f6a-4971-9c33-2d39316deedf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:16.914484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6018c837-0f6a-4971-9c33-2d39316deedf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.146798 May 10 21:39:16.915049 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2663/3439] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:16 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:17.614014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5a682cfe-42d6-4532-9a03-e8ee47d8d636 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:17.614633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5a682cfe-42d6-4532-9a03-e8ee47d8d636 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:17.621097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5a682cfe-42d6-4532-9a03-e8ee47d8d636 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:17.621551 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5a682cfe-42d6-4532-9a03-e8ee47d8d636 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:17.622316 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5a682cfe-42d6-4532-9a03-e8ee47d8d636 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:17.622753 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5a682cfe-42d6-4532-9a03-e8ee47d8d636 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:17.755597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5a682cfe-42d6-4532-9a03-e8ee47d8d636 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:17.763410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5a682cfe-42d6-4532-9a03-e8ee47d8d636 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.153476 May 10 21:39:17.763971 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2664/3440] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:17 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:17.931006 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-77509f17-2e87-4ec9-b950-02883c46286c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:17.931675 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-77509f17-2e87-4ec9-b950-02883c46286c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:17.937533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-77509f17-2e87-4ec9-b950-02883c46286c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:17.937986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-77509f17-2e87-4ec9-b950-02883c46286c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:17.938748 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-77509f17-2e87-4ec9-b950-02883c46286c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:17.939220 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-77509f17-2e87-4ec9-b950-02883c46286c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:18.068528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-77509f17-2e87-4ec9-b950-02883c46286c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:18.076867 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-77509f17-2e87-4ec9-b950-02883c46286c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149807 May 10 21:39:18.077434 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2665/3441] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:17 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:18.781218 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b06ce747-2a48-4cb5-abd0-90cf19257cb0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:18.781825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b06ce747-2a48-4cb5-abd0-90cf19257cb0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:18.788819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b06ce747-2a48-4cb5-abd0-90cf19257cb0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:18.789269 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b06ce747-2a48-4cb5-abd0-90cf19257cb0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:18.790054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b06ce747-2a48-4cb5-abd0-90cf19257cb0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:18.790488 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b06ce747-2a48-4cb5-abd0-90cf19257cb0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:18.920147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b06ce747-2a48-4cb5-abd0-90cf19257cb0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:18.927943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b06ce747-2a48-4cb5-abd0-90cf19257cb0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150579 May 10 21:39:18.928545 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2666/3442] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:18 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:19.093852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b6cef069-d299-4283-b887-81a32cf07f2c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:19.094484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b6cef069-d299-4283-b887-81a32cf07f2c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:19.100972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b6cef069-d299-4283-b887-81a32cf07f2c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:19.101428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b6cef069-d299-4283-b887-81a32cf07f2c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:19.102199 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b6cef069-d299-4283-b887-81a32cf07f2c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:19.102660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b6cef069-d299-4283-b887-81a32cf07f2c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:19.230286 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b6cef069-d299-4283-b887-81a32cf07f2c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:19.238027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b6cef069-d299-4283-b887-81a32cf07f2c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148283 May 10 21:39:19.238728 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2667/3443] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:19 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:19.945357 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-17f05af8-41e7-452a-9e82-adf6247a8b97 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:19.945897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-17f05af8-41e7-452a-9e82-adf6247a8b97 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:19.952824 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17f05af8-41e7-452a-9e82-adf6247a8b97 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:19.953295 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17f05af8-41e7-452a-9e82-adf6247a8b97 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:19.954220 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17f05af8-41e7-452a-9e82-adf6247a8b97 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:19.954679 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-17f05af8-41e7-452a-9e82-adf6247a8b97 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:20.084255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-17f05af8-41e7-452a-9e82-adf6247a8b97 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:20.092278 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-17f05af8-41e7-452a-9e82-adf6247a8b97 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151238 May 10 21:39:20.092850 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2668/3444] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:19 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:20.255099 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-75d59391-8e44-490f-bf3f-ac3bd553af60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:20.255759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-75d59391-8e44-490f-bf3f-ac3bd553af60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:20.261619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-75d59391-8e44-490f-bf3f-ac3bd553af60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:20.262075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-75d59391-8e44-490f-bf3f-ac3bd553af60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:20.262847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-75d59391-8e44-490f-bf3f-ac3bd553af60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:20.263324 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-75d59391-8e44-490f-bf3f-ac3bd553af60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:20.396227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-75d59391-8e44-490f-bf3f-ac3bd553af60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:20.404082 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-75d59391-8e44-490f-bf3f-ac3bd553af60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.153199 May 10 21:39:20.404642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2669/3445] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:20 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:21.110264 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fca435dd-990c-49a5-b0da-aa12de2216cb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:21.110877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fca435dd-990c-49a5-b0da-aa12de2216cb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:21.117711 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fca435dd-990c-49a5-b0da-aa12de2216cb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:21.118163 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fca435dd-990c-49a5-b0da-aa12de2216cb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:21.118918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fca435dd-990c-49a5-b0da-aa12de2216cb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:21.119378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fca435dd-990c-49a5-b0da-aa12de2216cb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:21.247661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fca435dd-990c-49a5-b0da-aa12de2216cb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:21.256150 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fca435dd-990c-49a5-b0da-aa12de2216cb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149709 May 10 21:39:21.256775 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2670/3446] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:21 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:21.421629 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f913dd3a-1b8e-4cfe-9eaf-826e62951107 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:21.422239 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f913dd3a-1b8e-4cfe-9eaf-826e62951107 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:21.429215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f913dd3a-1b8e-4cfe-9eaf-826e62951107 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:21.429726 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f913dd3a-1b8e-4cfe-9eaf-826e62951107 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:21.430500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f913dd3a-1b8e-4cfe-9eaf-826e62951107 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:21.430939 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f913dd3a-1b8e-4cfe-9eaf-826e62951107 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:21.561565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f913dd3a-1b8e-4cfe-9eaf-826e62951107 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:21.569876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f913dd3a-1b8e-4cfe-9eaf-826e62951107 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.152183 May 10 21:39:21.570438 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2671/3447] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:21 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:22.273815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8c5ff336-6149-471f-b526-6b6409357757 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:22.274474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8c5ff336-6149-471f-b526-6b6409357757 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:22.280630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c5ff336-6149-471f-b526-6b6409357757 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:22.281080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c5ff336-6149-471f-b526-6b6409357757 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:22.281842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c5ff336-6149-471f-b526-6b6409357757 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:22.282280 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c5ff336-6149-471f-b526-6b6409357757 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:22.410411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8c5ff336-6149-471f-b526-6b6409357757 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:22.418350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8c5ff336-6149-471f-b526-6b6409357757 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149124 May 10 21:39:22.418923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2672/3448] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:22 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:22.587561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7018b174-5ed4-4bf7-8e31-336d3ad39c1e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:22.588185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7018b174-5ed4-4bf7-8e31-336d3ad39c1e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:22.594600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7018b174-5ed4-4bf7-8e31-336d3ad39c1e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:22.595058 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7018b174-5ed4-4bf7-8e31-336d3ad39c1e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:22.595863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7018b174-5ed4-4bf7-8e31-336d3ad39c1e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:22.596309 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7018b174-5ed4-4bf7-8e31-336d3ad39c1e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:22.726554 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7018b174-5ed4-4bf7-8e31-336d3ad39c1e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:22.734340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7018b174-5ed4-4bf7-8e31-336d3ad39c1e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150718 May 10 21:39:22.734901 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2673/3449] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:22 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:23.435607 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9c910590-da06-44b7-9457-14a7dd5874d1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:23.436273 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9c910590-da06-44b7-9457-14a7dd5874d1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:23.442616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c910590-da06-44b7-9457-14a7dd5874d1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:23.443068 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c910590-da06-44b7-9457-14a7dd5874d1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:23.443852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c910590-da06-44b7-9457-14a7dd5874d1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:23.444292 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c910590-da06-44b7-9457-14a7dd5874d1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:23.570372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9c910590-da06-44b7-9457-14a7dd5874d1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:23.578091 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9c910590-da06-44b7-9457-14a7dd5874d1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.146328 May 10 21:39:23.578653 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2674/3450] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:23 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:23.751824 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6fa8236b-7078-41cf-9b3e-b9b7ae920389 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:23.752359 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6fa8236b-7078-41cf-9b3e-b9b7ae920389 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:23.759297 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6fa8236b-7078-41cf-9b3e-b9b7ae920389 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:23.759746 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6fa8236b-7078-41cf-9b3e-b9b7ae920389 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:23.760507 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6fa8236b-7078-41cf-9b3e-b9b7ae920389 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:23.760947 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6fa8236b-7078-41cf-9b3e-b9b7ae920389 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:23.885812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6fa8236b-7078-41cf-9b3e-b9b7ae920389 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:23.893505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6fa8236b-7078-41cf-9b3e-b9b7ae920389 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.145640 May 10 21:39:23.894068 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2675/3451] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:23 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:24.596170 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5cc6fd6f-1132-42ff-8a46-f0a11e2a1d18 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:24.596873 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5cc6fd6f-1132-42ff-8a46-f0a11e2a1d18 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:24.604168 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5cc6fd6f-1132-42ff-8a46-f0a11e2a1d18 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:24.604629 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5cc6fd6f-1132-42ff-8a46-f0a11e2a1d18 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:24.605415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5cc6fd6f-1132-42ff-8a46-f0a11e2a1d18 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:24.605907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5cc6fd6f-1132-42ff-8a46-f0a11e2a1d18 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:24.738439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5cc6fd6f-1132-42ff-8a46-f0a11e2a1d18 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:24.746208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5cc6fd6f-1132-42ff-8a46-f0a11e2a1d18 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.153880 May 10 21:39:24.746758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2676/3452] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:24 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:24.910790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e8a03dd9-2791-4195-b519-9b824b67b4fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:24.911932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e8a03dd9-2791-4195-b519-9b824b67b4fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:24.917840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e8a03dd9-2791-4195-b519-9b824b67b4fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:24.918283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e8a03dd9-2791-4195-b519-9b824b67b4fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:24.919040 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e8a03dd9-2791-4195-b519-9b824b67b4fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:24.919501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e8a03dd9-2791-4195-b519-9b824b67b4fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:25.047740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e8a03dd9-2791-4195-b519-9b824b67b4fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:25.055857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e8a03dd9-2791-4195-b519-9b824b67b4fa tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149011 May 10 21:39:25.056427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2677/3453] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:24 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:39:25.763399 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3d2a8cdd-3dc3-4918-b760-ed81b6e45176 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:25.764075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3d2a8cdd-3dc3-4918-b760-ed81b6e45176 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:25.770475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d2a8cdd-3dc3-4918-b760-ed81b6e45176 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:25.770930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d2a8cdd-3dc3-4918-b760-ed81b6e45176 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:25.771729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d2a8cdd-3dc3-4918-b760-ed81b6e45176 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:25.773306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d2a8cdd-3dc3-4918-b760-ed81b6e45176 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:25.907071 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3d2a8cdd-3dc3-4918-b760-ed81b6e45176 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:25.915105 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3d2a8cdd-3dc3-4918-b760-ed81b6e45176 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.155332 May 10 21:39:25.915650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2678/3454] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:25 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:26.073445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-eefbe636-e6a3-47cf-bbe2-b08952da7557 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:26.074058 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-eefbe636-e6a3-47cf-bbe2-b08952da7557 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:26.080105 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eefbe636-e6a3-47cf-bbe2-b08952da7557 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:26.080572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eefbe636-e6a3-47cf-bbe2-b08952da7557 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:26.081322 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eefbe636-e6a3-47cf-bbe2-b08952da7557 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:26.081758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-eefbe636-e6a3-47cf-bbe2-b08952da7557 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:26.211066 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-eefbe636-e6a3-47cf-bbe2-b08952da7557 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:26.219361 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-eefbe636-e6a3-47cf-bbe2-b08952da7557 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150309 May 10 21:39:26.219937 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2679/3455] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:26 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:26.933209 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-210d16e3-5e83-445a-8fe2-3af3c3600107 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:26.933855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-210d16e3-5e83-445a-8fe2-3af3c3600107 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:26.940129 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-210d16e3-5e83-445a-8fe2-3af3c3600107 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:26.940586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-210d16e3-5e83-445a-8fe2-3af3c3600107 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:26.941352 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-210d16e3-5e83-445a-8fe2-3af3c3600107 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:26.941794 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-210d16e3-5e83-445a-8fe2-3af3c3600107 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:27.075156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-210d16e3-5e83-445a-8fe2-3af3c3600107 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:27.082969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-210d16e3-5e83-445a-8fe2-3af3c3600107 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.154668 May 10 21:39:27.083571 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2680/3456] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:26 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:27.236986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0ac5b80d-3e04-4894-be65-dfaaf11b1049 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:27.237510 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0ac5b80d-3e04-4894-be65-dfaaf11b1049 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:27.244240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ac5b80d-3e04-4894-be65-dfaaf11b1049 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:27.244694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ac5b80d-3e04-4894-be65-dfaaf11b1049 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:27.245464 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ac5b80d-3e04-4894-be65-dfaaf11b1049 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:27.245904 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ac5b80d-3e04-4894-be65-dfaaf11b1049 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:27.373647 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0ac5b80d-3e04-4894-be65-dfaaf11b1049 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:27.381472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0ac5b80d-3e04-4894-be65-dfaaf11b1049 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148444 May 10 21:39:27.383115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2681/3457] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:27 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:28.100097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b4ba2210-02fb-456c-8e50-8f05e3427a35 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:28.101727 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b4ba2210-02fb-456c-8e50-8f05e3427a35 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:28.108391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b4ba2210-02fb-456c-8e50-8f05e3427a35 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:28.108825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b4ba2210-02fb-456c-8e50-8f05e3427a35 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:28.109585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b4ba2210-02fb-456c-8e50-8f05e3427a35 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:28.110025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b4ba2210-02fb-456c-8e50-8f05e3427a35 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:28.236825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b4ba2210-02fb-456c-8e50-8f05e3427a35 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:28.244539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b4ba2210-02fb-456c-8e50-8f05e3427a35 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148324 May 10 21:39:28.245107 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2682/3458] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:28 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:28.399135 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a67ee6e0-3e82-4527-b1dc-daee38bdcbdc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:28.399678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a67ee6e0-3e82-4527-b1dc-daee38bdcbdc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:28.405511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a67ee6e0-3e82-4527-b1dc-daee38bdcbdc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:28.405960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a67ee6e0-3e82-4527-b1dc-daee38bdcbdc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:28.406716 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a67ee6e0-3e82-4527-b1dc-daee38bdcbdc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:28.407173 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a67ee6e0-3e82-4527-b1dc-daee38bdcbdc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:28.536539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a67ee6e0-3e82-4527-b1dc-daee38bdcbdc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:28.544743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a67ee6e0-3e82-4527-b1dc-daee38bdcbdc tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149472 May 10 21:39:28.545312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2683/3459] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:28 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:29.261859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3f10e3dc-28cf-42d3-b595-cefb16ecf327 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:29.262514 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3f10e3dc-28cf-42d3-b595-cefb16ecf327 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:29.268714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3f10e3dc-28cf-42d3-b595-cefb16ecf327 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:29.269165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3f10e3dc-28cf-42d3-b595-cefb16ecf327 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:29.269925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3f10e3dc-28cf-42d3-b595-cefb16ecf327 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:29.270362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3f10e3dc-28cf-42d3-b595-cefb16ecf327 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:29.396866 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3f10e3dc-28cf-42d3-b595-cefb16ecf327 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:29.405172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3f10e3dc-28cf-42d3-b595-cefb16ecf327 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.147358 May 10 21:39:29.405744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2684/3460] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:29 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:29.562011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-334d23da-9605-4d0c-9bed-424ddb97f613 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:29.562572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-334d23da-9605-4d0c-9bed-424ddb97f613 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:29.568497 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-334d23da-9605-4d0c-9bed-424ddb97f613 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:29.568965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-334d23da-9605-4d0c-9bed-424ddb97f613 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:29.570367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-334d23da-9605-4d0c-9bed-424ddb97f613 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:29.570807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-334d23da-9605-4d0c-9bed-424ddb97f613 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:29.700079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-334d23da-9605-4d0c-9bed-424ddb97f613 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:29.707750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-334d23da-9605-4d0c-9bed-424ddb97f613 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149598 May 10 21:39:29.708312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2685/3461] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:29 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:39:30.423088 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e3a35829-c10f-4bae-8287-72f865dc60a0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:30.423798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e3a35829-c10f-4bae-8287-72f865dc60a0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:30.430097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e3a35829-c10f-4bae-8287-72f865dc60a0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:30.430562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e3a35829-c10f-4bae-8287-72f865dc60a0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:30.431384 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e3a35829-c10f-4bae-8287-72f865dc60a0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:30.431817 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e3a35829-c10f-4bae-8287-72f865dc60a0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:30.562194 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e3a35829-c10f-4bae-8287-72f865dc60a0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:30.570600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e3a35829-c10f-4bae-8287-72f865dc60a0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151471 May 10 21:39:30.571692 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2686/3462] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:30 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:30.725827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c81fe28c-dd2f-466f-b4b2-012f887f886c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:30.726163 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c81fe28c-dd2f-466f-b4b2-012f887f886c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:30.732087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c81fe28c-dd2f-466f-b4b2-012f887f886c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:30.732537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c81fe28c-dd2f-466f-b4b2-012f887f886c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:30.733298 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c81fe28c-dd2f-466f-b4b2-012f887f886c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:30.733737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c81fe28c-dd2f-466f-b4b2-012f887f886c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:30.859786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c81fe28c-dd2f-466f-b4b2-012f887f886c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:30.868153 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c81fe28c-dd2f-466f-b4b2-012f887f886c tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.146502 May 10 21:39:30.868726 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2687/3463] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:30 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:31.588435 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-36ec7472-d8d1-43ae-85ee-11e495c779d4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:31.589119 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-36ec7472-d8d1-43ae-85ee-11e495c779d4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:31.595676 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-36ec7472-d8d1-43ae-85ee-11e495c779d4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:31.596129 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-36ec7472-d8d1-43ae-85ee-11e495c779d4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:31.596891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-36ec7472-d8d1-43ae-85ee-11e495c779d4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:31.597335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-36ec7472-d8d1-43ae-85ee-11e495c779d4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:31.727774 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-36ec7472-d8d1-43ae-85ee-11e495c779d4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:31.735643 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-36ec7472-d8d1-43ae-85ee-11e495c779d4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151644 May 10 21:39:31.736303 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2688/3464] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:31 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:31.884832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6791b265-a3b7-4bc2-b11f-26e5ced742f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:31.885372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6791b265-a3b7-4bc2-b11f-26e5ced742f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:31.891291 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6791b265-a3b7-4bc2-b11f-26e5ced742f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:31.891753 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6791b265-a3b7-4bc2-b11f-26e5ced742f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:31.892528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6791b265-a3b7-4bc2-b11f-26e5ced742f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:31.892971 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6791b265-a3b7-4bc2-b11f-26e5ced742f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:32.018623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6791b265-a3b7-4bc2-b11f-26e5ced742f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:32.026335 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6791b265-a3b7-4bc2-b11f-26e5ced742f1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.145367 May 10 21:39:32.026896 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2689/3465] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:31 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:32.753284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c8da0d62-0457-4a20-a74b-c506ef67d0ed tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:32.753962 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c8da0d62-0457-4a20-a74b-c506ef67d0ed tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:32.760975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c8da0d62-0457-4a20-a74b-c506ef67d0ed tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:32.761426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c8da0d62-0457-4a20-a74b-c506ef67d0ed tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:32.762182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c8da0d62-0457-4a20-a74b-c506ef67d0ed tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:32.762619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c8da0d62-0457-4a20-a74b-c506ef67d0ed tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:32.891760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c8da0d62-0457-4a20-a74b-c506ef67d0ed tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:32.899650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c8da0d62-0457-4a20-a74b-c506ef67d0ed tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150208 May 10 21:39:32.900205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2690/3466] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:32 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:33.042951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4f282c0c-3e9d-4d1c-935b-27771cd3efb4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:33.043590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4f282c0c-3e9d-4d1c-935b-27771cd3efb4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:33.049540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f282c0c-3e9d-4d1c-935b-27771cd3efb4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:33.049993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f282c0c-3e9d-4d1c-935b-27771cd3efb4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:33.050754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f282c0c-3e9d-4d1c-935b-27771cd3efb4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:33.051221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f282c0c-3e9d-4d1c-935b-27771cd3efb4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:33.182788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4f282c0c-3e9d-4d1c-935b-27771cd3efb4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:33.192050 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4f282c0c-3e9d-4d1c-935b-27771cd3efb4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.152928 May 10 21:39:33.192630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2691/3467] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:33 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:33.917709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-53969790-9206-4b85-a9bb-3fd54700d559 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:33.918376 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-53969790-9206-4b85-a9bb-3fd54700d559 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:33.924986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-53969790-9206-4b85-a9bb-3fd54700d559 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:33.925445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-53969790-9206-4b85-a9bb-3fd54700d559 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:33.926232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-53969790-9206-4b85-a9bb-3fd54700d559 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:33.926669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-53969790-9206-4b85-a9bb-3fd54700d559 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:34.058017 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-53969790-9206-4b85-a9bb-3fd54700d559 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:34.065781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-53969790-9206-4b85-a9bb-3fd54700d559 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.152091 May 10 21:39:34.066346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2692/3468] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:33 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:34.209491 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-25157c7e-e794-46cc-a1d1-4c02c53dec47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:34.210639 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-25157c7e-e794-46cc-a1d1-4c02c53dec47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:34.216910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-25157c7e-e794-46cc-a1d1-4c02c53dec47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:34.217358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-25157c7e-e794-46cc-a1d1-4c02c53dec47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:34.218129 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-25157c7e-e794-46cc-a1d1-4c02c53dec47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:34.218570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-25157c7e-e794-46cc-a1d1-4c02c53dec47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:34.352976 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-25157c7e-e794-46cc-a1d1-4c02c53dec47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:34.360966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-25157c7e-e794-46cc-a1d1-4c02c53dec47 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.155386 May 10 21:39:34.361541 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2693/3469] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:34 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:35.082510 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-075aee02-520d-4821-b783-f2cc9b6113bb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:35.083182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-075aee02-520d-4821-b783-f2cc9b6113bb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:35.090278 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-075aee02-520d-4821-b783-f2cc9b6113bb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:35.090726 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-075aee02-520d-4821-b783-f2cc9b6113bb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:35.091529 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-075aee02-520d-4821-b783-f2cc9b6113bb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:35.091968 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-075aee02-520d-4821-b783-f2cc9b6113bb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:35.221258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-075aee02-520d-4821-b783-f2cc9b6113bb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:35.229627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-075aee02-520d-4821-b783-f2cc9b6113bb tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151027 May 10 21:39:35.230200 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2694/3470] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:35 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:35.377949 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d97b8851-e825-4b98-b19f-eb63af87863b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:35.378595 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d97b8851-e825-4b98-b19f-eb63af87863b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:35.385235 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d97b8851-e825-4b98-b19f-eb63af87863b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:35.385722 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d97b8851-e825-4b98-b19f-eb63af87863b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:35.386492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d97b8851-e825-4b98-b19f-eb63af87863b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:35.386937 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d97b8851-e825-4b98-b19f-eb63af87863b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:35.517627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d97b8851-e825-4b98-b19f-eb63af87863b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:35.525627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d97b8851-e825-4b98-b19f-eb63af87863b tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.151542 May 10 21:39:35.526192 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2695/3471] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:35 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:36.246403 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0f444a68-aaa6-4cd5-8611-ce8250519385 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:36.247094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0f444a68-aaa6-4cd5-8611-ce8250519385 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:36.253425 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f444a68-aaa6-4cd5-8611-ce8250519385 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:36.253873 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f444a68-aaa6-4cd5-8611-ce8250519385 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:36.254631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f444a68-aaa6-4cd5-8611-ce8250519385 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:36.255065 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f444a68-aaa6-4cd5-8611-ce8250519385 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:36.380662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0f444a68-aaa6-4cd5-8611-ce8250519385 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:36.389084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0f444a68-aaa6-4cd5-8611-ce8250519385 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.146611 May 10 21:39:36.389653 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2696/3472] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:36 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:36.542201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-226eab4a-dbe3-4936-8964-c26490814029 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:36.542736 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-226eab4a-dbe3-4936-8964-c26490814029 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:36.548697 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-226eab4a-dbe3-4936-8964-c26490814029 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:36.549147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-226eab4a-dbe3-4936-8964-c26490814029 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:36.549934 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-226eab4a-dbe3-4936-8964-c26490814029 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:36.550372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-226eab4a-dbe3-4936-8964-c26490814029 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:36.680063 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-226eab4a-dbe3-4936-8964-c26490814029 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:36.687785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-226eab4a-dbe3-4936-8964-c26490814029 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149462 May 10 21:39:36.688342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2697/3473] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:36 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:37.406773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7ede0e21-7ca1-4e1a-9612-da0a549789e0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:37.407469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7ede0e21-7ca1-4e1a-9612-da0a549789e0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:37.414248 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ede0e21-7ca1-4e1a-9612-da0a549789e0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:37.414700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ede0e21-7ca1-4e1a-9612-da0a549789e0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:37.415507 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ede0e21-7ca1-4e1a-9612-da0a549789e0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:37.415941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ede0e21-7ca1-4e1a-9612-da0a549789e0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:37.542440 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7ede0e21-7ca1-4e1a-9612-da0a549789e0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:37.550150 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7ede0e21-7ca1-4e1a-9612-da0a549789e0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.147261 May 10 21:39:37.550716 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2698/3474] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:37 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:37.711663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8bfa997f-9a42-4549-9609-0aa745012b51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:37.711663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8bfa997f-9a42-4549-9609-0aa745012b51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:37.712056 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8bfa997f-9a42-4549-9609-0aa745012b51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:37.712509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8bfa997f-9a42-4549-9609-0aa745012b51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:37.713270 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8bfa997f-9a42-4549-9609-0aa745012b51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:37.713706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8bfa997f-9a42-4549-9609-0aa745012b51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:37.842468 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8bfa997f-9a42-4549-9609-0aa745012b51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:37.850887 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8bfa997f-9a42-4549-9609-0aa745012b51 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148995 May 10 21:39:37.851481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2699/3475] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:37 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:38.567739 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5be0d53e-46e5-47a3-80bb-a45acce397bd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:38.568426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5be0d53e-46e5-47a3-80bb-a45acce397bd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:38.575187 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5be0d53e-46e5-47a3-80bb-a45acce397bd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:38.575645 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5be0d53e-46e5-47a3-80bb-a45acce397bd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:38.576411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5be0d53e-46e5-47a3-80bb-a45acce397bd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:38.576853 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5be0d53e-46e5-47a3-80bb-a45acce397bd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:38.711196 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5be0d53e-46e5-47a3-80bb-a45acce397bd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:38.719086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5be0d53e-46e5-47a3-80bb-a45acce397bd tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.155244 May 10 21:39:38.719675 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2700/3476] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:38 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:38.868231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e5c1ca59-7a79-4c60-b9f2-cc42235e433e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:38.868840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e5c1ca59-7a79-4c60-b9f2-cc42235e433e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:38.874704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e5c1ca59-7a79-4c60-b9f2-cc42235e433e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:38.875175 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e5c1ca59-7a79-4c60-b9f2-cc42235e433e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:38.875938 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e5c1ca59-7a79-4c60-b9f2-cc42235e433e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:38.876372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e5c1ca59-7a79-4c60-b9f2-cc42235e433e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:39.004651 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e5c1ca59-7a79-4c60-b9f2-cc42235e433e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:39.012939 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e5c1ca59-7a79-4c60-b9f2-cc42235e433e tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149146 May 10 21:39:39.013499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2701/3477] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:38 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:39.736542 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3f76b0cd-dd7f-4140-83f8-ce40263be63c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:39.737182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3f76b0cd-dd7f-4140-83f8-ce40263be63c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:39.744141 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3f76b0cd-dd7f-4140-83f8-ce40263be63c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:39.744589 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3f76b0cd-dd7f-4140-83f8-ce40263be63c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:39.745348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3f76b0cd-dd7f-4140-83f8-ce40263be63c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:39.745785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3f76b0cd-dd7f-4140-83f8-ce40263be63c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:39.876822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3f76b0cd-dd7f-4140-83f8-ce40263be63c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:39.885060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3f76b0cd-dd7f-4140-83f8-ce40263be63c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.152339 May 10 21:39:39.885625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2702/3478] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:39 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:40.029952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f35f19bb-2eec-494d-9389-8a177df11230 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:40.030740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f35f19bb-2eec-494d-9389-8a177df11230 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:40.037176 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f35f19bb-2eec-494d-9389-8a177df11230 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:40.038246 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f35f19bb-2eec-494d-9389-8a177df11230 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:40.038926 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f35f19bb-2eec-494d-9389-8a177df11230 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:40.039398 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f35f19bb-2eec-494d-9389-8a177df11230 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:40.175241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f35f19bb-2eec-494d-9389-8a177df11230 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:40.181822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f35f19bb-2eec-494d-9389-8a177df11230 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.155833 May 10 21:39:40.182399 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2703/3479] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:40 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:40.902762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d5984e5d-7fe4-4049-8fb2-7052f0d36765 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:40.903550 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d5984e5d-7fe4-4049-8fb2-7052f0d36765 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:40.909789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d5984e5d-7fe4-4049-8fb2-7052f0d36765 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:40.910252 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d5984e5d-7fe4-4049-8fb2-7052f0d36765 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:40.911035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d5984e5d-7fe4-4049-8fb2-7052f0d36765 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:40.911502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d5984e5d-7fe4-4049-8fb2-7052f0d36765 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:41.043165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d5984e5d-7fe4-4049-8fb2-7052f0d36765 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:41.050959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d5984e5d-7fe4-4049-8fb2-7052f0d36765 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.152094 May 10 21:39:41.051567 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2704/3480] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:40 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:41.198157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-607a401d-d901-40bf-8386-00f5ea104f60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:41.198766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-607a401d-d901-40bf-8386-00f5ea104f60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:41.204626 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-607a401d-d901-40bf-8386-00f5ea104f60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:41.205082 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-607a401d-d901-40bf-8386-00f5ea104f60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:41.205846 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-607a401d-d901-40bf-8386-00f5ea104f60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:41.206289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-607a401d-d901-40bf-8386-00f5ea104f60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:41.333113 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-607a401d-d901-40bf-8386-00f5ea104f60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:41.341981 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-607a401d-d901-40bf-8386-00f5ea104f60 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147750 May 10 21:39:41.342551 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2705/3481] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:41 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:42.068492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-efc8a6b4-23ac-4a8a-bdea-d56ee9963d1a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:42.070546 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-efc8a6b4-23ac-4a8a-bdea-d56ee9963d1a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:42.077173 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-efc8a6b4-23ac-4a8a-bdea-d56ee9963d1a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:42.077638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-efc8a6b4-23ac-4a8a-bdea-d56ee9963d1a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:42.078411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-efc8a6b4-23ac-4a8a-bdea-d56ee9963d1a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:42.078858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-efc8a6b4-23ac-4a8a-bdea-d56ee9963d1a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:42.205090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-efc8a6b4-23ac-4a8a-bdea-d56ee9963d1a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:42.212806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-efc8a6b4-23ac-4a8a-bdea-d56ee9963d1a tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148458 May 10 21:39:42.213380 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2706/3482] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:42 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:42.359252 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-aaac2210-342c-4898-82a1-ef177551eeeb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:42.359864 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-aaac2210-342c-4898-82a1-ef177551eeeb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:42.365712 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aaac2210-342c-4898-82a1-ef177551eeeb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:42.366709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aaac2210-342c-4898-82a1-ef177551eeeb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:42.367609 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aaac2210-342c-4898-82a1-ef177551eeeb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:42.368050 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aaac2210-342c-4898-82a1-ef177551eeeb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:42.496225 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-aaac2210-342c-4898-82a1-ef177551eeeb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:42.503963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-aaac2210-342c-4898-82a1-ef177551eeeb tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148519 May 10 21:39:42.504531 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2707/3483] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:42 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:43.229411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b9258bb7-8504-4cd5-8c91-d59327ec81c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:43.230043 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b9258bb7-8504-4cd5-8c91-d59327ec81c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:43.236454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b9258bb7-8504-4cd5-8c91-d59327ec81c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:43.236914 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b9258bb7-8504-4cd5-8c91-d59327ec81c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:43.237689 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b9258bb7-8504-4cd5-8c91-d59327ec81c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:43.238143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b9258bb7-8504-4cd5-8c91-d59327ec81c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:43.365427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b9258bb7-8504-4cd5-8c91-d59327ec81c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:43.373880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b9258bb7-8504-4cd5-8c91-d59327ec81c0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148468 May 10 21:39:43.374455 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2708/3484] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:43 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:43.520886 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-120b346c-0f20-4d2e-b8ed-9f1cf2c32d4d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:43.521506 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-120b346c-0f20-4d2e-b8ed-9f1cf2c32d4d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:43.527646 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-120b346c-0f20-4d2e-b8ed-9f1cf2c32d4d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:43.528104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-120b346c-0f20-4d2e-b8ed-9f1cf2c32d4d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:43.528881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-120b346c-0f20-4d2e-b8ed-9f1cf2c32d4d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:43.529327 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-120b346c-0f20-4d2e-b8ed-9f1cf2c32d4d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:43.658601 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-120b346c-0f20-4d2e-b8ed-9f1cf2c32d4d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:43.666642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-120b346c-0f20-4d2e-b8ed-9f1cf2c32d4d tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149634 May 10 21:39:43.667226 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2709/3485] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:43 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:44.391959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-de935590-5f88-4272-b84d-08a0cbfb6912 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:44.392635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-de935590-5f88-4272-b84d-08a0cbfb6912 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:44.399022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de935590-5f88-4272-b84d-08a0cbfb6912 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:44.399492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de935590-5f88-4272-b84d-08a0cbfb6912 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:44.400249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de935590-5f88-4272-b84d-08a0cbfb6912 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:44.400682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de935590-5f88-4272-b84d-08a0cbfb6912 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:44.528414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-de935590-5f88-4272-b84d-08a0cbfb6912 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:44.536287 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-de935590-5f88-4272-b84d-08a0cbfb6912 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148217 May 10 21:39:44.536852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2710/3486] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:44 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:44.684285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f0fff396-f6e9-4998-b1da-81a503ec63e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:44.863481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f0fff396-f6e9-4998-b1da-81a503ec63e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:44.863481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0fff396-f6e9-4998-b1da-81a503ec63e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:44.863481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0fff396-f6e9-4998-b1da-81a503ec63e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:44.863481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0fff396-f6e9-4998-b1da-81a503ec63e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:44.864805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f0fff396-f6e9-4998-b1da-81a503ec63e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:44.864805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f0fff396-f6e9-4998-b1da-81a503ec63e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:44.864805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f0fff396-f6e9-4998-b1da-81a503ec63e5 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.157619 May 10 21:39:44.864805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2711/3487] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:44 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:45.563099 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-de762b73-a4da-4209-979e-5749e4d991a0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:45.563891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-de762b73-a4da-4209-979e-5749e4d991a0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:45.569850 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de762b73-a4da-4209-979e-5749e4d991a0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:45.570295 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de762b73-a4da-4209-979e-5749e4d991a0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:45.571047 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de762b73-a4da-4209-979e-5749e4d991a0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:45.571507 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-de762b73-a4da-4209-979e-5749e4d991a0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:45.709231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-de762b73-a4da-4209-979e-5749e4d991a0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:45.718358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-de762b73-a4da-4209-979e-5749e4d991a0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.159130 May 10 21:39:45.718922 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2712/3488] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:45 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:45.855417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9cc3a8b6-55f8-44ae-a3b1-158f382cfed7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:45.856017 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9cc3a8b6-55f8-44ae-a3b1-158f382cfed7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:45.861805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9cc3a8b6-55f8-44ae-a3b1-158f382cfed7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:45.862258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9cc3a8b6-55f8-44ae-a3b1-158f382cfed7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:45.863013 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9cc3a8b6-55f8-44ae-a3b1-158f382cfed7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:45.863472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9cc3a8b6-55f8-44ae-a3b1-158f382cfed7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:45.992774 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9cc3a8b6-55f8-44ae-a3b1-158f382cfed7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:46.000805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9cc3a8b6-55f8-44ae-a3b1-158f382cfed7 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149108 May 10 21:39:46.001384 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2713/3489] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:45 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:46.735412 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-23f154a1-eb13-430c-897e-a87bcbfd7ca0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:46.736015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-23f154a1-eb13-430c-897e-a87bcbfd7ca0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:46.742420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-23f154a1-eb13-430c-897e-a87bcbfd7ca0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:46.742868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-23f154a1-eb13-430c-897e-a87bcbfd7ca0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:46.743650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-23f154a1-eb13-430c-897e-a87bcbfd7ca0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:46.744089 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-23f154a1-eb13-430c-897e-a87bcbfd7ca0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:46.875060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-23f154a1-eb13-430c-897e-a87bcbfd7ca0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:46.883621 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-23f154a1-eb13-430c-897e-a87bcbfd7ca0 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.152078 May 10 21:39:46.884195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2714/3490] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:46 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:47.018051 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0b694ef0-3c7e-407a-b7f6-b13b6adc323a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:47.018669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0b694ef0-3c7e-407a-b7f6-b13b6adc323a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:47.025493 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0b694ef0-3c7e-407a-b7f6-b13b6adc323a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:47.025952 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0b694ef0-3c7e-407a-b7f6-b13b6adc323a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:47.026757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0b694ef0-3c7e-407a-b7f6-b13b6adc323a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:47.027231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0b694ef0-3c7e-407a-b7f6-b13b6adc323a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:47.153892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0b694ef0-3c7e-407a-b7f6-b13b6adc323a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:47.161591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0b694ef0-3c7e-407a-b7f6-b13b6adc323a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147386 May 10 21:39:47.162158 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2715/3491] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:47 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:47.901507 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4f95961d-cb67-41b3-92c1-7a63ea72b05c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:47.902172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4f95961d-cb67-41b3-92c1-7a63ea72b05c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:47.908528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f95961d-cb67-41b3-92c1-7a63ea72b05c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:47.908999 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f95961d-cb67-41b3-92c1-7a63ea72b05c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:47.909751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f95961d-cb67-41b3-92c1-7a63ea72b05c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:47.910185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4f95961d-cb67-41b3-92c1-7a63ea72b05c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:48.040674 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4f95961d-cb67-41b3-92c1-7a63ea72b05c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:48.048427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4f95961d-cb67-41b3-92c1-7a63ea72b05c tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151680 May 10 21:39:48.048986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2716/3492] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:47 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:48.177649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f5d11be5-8b72-4b24-98c7-613efab4624f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:48.178731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f5d11be5-8b72-4b24-98c7-613efab4624f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:48.184709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5d11be5-8b72-4b24-98c7-613efab4624f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:48.185167 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5d11be5-8b72-4b24-98c7-613efab4624f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:48.185935 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5d11be5-8b72-4b24-98c7-613efab4624f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:48.186402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f5d11be5-8b72-4b24-98c7-613efab4624f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:48.312266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f5d11be5-8b72-4b24-98c7-613efab4624f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:48.320226 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f5d11be5-8b72-4b24-98c7-613efab4624f tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.146405 May 10 21:39:48.320871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2717/3493] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:48 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:49.065680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-231d1b14-be88-4739-ae95-30d957c710a8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:49.066340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-231d1b14-be88-4739-ae95-30d957c710a8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:49.073109 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-231d1b14-be88-4739-ae95-30d957c710a8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:49.073553 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-231d1b14-be88-4739-ae95-30d957c710a8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:49.074311 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-231d1b14-be88-4739-ae95-30d957c710a8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:49.074742 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-231d1b14-be88-4739-ae95-30d957c710a8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:49.199493 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-231d1b14-be88-4739-ae95-30d957c710a8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:49.207346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-231d1b14-be88-4739-ae95-30d957c710a8 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.145596 May 10 21:39:49.207918 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2718/3494] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:49 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:49.337920 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a4f1d0e6-ea46-4023-aead-04a397602833 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:49.338540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a4f1d0e6-ea46-4023-aead-04a397602833 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:49.344871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a4f1d0e6-ea46-4023-aead-04a397602833 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:49.345327 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a4f1d0e6-ea46-4023-aead-04a397602833 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:49.346104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a4f1d0e6-ea46-4023-aead-04a397602833 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:49.346546 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a4f1d0e6-ea46-4023-aead-04a397602833 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:49.474369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a4f1d0e6-ea46-4023-aead-04a397602833 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:49.482205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a4f1d0e6-ea46-4023-aead-04a397602833 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149058 May 10 21:39:49.482768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2719/3495] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:49 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:50.226552 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-57b724fb-071d-4d72-9c5e-ee8ce5eae96d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:50.227271 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-57b724fb-071d-4d72-9c5e-ee8ce5eae96d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:50.233539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-57b724fb-071d-4d72-9c5e-ee8ce5eae96d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:50.233987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-57b724fb-071d-4d72-9c5e-ee8ce5eae96d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:50.234753 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-57b724fb-071d-4d72-9c5e-ee8ce5eae96d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:50.235219 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-57b724fb-071d-4d72-9c5e-ee8ce5eae96d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:50.369704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-57b724fb-071d-4d72-9c5e-ee8ce5eae96d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:50.377431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-57b724fb-071d-4d72-9c5e-ee8ce5eae96d tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.155833 May 10 21:39:50.378005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2720/3496] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:50 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:50.498628 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b72a5ed9-0018-4bce-ab80-4b6420c9fd95 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:50.499180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b72a5ed9-0018-4bce-ab80-4b6420c9fd95 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:50.505038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b72a5ed9-0018-4bce-ab80-4b6420c9fd95 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:50.505489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b72a5ed9-0018-4bce-ab80-4b6420c9fd95 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:50.506819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b72a5ed9-0018-4bce-ab80-4b6420c9fd95 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:50.507397 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b72a5ed9-0018-4bce-ab80-4b6420c9fd95 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:50.637678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b72a5ed9-0018-4bce-ab80-4b6420c9fd95 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:50.645620 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b72a5ed9-0018-4bce-ab80-4b6420c9fd95 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.150892 May 10 21:39:50.646382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2721/3497] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:50 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:51.394398 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-255c826e-cc0a-4f37-b7dc-96f368d0d155 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:51.395352 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-255c826e-cc0a-4f37-b7dc-96f368d0d155 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:51.401765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-255c826e-cc0a-4f37-b7dc-96f368d0d155 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:51.402211 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-255c826e-cc0a-4f37-b7dc-96f368d0d155 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:51.402963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-255c826e-cc0a-4f37-b7dc-96f368d0d155 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:51.403428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-255c826e-cc0a-4f37-b7dc-96f368d0d155 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:51.530057 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-255c826e-cc0a-4f37-b7dc-96f368d0d155 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:51.538775 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-255c826e-cc0a-4f37-b7dc-96f368d0d155 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.147278 May 10 21:39:51.539386 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2722/3498] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:51 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:51.664831 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-32636c97-7467-433d-8543-34235e27537a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:51.665386 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-32636c97-7467-433d-8543-34235e27537a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:51.671377 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-32636c97-7467-433d-8543-34235e27537a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:51.671829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-32636c97-7467-433d-8543-34235e27537a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:51.672590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-32636c97-7467-433d-8543-34235e27537a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:51.673024 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-32636c97-7467-433d-8543-34235e27537a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:51.800342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-32636c97-7467-433d-8543-34235e27537a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:51.808507 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-32636c97-7467-433d-8543-34235e27537a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.148695 May 10 21:39:51.809078 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2723/3499] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:51 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:52.557201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f854d828-1518-4a26-88b8-5bd0d44f73b4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:52.557814 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f854d828-1518-4a26-88b8-5bd0d44f73b4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:52.564172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f854d828-1518-4a26-88b8-5bd0d44f73b4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:52.564625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f854d828-1518-4a26-88b8-5bd0d44f73b4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:52.565390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f854d828-1518-4a26-88b8-5bd0d44f73b4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:52.565828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f854d828-1518-4a26-88b8-5bd0d44f73b4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:52.697418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f854d828-1518-4a26-88b8-5bd0d44f73b4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:52.705125 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f854d828-1518-4a26-88b8-5bd0d44f73b4 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.152765 May 10 21:39:52.705692 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2724/3500] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:52 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:52.825233 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-feeeceb1-a181-4381-a182-86a9d1b546a2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:52.825762 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-feeeceb1-a181-4381-a182-86a9d1b546a2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:52.831621 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-feeeceb1-a181-4381-a182-86a9d1b546a2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:52.832066 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-feeeceb1-a181-4381-a182-86a9d1b546a2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:52.832819 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-feeeceb1-a181-4381-a182-86a9d1b546a2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:52.833253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-feeeceb1-a181-4381-a182-86a9d1b546a2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:52.960780 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-feeeceb1-a181-4381-a182-86a9d1b546a2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:52.968768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-feeeceb1-a181-4381-a182-86a9d1b546a2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.147346 May 10 21:39:52.969328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2725/3501] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:52 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:53.722993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fc3d47c8-d4ce-401f-9b43-9c6e17ec8bdc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:53.723678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fc3d47c8-d4ce-401f-9b43-9c6e17ec8bdc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:53.730197 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fc3d47c8-d4ce-401f-9b43-9c6e17ec8bdc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:53.730650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fc3d47c8-d4ce-401f-9b43-9c6e17ec8bdc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:53.731443 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fc3d47c8-d4ce-401f-9b43-9c6e17ec8bdc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:53.731889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fc3d47c8-d4ce-401f-9b43-9c6e17ec8bdc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:53.861487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fc3d47c8-d4ce-401f-9b43-9c6e17ec8bdc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:53.869705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fc3d47c8-d4ce-401f-9b43-9c6e17ec8bdc tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.150571 May 10 21:39:53.870273 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2726/3502] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:53 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:53.985544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9655417d-27e0-477b-9ccf-3dedf553f674 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:53.986153 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9655417d-27e0-477b-9ccf-3dedf553f674 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:53.992802 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9655417d-27e0-477b-9ccf-3dedf553f674 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:53.993246 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9655417d-27e0-477b-9ccf-3dedf553f674 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:53.994003 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9655417d-27e0-477b-9ccf-3dedf553f674 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:53.994439 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9655417d-27e0-477b-9ccf-3dedf553f674 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:54.123848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9655417d-27e0-477b-9ccf-3dedf553f674 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:54.131715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9655417d-27e0-477b-9ccf-3dedf553f674 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.149890 May 10 21:39:54.132284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2727/3503] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:53 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:54.886571 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cee78163-de17-4b78-aceb-2f9e2180b55e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:54.887257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cee78163-de17-4b78-aceb-2f9e2180b55e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:54.893501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cee78163-de17-4b78-aceb-2f9e2180b55e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:54.893955 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cee78163-de17-4b78-aceb-2f9e2180b55e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:54.894722 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cee78163-de17-4b78-aceb-2f9e2180b55e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:54.895186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cee78163-de17-4b78-aceb-2f9e2180b55e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:55.026499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cee78163-de17-4b78-aceb-2f9e2180b55e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:55.034310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cee78163-de17-4b78-aceb-2f9e2180b55e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.151693 May 10 21:39:55.038352 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2728/3504] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:54 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:55.148316 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8c4a04d1-16ad-4980-b334-4c9d866db86a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:55.148855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8c4a04d1-16ad-4980-b334-4c9d866db86a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:55.154786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c4a04d1-16ad-4980-b334-4c9d866db86a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:55.155277 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c4a04d1-16ad-4980-b334-4c9d866db86a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:55.156033 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c4a04d1-16ad-4980-b334-4c9d866db86a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:55.156472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c4a04d1-16ad-4980-b334-4c9d866db86a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:55.281940 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8c4a04d1-16ad-4980-b334-4c9d866db86a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:55.290400 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8c4a04d1-16ad-4980-b334-4c9d866db86a tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.146224 May 10 21:39:55.290965 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2729/3505] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:55 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:56.051326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f6343589-45a2-4987-a730-aabdfd3f2431 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:56.051984 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f6343589-45a2-4987-a730-aabdfd3f2431 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:56.059066 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6343589-45a2-4987-a730-aabdfd3f2431 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:56.059557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6343589-45a2-4987-a730-aabdfd3f2431 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:56.060362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6343589-45a2-4987-a730-aabdfd3f2431 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:56.060797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f6343589-45a2-4987-a730-aabdfd3f2431 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:56.187991 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-f6343589-45a2-4987-a730-aabdfd3f2431 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:56.196797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f6343589-45a2-4987-a730-aabdfd3f2431 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.149444 May 10 21:39:56.197476 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2730/3506] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:56 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:56.308261 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6530fcaf-9716-45e9-9b3c-1705d638e5d1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:56.308790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6530fcaf-9716-45e9-9b3c-1705d638e5d1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:56.314526 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6530fcaf-9716-45e9-9b3c-1705d638e5d1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:56.315022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6530fcaf-9716-45e9-9b3c-1705d638e5d1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:56.315813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6530fcaf-9716-45e9-9b3c-1705d638e5d1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:56.316255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6530fcaf-9716-45e9-9b3c-1705d638e5d1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:56.450036 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6530fcaf-9716-45e9-9b3c-1705d638e5d1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:56.457740 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6530fcaf-9716-45e9-9b3c-1705d638e5d1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.153395 May 10 21:39:56.458327 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2731/3507] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:56 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:57.214086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cbf284c3-56fd-4c06-bd82-c42c35080398 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:57.214737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cbf284c3-56fd-4c06-bd82-c42c35080398 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:57.221243 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbf284c3-56fd-4c06-bd82-c42c35080398 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:57.221689 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbf284c3-56fd-4c06-bd82-c42c35080398 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:57.222445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbf284c3-56fd-4c06-bd82-c42c35080398 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:57.222881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbf284c3-56fd-4c06-bd82-c42c35080398 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:57.349734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cbf284c3-56fd-4c06-bd82-c42c35080398 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:57.358411 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cbf284c3-56fd-4c06-bd82-c42c35080398 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.148146 May 10 21:39:57.358979 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2732/3508] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:57 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:57.475853 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5756b6be-4f8a-4336-adb3-09deefb8b147 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:57.476451 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5756b6be-4f8a-4336-adb3-09deefb8b147 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:57.482568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5756b6be-4f8a-4336-adb3-09deefb8b147 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:57.483015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5756b6be-4f8a-4336-adb3-09deefb8b147 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:57.483796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5756b6be-4f8a-4336-adb3-09deefb8b147 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:57.484230 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5756b6be-4f8a-4336-adb3-09deefb8b147 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:57.620097 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5756b6be-4f8a-4336-adb3-09deefb8b147 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:57.627884 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5756b6be-4f8a-4336-adb3-09deefb8b147 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.156246 May 10 21:39:57.628447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2733/3509] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:57 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:58.376341 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-44558b64-2127-47b6-8e5b-a03a4e70c0d1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:58.377030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-44558b64-2127-47b6-8e5b-a03a4e70c0d1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:58.384139 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44558b64-2127-47b6-8e5b-a03a4e70c0d1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:58.384599 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44558b64-2127-47b6-8e5b-a03a4e70c0d1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:58.385371 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44558b64-2127-47b6-8e5b-a03a4e70c0d1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:58.385817 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44558b64-2127-47b6-8e5b-a03a4e70c0d1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:58.523824 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-44558b64-2127-47b6-8e5b-a03a4e70c0d1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:58.531557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-44558b64-2127-47b6-8e5b-a03a4e70c0d1 tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.159088 May 10 21:39:58.532120 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2734/3510] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:58 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:39:58.644272 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1d2efddc-601d-4420-b47f-2ffa51c91723 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:58.644822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1d2efddc-601d-4420-b47f-2ffa51c91723 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:58.650828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d2efddc-601d-4420-b47f-2ffa51c91723 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:58.651312 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d2efddc-601d-4420-b47f-2ffa51c91723 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:58.652071 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d2efddc-601d-4420-b47f-2ffa51c91723 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:58.652500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d2efddc-601d-4420-b47f-2ffa51c91723 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:58.777748 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1d2efddc-601d-4420-b47f-2ffa51c91723 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:39:58.785595 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1d2efddc-601d-4420-b47f-2ffa51c91723 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.145178 May 10 21:39:58.786164 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2735/3511] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:58 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:39:58.997561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-14cafce5-fec5-440e-9af5-03fc2651f229 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:58.998143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-14cafce5-fec5-440e-9af5-03fc2651f229 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:59.004111 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-14cafce5-fec5-440e-9af5-03fc2651f229 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:59.004709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-14cafce5-fec5-440e-9af5-03fc2651f229 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:59.005492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-14cafce5-fec5-440e-9af5-03fc2651f229 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:59.005983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-14cafce5-fec5-440e-9af5-03fc2651f229 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:59.021193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-14cafce5-fec5-440e-9af5-03fc2651f229 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] HTTP exception thrown: Instance 688d836a-358b-4815-80e9-f43bd14f5f93 could not be found. May 10 21:39:59.024806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-14cafce5-fec5-440e-9af5-03fc2651f229 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Request method failure captured: May 10 21:39:59.024806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: DELETE /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 HTTP/1.1 May 10 21:39:59.024806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:39:59.024806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:39:59.024806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:39:59.024806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:39:59.024806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:39:59.024806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:39:59.024806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:39:59.024806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:39:59.024806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietR6Tl7QjLjKc4K1w0HGnHSaNRifu7i3MbGIwqZy-dRdsyX74b1HlxBr6BhyH3N55C0ul38iQpgHnWUEPkBG33RWMl0Yfjq6w9eHCTAp1EAs3VP7Z5vTy5x9NKqEp_4zr-iAY7V6vP-IrpJ2RHTopJm4F8nn7ELXpb1P8bWhFTtKxW4 May 10 21:39:59.024806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:39:59.024806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:39:59.024806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:39:59.024806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:39:59.024806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Openstack-Nova-Api-Version: 2.20 May 10 21:39:59.024806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:39:59.024806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:39:59.024806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 8df9bf1cf45743dc8206cab528d583a1 May 10 21:39:59.024806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1498611481 May 10 21:39:59.024806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:39:59.024806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:39:59.026737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8df9bf1cf45743dc8206cab528d583a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8df9bf1cf45743dc8206cab528d583a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8df9bf1cf45743dc8206cab528d583a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8df9bf1cf45743dc8206cab528d583a1", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:39:59.026737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1498611481 May 10 21:39:59.026737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 8df9bf1cf45743dc8206cab528d583a1 May 10 21:39:59.026737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1498611481 May 10 21:39:59.026737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-AttachVolumeShelveTestJSON-1498611481-project May 10 21:39:59.026737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:39:59.026737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:39:59.026737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: da06520884ff4677af84f9e7356818ef May 10 21:39:59.026737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1498611481-project May 10 21:39:59.026737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:39:59.026737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance 688d836a-358b-4815-80e9-f43bd14f5f93 could not be found. May 10 21:39:59.026737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': '688d836a-358b-4815-80e9-f43bd14f5f93'} May 10 21:39:59.027665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:39:59.027665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:39:59.027665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:39:59.027665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:39:59.027665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:39:59.027665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:39:59.027665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:39:59.027665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:39:59.027665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:39:59.027665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:39:59.027665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 688d836a-358b-4815-80e9-f43bd14f5f93 could not be found. May 10 21:39:59.027665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:39:59.027665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:39:59.027665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:39:59.027665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:39:59.027665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:39:59.027665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:39:59.027665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:39:59.027665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:39:59.027665 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:39:59.029210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:39:59.029210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 21:39:59.029210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 21:39:59.029210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 21:39:59.029210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 21:39:59.029210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:39:59.029210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:39:59.029210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:39:59.029210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:39:59.029210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 688d836a-358b-4815-80e9-f43bd14f5f93 could not be found. May 10 21:39:59.029210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:39:59.029210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:39:59.029210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:39:59.029210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:39:59.029210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:39:59.029210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:39:59.029210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:39:59.029210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:39:59.029210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 688d836a-358b-4815-80e9-f43bd14f5f93 could not be found. May 10 21:39:59.029210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:39:59.030969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-14cafce5-fec5-440e-9af5-03fc2651f229 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Returning 404 to user: Instance 688d836a-358b-4815-80e9-f43bd14f5f93 could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:39:59.030969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-14cafce5-fec5-440e-9af5-03fc2651f229 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "DELETE /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 404 len: 111 microversion: 2.20 time: 0.031526 May 10 21:39:59.030969 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2736/3512] 10.222.0.49 () {60 vars in 1279 bytes} [Tue May 10 21:39:58 2022] DELETE /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 10 21:39:59.034031 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-646d526c-b7b3-4e19-b6ba-a6f0cef25923 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:59.034704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-646d526c-b7b3-4e19-b6ba-a6f0cef25923 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] [instance: 688d836a-358b-4815-80e9-f43bd14f5f93] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:59.041480 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-646d526c-b7b3-4e19-b6ba-a6f0cef25923 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:59.041939 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-646d526c-b7b3-4e19-b6ba-a6f0cef25923 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:59.042717 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-646d526c-b7b3-4e19-b6ba-a6f0cef25923 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:59.043175 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-646d526c-b7b3-4e19-b6ba-a6f0cef25923 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:59.057051 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-646d526c-b7b3-4e19-b6ba-a6f0cef25923 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] HTTP exception thrown: Instance 688d836a-358b-4815-80e9-f43bd14f5f93 could not be found. May 10 21:39:59.058591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-646d526c-b7b3-4e19-b6ba-a6f0cef25923 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Request method failure captured: May 10 21:39:59.058591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 HTTP/1.1 May 10 21:39:59.058591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:39:59.058591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:39:59.058591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:39:59.058591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:39:59.058591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:39:59.058591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:39:59.058591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:39:59.058591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:39:59.058591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietR6Tl7QjLjKc4K1w0HGnHSaNRifu7i3MbGIwqZy-dRdsyX74b1HlxBr6BhyH3N55C0ul38iQpgHnWUEPkBG33RWMl0Yfjq6w9eHCTAp1EAs3VP7Z5vTy5x9NKqEp_4zr-iAY7V6vP-IrpJ2RHTopJm4F8nn7ELXpb1P8bWhFTtKxW4 May 10 21:39:59.058591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:39:59.058591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:39:59.058591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:39:59.058591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:39:59.058591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Openstack-Nova-Api-Version: 2.20 May 10 21:39:59.058591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:39:59.058591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:39:59.058591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 8df9bf1cf45743dc8206cab528d583a1 May 10 21:39:59.058591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1498611481 May 10 21:39:59.058591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:39:59.058591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:39:59.060422 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8df9bf1cf45743dc8206cab528d583a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8df9bf1cf45743dc8206cab528d583a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8df9bf1cf45743dc8206cab528d583a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8df9bf1cf45743dc8206cab528d583a1", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:39:59.060422 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1498611481 May 10 21:39:59.060422 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 8df9bf1cf45743dc8206cab528d583a1 May 10 21:39:59.060422 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1498611481 May 10 21:39:59.060422 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-AttachVolumeShelveTestJSON-1498611481-project May 10 21:39:59.060422 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:39:59.060422 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:39:59.060422 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: da06520884ff4677af84f9e7356818ef May 10 21:39:59.060422 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1498611481-project May 10 21:39:59.060422 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:39:59.060422 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance 688d836a-358b-4815-80e9-f43bd14f5f93 could not be found. May 10 21:39:59.060422 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': '688d836a-358b-4815-80e9-f43bd14f5f93'} May 10 21:39:59.061572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:39:59.061572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:39:59.061572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:39:59.061572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:39:59.061572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:39:59.061572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:39:59.061572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:39:59.061572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:39:59.061572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:39:59.061572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:39:59.061572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 688d836a-358b-4815-80e9-f43bd14f5f93 could not be found. May 10 21:39:59.061572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:39:59.061572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:39:59.061572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:39:59.061572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:39:59.061572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:39:59.061572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:39:59.061572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:39:59.061572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:39:59.061572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:39:59.063203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:39:59.063203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:39:59.063203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:39:59.063203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:39:59.063203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:39:59.063203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:39:59.063203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:39:59.063203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 688d836a-358b-4815-80e9-f43bd14f5f93 could not be found. May 10 21:39:59.063203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:39:59.063203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:39:59.063203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:39:59.063203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:39:59.063203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:39:59.063203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:39:59.063203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:39:59.063203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:39:59.063203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 688d836a-358b-4815-80e9-f43bd14f5f93 could not be found. May 10 21:39:59.063203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:39:59.064660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-646d526c-b7b3-4e19-b6ba-a6f0cef25923 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] Returning 404 to user: Instance 688d836a-358b-4815-80e9-f43bd14f5f93 could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:39:59.064660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-646d526c-b7b3-4e19-b6ba-a6f0cef25923 tempest-AttachVolumeShelveTestJSON-1498611481 tempest-AttachVolumeShelveTestJSON-1498611481-project] 10.222.0.49 "GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93" status: 404 len: 111 microversion: 2.20 time: 0.030037 May 10 21:39:59.064660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2737/3513] 10.222.0.49 () {60 vars in 1276 bytes} [Tue May 10 21:39:59 2022] GET /compute/v2.1/servers/688d836a-358b-4815-80e9-f43bd14f5f93 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 21:39:59.549433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c357a0e7-de8a-44cb-bb91-f84b5cd9df4e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:39:59.550109 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c357a0e7-de8a-44cb-bb91-f84b5cd9df4e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] [instance: 9f2d5e2c-92d8-49db-a14b-34dab8c145e4] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:39:59.556484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c357a0e7-de8a-44cb-bb91-f84b5cd9df4e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:59.556931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c357a0e7-de8a-44cb-bb91-f84b5cd9df4e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:39:59.557689 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c357a0e7-de8a-44cb-bb91-f84b5cd9df4e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:39:59.558122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c357a0e7-de8a-44cb-bb91-f84b5cd9df4e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:40:00.038998 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c357a0e7-de8a-44cb-bb91-f84b5cd9df4e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '842fa4b1c86e4c208ab1f1f119d3bdd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51f628be6144a698276671df56eac18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:40:00.046929 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c357a0e7-de8a-44cb-bb91-f84b5cd9df4e tempest-VolumesSnapshotTestJSON-447231634 tempest-VolumesSnapshotTestJSON-447231634-project] 10.222.0.49 "GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4" status: 200 len: 1561 microversion: 2.1 time: 0.501408 May 10 21:40:00.047534 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2738/3514] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:39:59 2022] GET /compute/v2.1/servers/9f2d5e2c-92d8-49db-a14b-34dab8c145e4 => generated 1561 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:40:00.052308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-21b9af46-a628-4a19-b8da-d43e20a62bf2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:40:00.052608 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-21b9af46-a628-4a19-b8da-d43e20a62bf2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cf6fc652-5ef0-417d-af13-69c7c058d50e] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:40:00.067186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21b9af46-a628-4a19-b8da-d43e20a62bf2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:40:00.067186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21b9af46-a628-4a19-b8da-d43e20a62bf2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:40:00.067186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21b9af46-a628-4a19-b8da-d43e20a62bf2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:40:00.067186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-21b9af46-a628-4a19-b8da-d43e20a62bf2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:40:00.271062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-21b9af46-a628-4a19-b8da-d43e20a62bf2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:40:00.279976 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-21b9af46-a628-4a19-b8da-d43e20a62bf2 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e" status: 200 len: 1735 microversion: 2.1 time: 0.231495 May 10 21:40:00.280544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2739/3515] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:40:00 2022] GET /compute/v2.1/servers/cf6fc652-5ef0-417d-af13-69c7c058d50e => generated 1735 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:40:00.295524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d578c5de-5800-4920-ac75-abd965c43fcf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '.version_select at 0x7f85d54a5ca0>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:40:00.387666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d578c5de-5800-4920-ac75-abd965c43fcf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-424622357" status: 202 len: 0 microversion: 2.1 time: 0.095676 May 10 21:40:00.388331 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2740/3516] 10.222.0.49 () {58 vars in 1217 bytes} [Tue May 10 21:40:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-424622357 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 21:40:01.513600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-8b7ff44d-92c2-4326-9e7d-b8540bca58d5 req-53c33944-dc2c-4b39-909b-7291c59c3ef4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf6fc652-5ef0-417d-af13-69c7c058d50e", "tag": "ced08b04-cda9-4a73-82de-1764e13bc529"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:40:01.526244 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-8b7ff44d-92c2-4326-9e7d-b8540bca58d5 req-53c33944-dc2c-4b39-909b-7291c59c3ef4 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:40:01.526963 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-8b7ff44d-92c2-4326-9e7d-b8540bca58d5 req-53c33944-dc2c-4b39-909b-7291c59c3ef4 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:40:01.538703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-8b7ff44d-92c2-4326-9e7d-b8540bca58d5 req-53c33944-dc2c-4b39-909b-7291c59c3ef4 service nova] Creating event network-changed:ced08b04-cda9-4a73-82de-1764e13bc529 for instance cf6fc652-5ef0-417d-af13-69c7c058d50e on hv-cinder-82880 May 10 21:40:01.545055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-8b7ff44d-92c2-4326-9e7d-b8540bca58d5 req-53c33944-dc2c-4b39-909b-7291c59c3ef4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098357 May 10 21:40:01.546841 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2741/3517] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:40:46.685668 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:40:46.686308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Tue May 10 21:40:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 21:41:41.830758 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-80b242a7-bdf3-46de-b431-a98331d99dab tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:41:41.831447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-80b242a7-bdf3-46de-b431-a98331d99dab tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:41:41.837563 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-80b242a7-bdf3-46de-b431-a98331d99dab tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:41:41.838013 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-80b242a7-bdf3-46de-b431-a98331d99dab tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:41:41.838980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-80b242a7-bdf3-46de-b431-a98331d99dab tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:41:41.839755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-80b242a7-bdf3-46de-b431-a98331d99dab tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:41:41.854293 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-80b242a7-bdf3-46de-b431-a98331d99dab tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] HTTP exception thrown: Instance 504464a5-03e5-42af-a2f3-ca210277d932 could not be found. May 10 21:41:41.855988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-80b242a7-bdf3-46de-b431-a98331d99dab tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Request method failure captured: May 10 21:41:41.855988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: DELETE /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 HTTP/1.1 May 10 21:41:41.855988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:41:41.855988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:41:41.855988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:41:41.855988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:41:41.855988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:41:41.855988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:41:41.855988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:41:41.855988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:41:41.855988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietSAJMT-hnL6qBkRs7bZ3-110HT4ymfZj92vRoBUEAGHIeo_ldK2Vr4zsDgcllgzjIBDSyio1stjSGyxN0jeNBxfaE1kSHTlyNAeVLUtctiC1v8O3DwT8su8M8miZ3QqxTaNbg2K8kPDMc7k5ZJZ4ZhBF8q-vP6lWzvhhrcux6GAj2A May 10 21:41:41.855988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:41:41.855988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:41:41.855988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:41:41.855988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:41:41.855988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:41:41.855988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:41:41.855988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: bd946455713e4c36a8efadbce486ee8b May 10 21:41:41.855988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-AttachVolumeTestJSON-824855839 May 10 21:41:41.855988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:41:41.855988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:41:41.857751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd946455713e4c36a8efadbce486ee8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bd946455713e4c36a8efadbce486ee8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd946455713e4c36a8efadbce486ee8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bd946455713e4c36a8efadbce486ee8b", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:41:41.857751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-AttachVolumeTestJSON-824855839 May 10 21:41:41.857751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: bd946455713e4c36a8efadbce486ee8b May 10 21:41:41.857751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-AttachVolumeTestJSON-824855839 May 10 21:41:41.857751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-AttachVolumeTestJSON-824855839-project May 10 21:41:41.857751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:41:41.857751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:41:41.857751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: dc411f6a0a024e7eac561ad1b6d2a944 May 10 21:41:41.857751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-AttachVolumeTestJSON-824855839-project May 10 21:41:41.857751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:41:41.857751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance 504464a5-03e5-42af-a2f3-ca210277d932 could not be found. May 10 21:41:41.857751 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': '504464a5-03e5-42af-a2f3-ca210277d932'} May 10 21:41:41.858715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:41:41.858715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:41:41.858715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:41:41.858715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:41:41.858715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:41:41.858715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:41:41.858715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:41:41.858715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:41:41.858715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:41:41.858715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:41:41.858715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 504464a5-03e5-42af-a2f3-ca210277d932 could not be found. May 10 21:41:41.858715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:41:41.858715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:41:41.858715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:41:41.858715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:41:41.858715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:41:41.858715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:41:41.858715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:41:41.858715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:41:41.858715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:41:41.860343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:41:41.860343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 21:41:41.860343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 21:41:41.860343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 21:41:41.860343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 21:41:41.860343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:41:41.860343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:41:41.860343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:41:41.860343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:41:41.860343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 504464a5-03e5-42af-a2f3-ca210277d932 could not be found. May 10 21:41:41.860343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:41:41.860343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:41:41.860343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:41:41.860343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:41:41.860343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:41:41.860343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:41:41.860343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:41:41.860343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:41:41.860343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 504464a5-03e5-42af-a2f3-ca210277d932 could not be found. May 10 21:41:41.860343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:41:41.861870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-80b242a7-bdf3-46de-b431-a98331d99dab tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Returning 404 to user: Instance 504464a5-03e5-42af-a2f3-ca210277d932 could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:41:41.861870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-80b242a7-bdf3-46de-b431-a98331d99dab tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "DELETE /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 404 len: 111 microversion: 2.1 time: 0.032787 May 10 21:41:41.861870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2742/3518] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 21:41:41 2022] DELETE /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 21:41:41.866253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-517e0ca6-d91d-4bad-8029-076cac97fbbe tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:41:41.866860 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-517e0ca6-d91d-4bad-8029-076cac97fbbe tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] [instance: 504464a5-03e5-42af-a2f3-ca210277d932] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:41:41.872656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-517e0ca6-d91d-4bad-8029-076cac97fbbe tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:41:41.873172 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-517e0ca6-d91d-4bad-8029-076cac97fbbe tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:41:41.873868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-517e0ca6-d91d-4bad-8029-076cac97fbbe tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:41:41.874301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-517e0ca6-d91d-4bad-8029-076cac97fbbe tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:41:41.887544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-517e0ca6-d91d-4bad-8029-076cac97fbbe tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] HTTP exception thrown: Instance 504464a5-03e5-42af-a2f3-ca210277d932 could not be found. May 10 21:41:41.889062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-517e0ca6-d91d-4bad-8029-076cac97fbbe tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Request method failure captured: May 10 21:41:41.889062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 HTTP/1.1 May 10 21:41:41.889062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:41:41.889062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:41:41.889062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:41:41.889062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:41:41.889062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:41:41.889062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:41:41.889062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:41:41.889062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:41:41.889062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietSAJMT-hnL6qBkRs7bZ3-110HT4ymfZj92vRoBUEAGHIeo_ldK2Vr4zsDgcllgzjIBDSyio1stjSGyxN0jeNBxfaE1kSHTlyNAeVLUtctiC1v8O3DwT8su8M8miZ3QqxTaNbg2K8kPDMc7k5ZJZ4ZhBF8q-vP6lWzvhhrcux6GAj2A May 10 21:41:41.889062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:41:41.889062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:41:41.889062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:41:41.889062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:41:41.889062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:41:41.889062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:41:41.889062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: bd946455713e4c36a8efadbce486ee8b May 10 21:41:41.889062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-AttachVolumeTestJSON-824855839 May 10 21:41:41.889062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:41:41.889062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:41:41.890838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd946455713e4c36a8efadbce486ee8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bd946455713e4c36a8efadbce486ee8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd946455713e4c36a8efadbce486ee8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bd946455713e4c36a8efadbce486ee8b", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:41:41.890838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-AttachVolumeTestJSON-824855839 May 10 21:41:41.890838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: bd946455713e4c36a8efadbce486ee8b May 10 21:41:41.890838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-AttachVolumeTestJSON-824855839 May 10 21:41:41.890838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-AttachVolumeTestJSON-824855839-project May 10 21:41:41.890838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:41:41.890838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:41:41.890838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: dc411f6a0a024e7eac561ad1b6d2a944 May 10 21:41:41.890838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-AttachVolumeTestJSON-824855839-project May 10 21:41:41.890838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:41:41.890838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance 504464a5-03e5-42af-a2f3-ca210277d932 could not be found. May 10 21:41:41.890838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': '504464a5-03e5-42af-a2f3-ca210277d932'} May 10 21:41:41.892339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:41:41.892339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:41:41.892339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:41:41.892339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:41:41.892339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:41:41.892339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:41:41.892339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:41:41.892339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:41:41.892339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:41:41.892339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:41:41.892339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 504464a5-03e5-42af-a2f3-ca210277d932 could not be found. May 10 21:41:41.892339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:41:41.892339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:41:41.892339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:41:41.892339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:41:41.892339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:41:41.892339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:41:41.892339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:41:41.892339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:41:41.892339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:41:41.893810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:41:41.893810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:41:41.893810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:41:41.893810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:41:41.893810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:41:41.893810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:41:41.893810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:41:41.893810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 504464a5-03e5-42af-a2f3-ca210277d932 could not be found. May 10 21:41:41.893810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:41:41.893810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:41:41.893810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:41:41.893810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:41:41.893810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:41:41.893810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:41:41.893810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:41:41.893810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:41:41.893810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 504464a5-03e5-42af-a2f3-ca210277d932 could not be found. May 10 21:41:41.893810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:41:41.896019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-517e0ca6-d91d-4bad-8029-076cac97fbbe tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] Returning 404 to user: Instance 504464a5-03e5-42af-a2f3-ca210277d932 could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:41:41.896019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-517e0ca6-d91d-4bad-8029-076cac97fbbe tempest-AttachVolumeTestJSON-824855839 tempest-AttachVolumeTestJSON-824855839-project] 10.222.0.49 "GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932" status: 404 len: 111 microversion: 2.1 time: 0.028387 May 10 21:41:41.896019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2743/3519] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:41:41 2022] GET /compute/v2.1/servers/504464a5-03e5-42af-a2f3-ca210277d932 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 21:42:44.297487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:42:44.298282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Tue May 10 21:42:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 21:42:45.667547 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:42:45.668170 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Tue May 10 21:42:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 21:43:53.975504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f431faa7-8846-4169-8fce-ab83b39ea89d] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 10 21:43:53.980603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-25b3e0b2-e9e7-4c48-a258-317d3347494d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0d6e659-f5ab-4c55-b493-eb5d84358787"}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:43:53.981888 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-25b3e0b2-e9e7-4c48-a258-317d3347494d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4674fb54-efa1-4bed-a2a2-49f3b1184874] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:43:53.989840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-25b3e0b2-e9e7-4c48-a258-317d3347494d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:43:53.990308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-25b3e0b2-e9e7-4c48-a258-317d3347494d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:43:53.991108 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-25b3e0b2-e9e7-4c48-a258-317d3347494d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:43:53.991637 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-25b3e0b2-e9e7-4c48-a258-317d3347494d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:43:54.983305 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO oslo.messaging._drivers.impl_rabbit [-] [f431faa7-8846-4169-8fce-ab83b39ea89d] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 48748. May 10 21:43:55.571999 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-25b3e0b2-e9e7-4c48-a258-317d3347494d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "POST /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.598587 May 10 21:43:55.572753 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2744/3520] 10.222.0.49 () {60 vars in 1322 bytes} [Tue May 10 21:43:53 2022] POST /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874/os-volume_attachments => generated 194 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:43:58.577285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-63aa3329-039e-4d60-9e57-16f3c8cdfa7e req-9fd6bedd-453f-4d93-8c36-3174b8e6b79b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf6fc652-5ef0-417d-af13-69c7c058d50e", "name": "network-vif-deleted", "tag": "ced08b04-cda9-4a73-82de-1764e13bc529"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:43:58.589341 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-63aa3329-039e-4d60-9e57-16f3c8cdfa7e req-9fd6bedd-453f-4d93-8c36-3174b8e6b79b service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:43:58.589783 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-63aa3329-039e-4d60-9e57-16f3c8cdfa7e req-9fd6bedd-453f-4d93-8c36-3174b8e6b79b service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:43:58.609236 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-63aa3329-039e-4d60-9e57-16f3c8cdfa7e req-9fd6bedd-453f-4d93-8c36-3174b8e6b79b service nova] Creating event network-vif-deleted:ced08b04-cda9-4a73-82de-1764e13bc529 for instance cf6fc652-5ef0-417d-af13-69c7c058d50e on hv-cinder-82880 May 10 21:43:58.610838 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-63aa3329-039e-4d60-9e57-16f3c8cdfa7e req-9fd6bedd-453f-4d93-8c36-3174b8e6b79b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171669 May 10 21:43:58.611603 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2745/3521] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:44:00.626257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-0f9d6712-d5dc-4f5d-9c77-b385a9810d51 req-fac4f113-875d-483a-a170-a922cff66924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f2d5e2c-92d8-49db-a14b-34dab8c145e4", "name": "network-vif-deleted", "tag": "e59377c8-2364-4bda-918e-6ec687c8b495"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:44:00.634929 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-0f9d6712-d5dc-4f5d-9c77-b385a9810d51 req-fac4f113-875d-483a-a170-a922cff66924 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:00.635404 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-0f9d6712-d5dc-4f5d-9c77-b385a9810d51 req-fac4f113-875d-483a-a170-a922cff66924 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:00.647818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-0f9d6712-d5dc-4f5d-9c77-b385a9810d51 req-fac4f113-875d-483a-a170-a922cff66924 service nova] Creating event network-vif-deleted:e59377c8-2364-4bda-918e-6ec687c8b495 for instance 9f2d5e2c-92d8-49db-a14b-34dab8c145e4 on hv-cinder-82880 May 10 21:44:00.652823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-0f9d6712-d5dc-4f5d-9c77-b385a9810d51 req-fac4f113-875d-483a-a170-a922cff66924 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030743 May 10 21:44:00.653414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2746/3522] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:44:06.378078 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1486099f-76eb-44ee-ad9e-dbad73fe7d3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0d6e659-f5ab-4c55-b493-eb5d84358787"}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:44:06.379266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1486099f-76eb-44ee-ad9e-dbad73fe7d3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4674fb54-efa1-4bed-a2a2-49f3b1184874] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:44:06.386129 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1486099f-76eb-44ee-ad9e-dbad73fe7d3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:06.386582 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1486099f-76eb-44ee-ad9e-dbad73fe7d3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:06.387388 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1486099f-76eb-44ee-ad9e-dbad73fe7d3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:06.387832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1486099f-76eb-44ee-ad9e-dbad73fe7d3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:06.464792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-1486099f-76eb-44ee-ad9e-dbad73fe7d3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] HTTP exception thrown: Invalid volume: volume c0d6e659-f5ab-4c55-b493-eb5d84358787 is already attached to instances: 4674fb54-efa1-4bed-a2a2-49f3b1184874 May 10 21:44:06.466535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1486099f-76eb-44ee-ad9e-dbad73fe7d3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Request method failure captured: May 10 21:44:06.466535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: POST /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874/os-volume_attachments HTTP/1.1 May 10 21:44:06.466535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:44:06.466535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:44:06.466535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:44:06.466535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 74 May 10 21:44:06.466535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:44:06.466535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:44:06.466535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:44:06.466535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:44:06.466535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietSE5zX3cUzqYcL4439JiFsqE4YiilwKjmw-zwJrvzsKCKk2V0t2rgnfCfWB9fMDqHcwDYx66Osidv5Nb3ivvjsId3P0K5BlinPK-pYoxdKcKRbo0A46AEZFFXEAkT7Vt_ZFHlOxIkEow-5P_dpFvNFYY0aq5XGlXkN1VnlT95XyJvw May 10 21:44:06.466535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:44:06.466535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:44:06.466535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:44:06.466535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:44:06.466535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:44:06.466535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:44:06.466535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 9582743483fa4fb88f4e91d3f787c945 May 10 21:44:06.466535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-AttachVolumeNegativeTest-297208105 May 10 21:44:06.466535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:44:06.466535 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:44:06.468408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9582743483fa4fb88f4e91d3f787c945", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:44:06.468408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-AttachVolumeNegativeTest-297208105 May 10 21:44:06.468408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 9582743483fa4fb88f4e91d3f787c945 May 10 21:44:06.468408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-297208105 May 10 21:44:06.468408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-AttachVolumeNegativeTest-297208105-project May 10 21:44:06.468408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:44:06.468408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:44:06.468408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 62bc5605a22d408f9b4bac69a0f5f486 May 10 21:44:06.468408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-AttachVolumeNegativeTest-297208105-project May 10 21:44:06.468408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: May 10 21:44:06.468408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {"volumeAttachment": {"volumeId": "c0d6e659-f5ab-4c55-b493-eb5d84358787"}} May 10 21:44:06.468408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:44:06.469691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Invalid volume: volume c0d6e659-f5ab-4c55-b493-eb5d84358787 is already attached to instances: 4674fb54-efa1-4bed-a2a2-49f3b1184874 May 10 21:44:06.469691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'server_id': '4674fb54-efa1-4bed-a2a2-49f3b1184874', 'body': {'volumeAttachment': {'volumeId': 'c0d6e659-f5ab-4c55-b493-eb5d84358787'}}} May 10 21:44:06.469691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:44:06.469691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:44:06.469691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 21:44:06.469691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 21:44:06.469691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 21:44:06.469691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 21:44:06.469691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 21:44:06.469691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 21:44:06.469691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 10 21:44:06.469691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 10 21:44:06.469691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 10 21:44:06.469691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 10 21:44:06.469691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c0d6e659-f5ab-4c55-b493-eb5d84358787 is already attached to instances: 4674fb54-efa1-4bed-a2a2-49f3b1184874 May 10 21:44:06.469691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:44:06.469691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:44:06.469691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:44:06.469691 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:44:06.471362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:44:06.471362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:44:06.471362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:44:06.471362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:44:06.471362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:44:06.471362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:44:06.471362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 21:44:06.471362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 21:44:06.471362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 21:44:06.471362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 21:44:06.471362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 21:44:06.471362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 21:44:06.471362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 10 21:44:06.471362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 21:44:06.471362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c0d6e659-f5ab-4c55-b493-eb5d84358787 is already attached to instances: 4674fb54-efa1-4bed-a2a2-49f3b1184874 May 10 21:44:06.471362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:44:06.471362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:44:06.471362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:44:06.471362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:44:06.471362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:44:06.473133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:44:06.473133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:44:06.473133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:44:06.473133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c0d6e659-f5ab-4c55-b493-eb5d84358787 is already attached to instances: 4674fb54-efa1-4bed-a2a2-49f3b1184874 May 10 21:44:06.473133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:44:06.473133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1486099f-76eb-44ee-ad9e-dbad73fe7d3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Returning 400 to user: Invalid volume: volume c0d6e659-f5ab-4c55-b493-eb5d84358787 is already attached to instances: 4674fb54-efa1-4bed-a2a2-49f3b1184874 {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:44:06.473133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1486099f-76eb-44ee-ad9e-dbad73fe7d3b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "POST /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094853 May 10 21:44:06.473133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2747/3523] 10.222.0.49 () {60 vars in 1322 bytes} [Tue May 10 21:44:06 2022] POST /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 10 21:44:06.528273 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9197da5c-81a9-4db0-a829-4ac812ad429f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:44:06.528703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9197da5c-81a9-4db0-a829-4ac812ad429f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4674fb54-efa1-4bed-a2a2-49f3b1184874] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:44:06.534519 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9197da5c-81a9-4db0-a829-4ac812ad429f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:06.534967 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9197da5c-81a9-4db0-a829-4ac812ad429f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:06.535757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9197da5c-81a9-4db0-a829-4ac812ad429f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:06.536190 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9197da5c-81a9-4db0-a829-4ac812ad429f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:06.616332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.objects.instance [None req-9197da5c-81a9-4db0-a829-4ac812ad429f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lazy-loading 'services' on Instance uuid 4674fb54-efa1-4bed-a2a2-49f3b1184874 {{(pid=117714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:44:06.694538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:44:06.694695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Tue May 10 21:44:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874/os-volume_attachments/c0d6e659-f5ab-4c55-b493-eb5d84358787 (ip 10.222.0.49) !!! May 10 21:44:06.795932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9197da5c-81a9-4db0-a829-4ac812ad429f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874/os-volume_attachments/c0d6e659-f5ab-4c55-b493-eb5d84358787" status: 202 len: 0 microversion: 2.1 time: 0.271149 May 10 21:44:06.796446 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2748/3524] 10.222.0.49 () {58 vars in 1415 bytes} [Tue May 10 21:44:06 2022] DELETE /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874/os-volume_attachments/c0d6e659-f5ab-4c55-b493-eb5d84358787 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 21:44:06.805718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-babe31bc-d3a7-4f36-95b3-bf995ee4b8e9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:44:06.806807 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-babe31bc-d3a7-4f36-95b3-bf995ee4b8e9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4674fb54-efa1-4bed-a2a2-49f3b1184874] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:44:06.813101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-babe31bc-d3a7-4f36-95b3-bf995ee4b8e9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:06.813582 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-babe31bc-d3a7-4f36-95b3-bf995ee4b8e9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:06.814355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-babe31bc-d3a7-4f36-95b3-bf995ee4b8e9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:06.814790 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-babe31bc-d3a7-4f36-95b3-bf995ee4b8e9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:06.845281 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-babe31bc-d3a7-4f36-95b3-bf995ee4b8e9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044415 May 10 21:44:06.845839 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2749/3525] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:44:06 2022] GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:44:07.856987 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9303c135-949c-4bf1-9a61-adae9b233f26 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:44:07.857973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9303c135-949c-4bf1-9a61-adae9b233f26 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4674fb54-efa1-4bed-a2a2-49f3b1184874] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:44:07.864283 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9303c135-949c-4bf1-9a61-adae9b233f26 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:07.865225 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9303c135-949c-4bf1-9a61-adae9b233f26 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:07.866009 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9303c135-949c-4bf1-9a61-adae9b233f26 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:07.866448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9303c135-949c-4bf1-9a61-adae9b233f26 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:07.895880 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9303c135-949c-4bf1-9a61-adae9b233f26 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042858 May 10 21:44:07.896448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2750/3526] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:44:07 2022] GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:44:08.908679 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-37cc3f05-bc55-4ddf-ac20-01bb3a766519 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:44:08.909609 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-37cc3f05-bc55-4ddf-ac20-01bb3a766519 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4674fb54-efa1-4bed-a2a2-49f3b1184874] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:44:08.916252 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-37cc3f05-bc55-4ddf-ac20-01bb3a766519 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:08.916737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-37cc3f05-bc55-4ddf-ac20-01bb3a766519 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:08.917503 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-37cc3f05-bc55-4ddf-ac20-01bb3a766519 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:08.917938 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-37cc3f05-bc55-4ddf-ac20-01bb3a766519 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:08.950279 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-37cc3f05-bc55-4ddf-ac20-01bb3a766519 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046232 May 10 21:44:08.951085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2751/3527] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:44:08 2022] GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:44:09.963149 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2dfc10de-01e9-4fae-abd5-f22df536051b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:44:09.963999 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2dfc10de-01e9-4fae-abd5-f22df536051b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4674fb54-efa1-4bed-a2a2-49f3b1184874] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:44:09.970682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2dfc10de-01e9-4fae-abd5-f22df536051b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:09.971145 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2dfc10de-01e9-4fae-abd5-f22df536051b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:09.971928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2dfc10de-01e9-4fae-abd5-f22df536051b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:09.972367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2dfc10de-01e9-4fae-abd5-f22df536051b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:10.003000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2dfc10de-01e9-4fae-abd5-f22df536051b tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044995 May 10 21:44:10.003591 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2752/3528] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:44:09 2022] GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 21:44:10.070522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-171000b4-f4f9-447b-ad92-7a37850e31c1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:44:10.071028 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-171000b4-f4f9-447b-ad92-7a37850e31c1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4674fb54-efa1-4bed-a2a2-49f3b1184874] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:44:10.077173 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-171000b4-f4f9-447b-ad92-7a37850e31c1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:10.077630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-171000b4-f4f9-447b-ad92-7a37850e31c1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:10.078402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-171000b4-f4f9-447b-ad92-7a37850e31c1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:10.078905 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-171000b4-f4f9-447b-ad92-7a37850e31c1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:10.103895 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-171000b4-f4f9-447b-ad92-7a37850e31c1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4674fb54-efa1-4bed-a2a2-49f3b1184874] Going to try to terminate instance {{(pid=117714) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:44:10.395768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-171000b4-f4f9-447b-ad92-7a37850e31c1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874" status: 204 len: 0 microversion: 2.1 time: 0.329491 May 10 21:44:10.396348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2753/3529] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 21:44:10 2022] DELETE /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 21:44:10.404992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-000a3598-4d00-40bb-a35d-87dd9c317508 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:44:10.405692 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-000a3598-4d00-40bb-a35d-87dd9c317508 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4674fb54-efa1-4bed-a2a2-49f3b1184874] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:44:10.411567 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-000a3598-4d00-40bb-a35d-87dd9c317508 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:10.412014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-000a3598-4d00-40bb-a35d-87dd9c317508 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:10.413302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-000a3598-4d00-40bb-a35d-87dd9c317508 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:10.413734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-000a3598-4d00-40bb-a35d-87dd9c317508 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:10.550505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-000a3598-4d00-40bb-a35d-87dd9c317508 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:44:10.557406 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-000a3598-4d00-40bb-a35d-87dd9c317508 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874" status: 200 len: 1682 microversion: 2.1 time: 0.156415 May 10 21:44:10.558265 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2754/3530] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:44:10 2022] GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:44:11.575865 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-64d5b936-d4e0-4144-a20f-02083f5325c1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:44:11.576495 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-64d5b936-d4e0-4144-a20f-02083f5325c1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4674fb54-efa1-4bed-a2a2-49f3b1184874] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:44:11.582915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-64d5b936-d4e0-4144-a20f-02083f5325c1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:11.583409 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-64d5b936-d4e0-4144-a20f-02083f5325c1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:11.584194 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-64d5b936-d4e0-4144-a20f-02083f5325c1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:11.584697 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-64d5b936-d4e0-4144-a20f-02083f5325c1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:11.857502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-64d5b936-d4e0-4144-a20f-02083f5325c1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:44:11.865182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-64d5b936-d4e0-4144-a20f-02083f5325c1 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874" status: 200 len: 1682 microversion: 2.1 time: 0.293365 May 10 21:44:11.865757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2755/3531] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:44:11 2022] GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874 => generated 1682 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:44:12.560777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-c3345efc-d841-408b-a500-fd1dbc6e3886 req-91ad032e-cf15-4458-aedd-8e6c1289d699 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4674fb54-efa1-4bed-a2a2-49f3b1184874", "name": "network-vif-deleted", "tag": "b7123b7e-3e48-4b36-891c-f17108289161"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:44:12.569624 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-c3345efc-d841-408b-a500-fd1dbc6e3886 req-91ad032e-cf15-4458-aedd-8e6c1289d699 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:12.570088 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-c3345efc-d841-408b-a500-fd1dbc6e3886 req-91ad032e-cf15-4458-aedd-8e6c1289d699 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:12.582119 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-c3345efc-d841-408b-a500-fd1dbc6e3886 req-91ad032e-cf15-4458-aedd-8e6c1289d699 service nova] Creating event network-vif-deleted:b7123b7e-3e48-4b36-891c-f17108289161 for instance 4674fb54-efa1-4bed-a2a2-49f3b1184874 on hv-cinder-82880 May 10 21:44:12.588628 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-c3345efc-d841-408b-a500-fd1dbc6e3886 req-91ad032e-cf15-4458-aedd-8e6c1289d699 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031501 May 10 21:44:12.589481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2756/3532] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:44:12.883161 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d65c420e-0cdf-4ca6-bd3a-120936134f60 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:44:12.888017 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d65c420e-0cdf-4ca6-bd3a-120936134f60 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4674fb54-efa1-4bed-a2a2-49f3b1184874] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:44:12.891065 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d65c420e-0cdf-4ca6-bd3a-120936134f60 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:12.891760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d65c420e-0cdf-4ca6-bd3a-120936134f60 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:12.892833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d65c420e-0cdf-4ca6-bd3a-120936134f60 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:12.893479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d65c420e-0cdf-4ca6-bd3a-120936134f60 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:12.928043 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d65c420e-0cdf-4ca6-bd3a-120936134f60 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:12.929396 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d65c420e-0cdf-4ca6-bd3a-120936134f60 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:12.929920 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.objects.instance [None req-d65c420e-0cdf-4ca6-bd3a-120936134f60 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lazy-loading 'fault' on Instance uuid 4674fb54-efa1-4bed-a2a2-49f3b1184874 {{(pid=117714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:44:12.976355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d65c420e-0cdf-4ca6-bd3a-120936134f60 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:44:12.994295 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d65c420e-0cdf-4ca6-bd3a-120936134f60 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874" status: 200 len: 1331 microversion: 2.1 time: 0.115578 May 10 21:44:12.994837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2757/3533] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:44:12 2022] GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874 => generated 1331 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:44:14.012695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d8b00ac7-08eb-4f8f-b626-c875d43939fa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:44:14.013448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d8b00ac7-08eb-4f8f-b626-c875d43939fa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4674fb54-efa1-4bed-a2a2-49f3b1184874] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:44:14.019996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d8b00ac7-08eb-4f8f-b626-c875d43939fa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:14.020369 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d8b00ac7-08eb-4f8f-b626-c875d43939fa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:14.021140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d8b00ac7-08eb-4f8f-b626-c875d43939fa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:14.021572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d8b00ac7-08eb-4f8f-b626-c875d43939fa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:14.035873 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-d8b00ac7-08eb-4f8f-b626-c875d43939fa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] HTTP exception thrown: Instance 4674fb54-efa1-4bed-a2a2-49f3b1184874 could not be found. May 10 21:44:14.038074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d8b00ac7-08eb-4f8f-b626-c875d43939fa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Request method failure captured: May 10 21:44:14.038074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874 HTTP/1.1 May 10 21:44:14.038074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:44:14.038074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:44:14.038074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:44:14.038074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:44:14.038074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:44:14.038074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:44:14.038074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:44:14.038074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:44:14.038074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietSE5zX3cUzqYcL4439JiFsqE4YiilwKjmw-zwJrvzsKCKk2V0t2rgnfCfWB9fMDqHcwDYx66Osidv5Nb3ivvjsId3P0K5BlinPK-pYoxdKcKRbo0A46AEZFFXEAkT7Vt_ZFHlOxIkEow-5P_dpFvNFYY0aq5XGlXkN1VnlT95XyJvw May 10 21:44:14.038074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:44:14.038074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:44:14.038074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:44:14.038074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:44:14.038074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:44:14.038074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:44:14.038074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 9582743483fa4fb88f4e91d3f787c945 May 10 21:44:14.038074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-AttachVolumeNegativeTest-297208105 May 10 21:44:14.038074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:44:14.038074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:44:14.044448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9582743483fa4fb88f4e91d3f787c945", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:44:14.044448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-AttachVolumeNegativeTest-297208105 May 10 21:44:14.044448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 9582743483fa4fb88f4e91d3f787c945 May 10 21:44:14.044448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-297208105 May 10 21:44:14.044448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-AttachVolumeNegativeTest-297208105-project May 10 21:44:14.044448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:44:14.044448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:44:14.044448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 62bc5605a22d408f9b4bac69a0f5f486 May 10 21:44:14.044448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-AttachVolumeNegativeTest-297208105-project May 10 21:44:14.044448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:44:14.044448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance 4674fb54-efa1-4bed-a2a2-49f3b1184874 could not be found. May 10 21:44:14.044448 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': '4674fb54-efa1-4bed-a2a2-49f3b1184874'} May 10 21:44:14.045474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:44:14.045474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:44:14.045474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:44:14.045474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:44:14.045474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:44:14.045474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:44:14.045474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:44:14.045474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:44:14.045474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:44:14.045474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:44:14.045474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4674fb54-efa1-4bed-a2a2-49f3b1184874 could not be found. May 10 21:44:14.045474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:44:14.045474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:44:14.045474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:44:14.045474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:44:14.045474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:44:14.045474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:44:14.045474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:44:14.045474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:44:14.045474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:44:14.047165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:44:14.047165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:44:14.047165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:44:14.047165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:44:14.047165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:44:14.047165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:44:14.047165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:44:14.047165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4674fb54-efa1-4bed-a2a2-49f3b1184874 could not be found. May 10 21:44:14.047165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:44:14.047165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:44:14.047165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:44:14.047165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:44:14.047165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:44:14.047165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:44:14.047165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:44:14.047165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:44:14.047165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4674fb54-efa1-4bed-a2a2-49f3b1184874 could not be found. May 10 21:44:14.047165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:44:14.048659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d8b00ac7-08eb-4f8f-b626-c875d43939fa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Returning 404 to user: Instance 4674fb54-efa1-4bed-a2a2-49f3b1184874 could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:44:14.048659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d8b00ac7-08eb-4f8f-b626-c875d43939fa tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874" status: 404 len: 111 microversion: 2.1 time: 0.031106 May 10 21:44:14.048659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2758/3534] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:44:14 2022] GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:44:14.054854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b0a7f300-fd38-4b1c-afe2-63f45d8a685d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '.version_select at 0x7f85d54bbb80>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:44:14.182617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b0a7f300-fd38-4b1c-afe2-63f45d8a685d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-145764112" status: 202 len: 0 microversion: 2.1 time: 0.132163 May 10 21:44:14.183219 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2759/3535] 10.222.0.49 () {58 vars in 1217 bytes} [Tue May 10 21:44:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-145764112 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:44:15.016379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b95513a7-38e6-4e19-a568-74eaff5f14eb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Action: 'create', calling method: .version_select at 0x7f85d54ee700>, body: {"keypair": {"name": "tempest-keypair-1687651556", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOyeOL1IQoeGCFjIgioX6CpMeLgT8KMBgsZ9pd/O0g79M6CYGAos9ofJKRJCc8B3JJv6h9dYSx3AiRM0fUwLNRCJVNRyzNkLg0hsFQvvYNs4846uCQtGmif/4RGcvRP5g=="}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:44:15.033013 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-b95513a7-38e6-4e19-a568-74eaff5f14eb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Getting quotas for project 9582743483fa4fb88f4e91d3f787c945. Resources: {'key_pairs'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:44:15.037197 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-b95513a7-38e6-4e19-a568-74eaff5f14eb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Getting quotas for user 62bc5605a22d408f9b4bac69a0f5f486 and project 9582743483fa4fb88f4e91d3f787c945. Resources: {'key_pairs'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:44:15.151951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b95513a7-38e6-4e19-a568-74eaff5f14eb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.139733 May 10 21:44:15.152666 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2760/3536] 10.222.0.49 () {60 vars in 1158 bytes} [Tue May 10 21:44:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:44:17.912134 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b8d5019b-2ca9-438b-b015-dc0d6cd82526 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-680629101", "imageRef": "cb321ccf-1ce7-4dda-90d0-f05332eb6fe1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a67b65bc-d215-4b97-b229-e2132409a79d"}], "security_groups": [{"name": "tempest-securitygroup--173312224"}], "key_name": "tempest-keypair-1687651556", "user_data": "}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:44:18.018017 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.network.neutron [None req-b8d5019b-2ca9-438b-b015-dc0d6cd82526 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] validate_networks() for [('a67b65bc-d215-4b97-b229-e2132409a79d', None, None, None, None, None)] {{(pid=117714) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:44:18.559664 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-b8d5019b-2ca9-438b-b015-dc0d6cd82526 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Flavor limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:44:18.560090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-b8d5019b-2ca9-438b-b015-dc0d6cd82526 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Image limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:44:18.560565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-b8d5019b-2ca9-438b-b015-dc0d6cd82526 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Flavor pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:44:18.560973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-b8d5019b-2ca9-438b-b015-dc0d6cd82526 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Image pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:44:18.561414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-b8d5019b-2ca9-438b-b015-dc0d6cd82526 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:44:18.571208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b8d5019b-2ca9-438b-b015-dc0d6cd82526 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:18.571660 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b8d5019b-2ca9-438b-b015-dc0d6cd82526 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:18.572459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b8d5019b-2ca9-438b-b015-dc0d6cd82526 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:18.572894 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b8d5019b-2ca9-438b-b015-dc0d6cd82526 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:18.589635 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-b8d5019b-2ca9-438b-b015-dc0d6cd82526 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Getting quotas for project 9582743483fa4fb88f4e91d3f787c945. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:44:18.593557 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-b8d5019b-2ca9-438b-b015-dc0d6cd82526 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Getting quotas for user 62bc5605a22d408f9b4bac69a0f5f486 and project 9582743483fa4fb88f4e91d3f787c945. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:44:18.604888 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b8d5019b-2ca9-438b-b015-dc0d6cd82526 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Going to run 1 instances... {{(pid=117714) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:44:18.607201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b8d5019b-2ca9-438b-b015-dc0d6cd82526 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: d43e9057-6151-4874-bf54-cacf91b0d7bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb321ccf-1ce7-4dda-90d0-f05332eb6fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117714) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:44:18.729736 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b8d5019b-2ca9-438b-b015-dc0d6cd82526 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.822131 May 10 21:44:18.730314 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2761/3537] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 21:44:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 21:44:18.740038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c1eb2e23-bc51-4e05-adab-03eecdb56d6e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:44:18.740737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c1eb2e23-bc51-4e05-adab-03eecdb56d6e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: d43e9057-6151-4874-bf54-cacf91b0d7bc] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:44:18.801806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c1eb2e23-bc51-4e05-adab-03eecdb56d6e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:44:18.811190 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c1eb2e23-bc51-4e05-adab-03eecdb56d6e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc" status: 200 len: 1241 microversion: 2.1 time: 0.074765 May 10 21:44:18.812577 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2762/3538] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:44:18 2022] GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:44:19.829244 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-66ae37bd-2a2c-48dc-b7de-16fce0dc9206 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:44:19.829906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-66ae37bd-2a2c-48dc-b7de-16fce0dc9206 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: d43e9057-6151-4874-bf54-cacf91b0d7bc] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:44:19.837687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-66ae37bd-2a2c-48dc-b7de-16fce0dc9206 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:19.838132 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-66ae37bd-2a2c-48dc-b7de-16fce0dc9206 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:19.838898 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-66ae37bd-2a2c-48dc-b7de-16fce0dc9206 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:19.839373 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-66ae37bd-2a2c-48dc-b7de-16fce0dc9206 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:19.902414 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-66ae37bd-2a2c-48dc-b7de-16fce0dc9206 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:44:19.914695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-66ae37bd-2a2c-48dc-b7de-16fce0dc9206 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc" status: 200 len: 1237 microversion: 2.1 time: 0.089296 May 10 21:44:19.915549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2763/3539] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:44:19 2022] GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc => generated 1237 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:44:20.932412 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-00180b10-2ac4-445f-b6e1-5d42b40ee5ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:44:20.933103 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-00180b10-2ac4-445f-b6e1-5d42b40ee5ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: d43e9057-6151-4874-bf54-cacf91b0d7bc] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:44:20.939639 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-00180b10-2ac4-445f-b6e1-5d42b40ee5ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:20.940093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-00180b10-2ac4-445f-b6e1-5d42b40ee5ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:20.940867 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-00180b10-2ac4-445f-b6e1-5d42b40ee5ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:20.941308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-00180b10-2ac4-445f-b6e1-5d42b40ee5ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:21.033962 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-00180b10-2ac4-445f-b6e1-5d42b40ee5ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:44:21.041564 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-00180b10-2ac4-445f-b6e1-5d42b40ee5ee tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc" status: 200 len: 1299 microversion: 2.1 time: 0.113577 May 10 21:44:21.042135 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2764/3540] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:44:20 2022] GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc => generated 1299 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:44:22.058565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-563054a3-bbd8-4a91-9aef-16e0cf331f5f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:44:22.059317 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-563054a3-bbd8-4a91-9aef-16e0cf331f5f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: d43e9057-6151-4874-bf54-cacf91b0d7bc] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:44:22.065653 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-563054a3-bbd8-4a91-9aef-16e0cf331f5f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:22.078426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-563054a3-bbd8-4a91-9aef-16e0cf331f5f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:22.078426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-563054a3-bbd8-4a91-9aef-16e0cf331f5f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:22.078426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-563054a3-bbd8-4a91-9aef-16e0cf331f5f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:22.262595 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-563054a3-bbd8-4a91-9aef-16e0cf331f5f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:44:22.305213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-563054a3-bbd8-4a91-9aef-16e0cf331f5f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc" status: 200 len: 1366 microversion: 2.1 time: 0.217160 May 10 21:44:22.305213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2765/3541] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:44:22 2022] GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:44:22.305213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-ee02b1b4-00f5-4d99-abcb-dffc8d90fa87 req-fb7871d3-20d2-4eb6-8e2d-1eb8cccc80db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d43e9057-6151-4874-bf54-cacf91b0d7bc", "tag": "b601c84b-c3bf-4921-859a-92a0aaefdc8f"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:44:22.305213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-ee02b1b4-00f5-4d99-abcb-dffc8d90fa87 req-fb7871d3-20d2-4eb6-8e2d-1eb8cccc80db service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:22.305846 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-ee02b1b4-00f5-4d99-abcb-dffc8d90fa87 req-fb7871d3-20d2-4eb6-8e2d-1eb8cccc80db service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:22.305846 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-ee02b1b4-00f5-4d99-abcb-dffc8d90fa87 req-fb7871d3-20d2-4eb6-8e2d-1eb8cccc80db service nova] Creating event network-changed:b601c84b-c3bf-4921-859a-92a0aaefdc8f for instance d43e9057-6151-4874-bf54-cacf91b0d7bc on hv-cinder-82880 May 10 21:44:22.309933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-ee02b1b4-00f5-4d99-abcb-dffc8d90fa87 req-fb7871d3-20d2-4eb6-8e2d-1eb8cccc80db service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036129 May 10 21:44:22.310549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2766/3542] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:44:23.290341 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ed62c556-7186-44e2-9a60-1b5b392de40d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:44:23.291070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ed62c556-7186-44e2-9a60-1b5b392de40d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: d43e9057-6151-4874-bf54-cacf91b0d7bc] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:44:23.297576 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed62c556-7186-44e2-9a60-1b5b392de40d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:23.298021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed62c556-7186-44e2-9a60-1b5b392de40d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:23.298779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed62c556-7186-44e2-9a60-1b5b392de40d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:23.299242 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ed62c556-7186-44e2-9a60-1b5b392de40d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:23.434241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ed62c556-7186-44e2-9a60-1b5b392de40d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:44:23.441528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ed62c556-7186-44e2-9a60-1b5b392de40d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc" status: 200 len: 1366 microversion: 2.1 time: 0.156247 May 10 21:44:23.442096 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2767/3543] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:44:23 2022] GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:44:24.457684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-82083a33-718c-421c-a2d3-aebc33a88e27 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:44:24.458364 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-82083a33-718c-421c-a2d3-aebc33a88e27 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: d43e9057-6151-4874-bf54-cacf91b0d7bc] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:44:24.464687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-82083a33-718c-421c-a2d3-aebc33a88e27 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:24.465134 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-82083a33-718c-421c-a2d3-aebc33a88e27 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:24.465899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-82083a33-718c-421c-a2d3-aebc33a88e27 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:24.466337 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-82083a33-718c-421c-a2d3-aebc33a88e27 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:24.602915 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-82083a33-718c-421c-a2d3-aebc33a88e27 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:44:24.610430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-82083a33-718c-421c-a2d3-aebc33a88e27 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc" status: 200 len: 1366 microversion: 2.1 time: 0.156554 May 10 21:44:24.610994 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2768/3544] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:44:24 2022] GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:44:25.626795 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5d1f2a49-89a1-413b-9aa2-2fdc86b4330e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:44:25.627513 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5d1f2a49-89a1-413b-9aa2-2fdc86b4330e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: d43e9057-6151-4874-bf54-cacf91b0d7bc] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:44:25.633900 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5d1f2a49-89a1-413b-9aa2-2fdc86b4330e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:25.634351 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5d1f2a49-89a1-413b-9aa2-2fdc86b4330e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:25.635187 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5d1f2a49-89a1-413b-9aa2-2fdc86b4330e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:25.635627 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5d1f2a49-89a1-413b-9aa2-2fdc86b4330e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:25.769566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5d1f2a49-89a1-413b-9aa2-2fdc86b4330e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:44:25.777646 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5d1f2a49-89a1-413b-9aa2-2fdc86b4330e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc" status: 200 len: 1366 microversion: 2.1 time: 0.154690 May 10 21:44:25.778221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2769/3545] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:44:25 2022] GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:44:26.795416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6dbb739a-347e-4db7-9e6a-dc9448314dcd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:44:26.796680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6dbb739a-347e-4db7-9e6a-dc9448314dcd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: d43e9057-6151-4874-bf54-cacf91b0d7bc] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:44:26.806158 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6dbb739a-347e-4db7-9e6a-dc9448314dcd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:26.806609 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6dbb739a-347e-4db7-9e6a-dc9448314dcd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:26.807417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6dbb739a-347e-4db7-9e6a-dc9448314dcd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:26.807855 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6dbb739a-347e-4db7-9e6a-dc9448314dcd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:26.957045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6dbb739a-347e-4db7-9e6a-dc9448314dcd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:44:26.965767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6dbb739a-347e-4db7-9e6a-dc9448314dcd tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc" status: 200 len: 1366 microversion: 2.1 time: 0.175083 May 10 21:44:26.966339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2770/3546] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:44:26 2022] GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:44:27.983074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8f3f29b5-428a-4bc8-a3d3-4269a9b0d88c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:44:27.983857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8f3f29b5-428a-4bc8-a3d3-4269a9b0d88c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: d43e9057-6151-4874-bf54-cacf91b0d7bc] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:44:27.990178 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8f3f29b5-428a-4bc8-a3d3-4269a9b0d88c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:27.991468 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8f3f29b5-428a-4bc8-a3d3-4269a9b0d88c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:27.992309 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8f3f29b5-428a-4bc8-a3d3-4269a9b0d88c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:27.992764 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8f3f29b5-428a-4bc8-a3d3-4269a9b0d88c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:28.127111 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8f3f29b5-428a-4bc8-a3d3-4269a9b0d88c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:44:28.135393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8f3f29b5-428a-4bc8-a3d3-4269a9b0d88c tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc" status: 200 len: 1366 microversion: 2.1 time: 0.156484 May 10 21:44:28.136014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2771/3547] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:44:27 2022] GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:44:29.051597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-e315b8c7-93ff-4d75-9b32-9476cebebae9 req-d1f039b8-b823-42e3-8f78-f6f36e9f8a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d43e9057-6151-4874-bf54-cacf91b0d7bc", "name": "network-vif-plugged", "status": "completed", "tag": "b601c84b-c3bf-4921-859a-92a0aaefdc8f"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:44:29.059804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-e315b8c7-93ff-4d75-9b32-9476cebebae9 req-d1f039b8-b823-42e3-8f78-f6f36e9f8a4e service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:29.060253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-e315b8c7-93ff-4d75-9b32-9476cebebae9 req-d1f039b8-b823-42e3-8f78-f6f36e9f8a4e service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:29.071992 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-e315b8c7-93ff-4d75-9b32-9476cebebae9 req-d1f039b8-b823-42e3-8f78-f6f36e9f8a4e service nova] Creating event network-vif-plugged:b601c84b-c3bf-4921-859a-92a0aaefdc8f for instance d43e9057-6151-4874-bf54-cacf91b0d7bc on hv-cinder-82880 May 10 21:44:29.076929 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-e315b8c7-93ff-4d75-9b32-9476cebebae9 req-d1f039b8-b823-42e3-8f78-f6f36e9f8a4e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171033 May 10 21:44:29.077464 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2772/3548] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:44:29.152995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5a799061-e149-4d52-b531-eed698ec801a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:44:29.153710 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5a799061-e149-4d52-b531-eed698ec801a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: d43e9057-6151-4874-bf54-cacf91b0d7bc] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:44:29.159975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5a799061-e149-4d52-b531-eed698ec801a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:29.160460 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5a799061-e149-4d52-b531-eed698ec801a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:29.164071 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5a799061-e149-4d52-b531-eed698ec801a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:29.164071 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5a799061-e149-4d52-b531-eed698ec801a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:29.345890 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5a799061-e149-4d52-b531-eed698ec801a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:44:29.359016 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5a799061-e149-4d52-b531-eed698ec801a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc" status: 200 len: 1366 microversion: 2.1 time: 0.210186 May 10 21:44:29.360111 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2773/3549] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:44:29 2022] GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:44:30.377778 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d442c105-491d-4721-9b2b-dc3c23b741f9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:44:30.378821 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d442c105-491d-4721-9b2b-dc3c23b741f9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: d43e9057-6151-4874-bf54-cacf91b0d7bc] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:44:30.387401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d442c105-491d-4721-9b2b-dc3c23b741f9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:30.387861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d442c105-491d-4721-9b2b-dc3c23b741f9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:30.388642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d442c105-491d-4721-9b2b-dc3c23b741f9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:30.389080 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d442c105-491d-4721-9b2b-dc3c23b741f9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:30.567692 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d442c105-491d-4721-9b2b-dc3c23b741f9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:44:30.576950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d442c105-491d-4721-9b2b-dc3c23b741f9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc" status: 200 len: 1366 microversion: 2.1 time: 0.203790 May 10 21:44:30.577532 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2774/3550] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:44:30 2022] GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:44:31.595238 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e0c6f665-c881-43e1-878a-dc0bc89abb02 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:44:31.596757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e0c6f665-c881-43e1-878a-dc0bc89abb02 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: d43e9057-6151-4874-bf54-cacf91b0d7bc] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:44:31.608467 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e0c6f665-c881-43e1-878a-dc0bc89abb02 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:31.609069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e0c6f665-c881-43e1-878a-dc0bc89abb02 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:31.609857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e0c6f665-c881-43e1-878a-dc0bc89abb02 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:31.610290 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e0c6f665-c881-43e1-878a-dc0bc89abb02 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:31.758460 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e0c6f665-c881-43e1-878a-dc0bc89abb02 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:44:31.766730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e0c6f665-c881-43e1-878a-dc0bc89abb02 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc" status: 200 len: 1557 microversion: 2.1 time: 0.176579 May 10 21:44:31.767334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2775/3551] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:44:31 2022] GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc => generated 1557 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:44:31.784589 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9d2f1f61-e7c5-4bde-94ae-6cd13210a6bf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:44:31.785480 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9d2f1f61-e7c5-4bde-94ae-6cd13210a6bf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: d43e9057-6151-4874-bf54-cacf91b0d7bc] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:44:31.794816 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9d2f1f61-e7c5-4bde-94ae-6cd13210a6bf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:31.795466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9d2f1f61-e7c5-4bde-94ae-6cd13210a6bf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:31.796507 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9d2f1f61-e7c5-4bde-94ae-6cd13210a6bf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:31.797210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9d2f1f61-e7c5-4bde-94ae-6cd13210a6bf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:31.880408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9d2f1f61-e7c5-4bde-94ae-6cd13210a6bf tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100109 May 10 21:44:31.886593 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2776/3552] 10.222.0.49 () {58 vars in 1274 bytes} [Tue May 10 21:44:31 2022] GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:44:33.251512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-0b8c8d51-3ca5-42c7-9851-60b412869cd4 req-441f569b-0413-4290-9d8a-bbfeec07dc05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d43e9057-6151-4874-bf54-cacf91b0d7bc", "tag": "b601c84b-c3bf-4921-859a-92a0aaefdc8f"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:44:33.261054 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-0b8c8d51-3ca5-42c7-9851-60b412869cd4 req-441f569b-0413-4290-9d8a-bbfeec07dc05 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:44:33.261777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-0b8c8d51-3ca5-42c7-9851-60b412869cd4 req-441f569b-0413-4290-9d8a-bbfeec07dc05 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:44:33.274122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-0b8c8d51-3ca5-42c7-9851-60b412869cd4 req-441f569b-0413-4290-9d8a-bbfeec07dc05 service nova] Creating event network-changed:b601c84b-c3bf-4921-859a-92a0aaefdc8f for instance d43e9057-6151-4874-bf54-cacf91b0d7bc on hv-cinder-82880 May 10 21:44:33.280201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-0b8c8d51-3ca5-42c7-9851-60b412869cd4 req-441f569b-0413-4290-9d8a-bbfeec07dc05 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033917 May 10 21:44:33.280851 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2777/3553] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:45:05.276623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-04b54378-dfb7-4da0-84dd-422caf44175b tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1834152432", "imageRef": "cb321ccf-1ce7-4dda-90d0-f05332eb6fe1", "flavorRef": "452", "networks": [{"uuid": "4f584610-52e7-42d8-8e6a-f2c0e47df726"}]}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:45:05.334330 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.network.neutron [None req-04b54378-dfb7-4da0-84dd-422caf44175b tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] validate_networks() for [('4f584610-52e7-42d8-8e6a-f2c0e47df726', None, None, None, None, None)] {{(pid=117714) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:45:05.678889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-04b54378-dfb7-4da0-84dd-422caf44175b tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Flavor limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:45:05.679501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-04b54378-dfb7-4da0-84dd-422caf44175b tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Image limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:45:05.680193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-04b54378-dfb7-4da0-84dd-422caf44175b tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Flavor pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:45:05.680858 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-04b54378-dfb7-4da0-84dd-422caf44175b tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Image pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:45:05.681438 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-04b54378-dfb7-4da0-84dd-422caf44175b tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:45:05.691018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04b54378-dfb7-4da0-84dd-422caf44175b tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:05.691500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04b54378-dfb7-4da0-84dd-422caf44175b tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:05.692294 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04b54378-dfb7-4da0-84dd-422caf44175b tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:05.692897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-04b54378-dfb7-4da0-84dd-422caf44175b tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:05.709013 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-04b54378-dfb7-4da0-84dd-422caf44175b tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Getting quotas for project e84b33f24f6d4a46b1e5ee4ed74ed39e. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:45:05.712909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-04b54378-dfb7-4da0-84dd-422caf44175b tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Getting quotas for user 0a0c9edad1444469a9a31988ac49730f and project e84b33f24f6d4a46b1e5ee4ed74ed39e. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:45:05.724130 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-04b54378-dfb7-4da0-84dd-422caf44175b tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Going to run 1 instances... {{(pid=117714) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:45:05.726476 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-04b54378-dfb7-4da0-84dd-422caf44175b tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 2c48ebaf-655b-4b2e-a141-a68c9e026c96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb321ccf-1ce7-4dda-90d0-f05332eb6fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117714) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:45:05.841617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-04b54378-dfb7-4da0-84dd-422caf44175b tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570176 May 10 21:45:05.842284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2778/3554] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 21:45:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 21:45:05.852292 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cd687073-2ae5-4595-81a0-4fd1ee614b7a tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:05.852908 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cd687073-2ae5-4595-81a0-4fd1ee614b7a tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 2c48ebaf-655b-4b2e-a141-a68c9e026c96] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:05.906636 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cd687073-2ae5-4595-81a0-4fd1ee614b7a tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0c9edad1444469a9a31988ac49730f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:05.913738 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cd687073-2ae5-4595-81a0-4fd1ee614b7a tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96" status: 200 len: 1214 microversion: 2.1 time: 0.065154 May 10 21:45:05.914293 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2779/3555] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:05 2022] GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:45:06.934240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-aa2e3b87-1bf8-40c4-a4a2-b01a226700e6 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:06.934991 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-aa2e3b87-1bf8-40c4-a4a2-b01a226700e6 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 2c48ebaf-655b-4b2e-a141-a68c9e026c96] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:06.941984 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aa2e3b87-1bf8-40c4-a4a2-b01a226700e6 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:06.942436 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aa2e3b87-1bf8-40c4-a4a2-b01a226700e6 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:06.943239 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aa2e3b87-1bf8-40c4-a4a2-b01a226700e6 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:06.943668 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-aa2e3b87-1bf8-40c4-a4a2-b01a226700e6 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:07.014766 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-aa2e3b87-1bf8-40c4-a4a2-b01a226700e6 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0c9edad1444469a9a31988ac49730f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:07.025148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-aa2e3b87-1bf8-40c4-a4a2-b01a226700e6 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96" status: 200 len: 1218 microversion: 2.1 time: 0.096112 May 10 21:45:07.025797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2780/3556] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:06 2022] GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:45:08.042636 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-80ef020a-a314-4838-afbd-87653228b8a5 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:08.044249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-80ef020a-a314-4838-afbd-87653228b8a5 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 2c48ebaf-655b-4b2e-a141-a68c9e026c96] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:08.052789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-80ef020a-a314-4838-afbd-87653228b8a5 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:08.053432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-80ef020a-a314-4838-afbd-87653228b8a5 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:08.056201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-80ef020a-a314-4838-afbd-87653228b8a5 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:08.056201 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-80ef020a-a314-4838-afbd-87653228b8a5 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:08.123803 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-80ef020a-a314-4838-afbd-87653228b8a5 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0c9edad1444469a9a31988ac49730f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:08.130128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-80ef020a-a314-4838-afbd-87653228b8a5 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96" status: 200 len: 1284 microversion: 2.1 time: 0.091217 May 10 21:45:08.130719 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2781/3557] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:08 2022] GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:45:09.148997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-af141cd1-c02f-422d-9c38-0d1f71526a92 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:09.154984 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-af141cd1-c02f-422d-9c38-0d1f71526a92 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 2c48ebaf-655b-4b2e-a141-a68c9e026c96] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:09.157086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af141cd1-c02f-422d-9c38-0d1f71526a92 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:09.157667 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af141cd1-c02f-422d-9c38-0d1f71526a92 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:09.158677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af141cd1-c02f-422d-9c38-0d1f71526a92 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:09.159198 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af141cd1-c02f-422d-9c38-0d1f71526a92 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:09.423492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-af141cd1-c02f-422d-9c38-0d1f71526a92 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0c9edad1444469a9a31988ac49730f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:09.430977 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-af141cd1-c02f-422d-9c38-0d1f71526a92 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96" status: 200 len: 1314 microversion: 2.1 time: 0.287156 May 10 21:45:09.440600 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2782/3558] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:09 2022] GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:45:09.676999 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-53eb2718-ab49-4df1-8028-a50f284fc968 req-b0136b0a-ec54-4b19-b878-67a4ce9643e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c48ebaf-655b-4b2e-a141-a68c9e026c96", "tag": "9ee6d047-a056-4571-b65e-fc5d447f624d"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:45:09.686143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-53eb2718-ab49-4df1-8028-a50f284fc968 req-b0136b0a-ec54-4b19-b878-67a4ce9643e7 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:09.687225 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-53eb2718-ab49-4df1-8028-a50f284fc968 req-b0136b0a-ec54-4b19-b878-67a4ce9643e7 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:09.700348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-53eb2718-ab49-4df1-8028-a50f284fc968 req-b0136b0a-ec54-4b19-b878-67a4ce9643e7 service nova] Creating event network-changed:9ee6d047-a056-4571-b65e-fc5d447f624d for instance 2c48ebaf-655b-4b2e-a141-a68c9e026c96 on hv-cinder-82880 May 10 21:45:09.706925 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-53eb2718-ab49-4df1-8028-a50f284fc968 req-b0136b0a-ec54-4b19-b878-67a4ce9643e7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033575 May 10 21:45:09.708226 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2783/3559] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:45:10.449169 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d7c52620-b8b0-429c-841a-26cb860578b7 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:10.449902 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d7c52620-b8b0-429c-841a-26cb860578b7 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 2c48ebaf-655b-4b2e-a141-a68c9e026c96] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:10.456698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d7c52620-b8b0-429c-841a-26cb860578b7 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:10.461423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d7c52620-b8b0-429c-841a-26cb860578b7 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:10.461423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d7c52620-b8b0-429c-841a-26cb860578b7 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:10.461423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d7c52620-b8b0-429c-841a-26cb860578b7 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:10.592420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d7c52620-b8b0-429c-841a-26cb860578b7 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0c9edad1444469a9a31988ac49730f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:10.600094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d7c52620-b8b0-429c-841a-26cb860578b7 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96" status: 200 len: 1314 microversion: 2.1 time: 0.155717 May 10 21:45:10.600662 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2784/3560] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:10 2022] GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:45:11.617302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fcea5c30-347f-49a2-af22-c19447eba44c tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:11.617945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fcea5c30-347f-49a2-af22-c19447eba44c tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 2c48ebaf-655b-4b2e-a141-a68c9e026c96] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:11.624431 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fcea5c30-347f-49a2-af22-c19447eba44c tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:11.624887 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fcea5c30-347f-49a2-af22-c19447eba44c tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:11.633447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fcea5c30-347f-49a2-af22-c19447eba44c tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:11.633447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fcea5c30-347f-49a2-af22-c19447eba44c tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:11.753889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fcea5c30-347f-49a2-af22-c19447eba44c tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0c9edad1444469a9a31988ac49730f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:11.761094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fcea5c30-347f-49a2-af22-c19447eba44c tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96" status: 200 len: 1314 microversion: 2.1 time: 0.147711 May 10 21:45:11.761663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2785/3561] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:11 2022] GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:45:12.504686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-09c15998-9320-42f6-9f22-8d0572c7db11 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:12.505209 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-09c15998-9320-42f6-9f22-8d0572c7db11 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: d43e9057-6151-4874-bf54-cacf91b0d7bc] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:12.511260 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-09c15998-9320-42f6-9f22-8d0572c7db11 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:12.511718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-09c15998-9320-42f6-9f22-8d0572c7db11 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:12.512480 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-09c15998-9320-42f6-9f22-8d0572c7db11 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:12.512921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-09c15998-9320-42f6-9f22-8d0572c7db11 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:12.537119 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-09c15998-9320-42f6-9f22-8d0572c7db11 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc/ips" status: 200 len: 150 microversion: 2.1 time: 0.036801 May 10 21:45:12.537663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2786/3562] 10.222.0.49 () {58 vars in 1247 bytes} [Tue May 10 21:45:12 2022] GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:45:12.778346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5c82d01b-0632-4527-906e-d9676d66f963 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:12.779030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5c82d01b-0632-4527-906e-d9676d66f963 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 2c48ebaf-655b-4b2e-a141-a68c9e026c96] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:12.785508 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5c82d01b-0632-4527-906e-d9676d66f963 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:12.785955 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5c82d01b-0632-4527-906e-d9676d66f963 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:12.786700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5c82d01b-0632-4527-906e-d9676d66f963 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:12.787148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5c82d01b-0632-4527-906e-d9676d66f963 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:12.928275 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5c82d01b-0632-4527-906e-d9676d66f963 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0c9edad1444469a9a31988ac49730f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:12.936229 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5c82d01b-0632-4527-906e-d9676d66f963 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96" status: 200 len: 1314 microversion: 2.1 time: 0.161774 May 10 21:45:12.936794 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2787/3563] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:12 2022] GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:45:13.953647 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-49afbe1b-ad51-4139-a17e-9168ce273373 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:13.954285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-49afbe1b-ad51-4139-a17e-9168ce273373 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 2c48ebaf-655b-4b2e-a141-a68c9e026c96] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:13.961501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-49afbe1b-ad51-4139-a17e-9168ce273373 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:13.961974 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-49afbe1b-ad51-4139-a17e-9168ce273373 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:13.962732 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-49afbe1b-ad51-4139-a17e-9168ce273373 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:13.963189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-49afbe1b-ad51-4139-a17e-9168ce273373 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:14.092205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-49afbe1b-ad51-4139-a17e-9168ce273373 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0c9edad1444469a9a31988ac49730f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:14.100432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-49afbe1b-ad51-4139-a17e-9168ce273373 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96" status: 200 len: 1314 microversion: 2.1 time: 0.150777 May 10 21:45:14.101000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2788/3564] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:13 2022] GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:45:14.105556 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b5c4191f-b4a3-46a7-80d8-6f7bca43ae05 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bf01c94-0e2a-4555-9072-43156a0491a6"}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:45:14.106614 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b5c4191f-b4a3-46a7-80d8-6f7bca43ae05 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: d43e9057-6151-4874-bf54-cacf91b0d7bc] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:14.112178 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5c4191f-b4a3-46a7-80d8-6f7bca43ae05 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:14.112643 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5c4191f-b4a3-46a7-80d8-6f7bca43ae05 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:14.113417 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5c4191f-b4a3-46a7-80d8-6f7bca43ae05 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:14.113860 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b5c4191f-b4a3-46a7-80d8-6f7bca43ae05 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:14.816972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b5c4191f-b4a3-46a7-80d8-6f7bca43ae05 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "POST /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.714503 May 10 21:45:14.817597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2789/3565] 10.222.0.49 () {60 vars in 1322 bytes} [Tue May 10 21:45:14 2022] POST /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc/os-volume_attachments => generated 194 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:45:15.097698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-aa3f45b0-baeb-4079-8f04-7a6ce321cbd5 req-22aec8bb-9f8a-4eba-be67-fb9c480593e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c48ebaf-655b-4b2e-a141-a68c9e026c96", "name": "network-vif-plugged", "status": "completed", "tag": "9ee6d047-a056-4571-b65e-fc5d447f624d"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:45:15.106326 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-aa3f45b0-baeb-4079-8f04-7a6ce321cbd5 req-22aec8bb-9f8a-4eba-be67-fb9c480593e9 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:15.106783 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-aa3f45b0-baeb-4079-8f04-7a6ce321cbd5 req-22aec8bb-9f8a-4eba-be67-fb9c480593e9 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:15.118147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-aa3f45b0-baeb-4079-8f04-7a6ce321cbd5 req-22aec8bb-9f8a-4eba-be67-fb9c480593e9 service nova] Creating event network-vif-plugged:9ee6d047-a056-4571-b65e-fc5d447f624d for instance 2c48ebaf-655b-4b2e-a141-a68c9e026c96 on hv-cinder-82880 May 10 21:45:15.122872 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-aa3f45b0-baeb-4079-8f04-7a6ce321cbd5 req-22aec8bb-9f8a-4eba-be67-fb9c480593e9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029630 May 10 21:45:15.123493 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2790/3566] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:45:15.128964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bca93466-84c7-47c7-b51c-ede60410734e tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:15.129656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bca93466-84c7-47c7-b51c-ede60410734e tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 2c48ebaf-655b-4b2e-a141-a68c9e026c96] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:15.135861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bca93466-84c7-47c7-b51c-ede60410734e tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:15.136313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bca93466-84c7-47c7-b51c-ede60410734e tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:15.137079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bca93466-84c7-47c7-b51c-ede60410734e tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:15.137518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bca93466-84c7-47c7-b51c-ede60410734e tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:15.277602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bca93466-84c7-47c7-b51c-ede60410734e tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0c9edad1444469a9a31988ac49730f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:15.285685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bca93466-84c7-47c7-b51c-ede60410734e tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96" status: 200 len: 1314 microversion: 2.1 time: 0.161101 May 10 21:45:15.286342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2791/3567] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:15 2022] GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:45:16.303524 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-58a46098-951f-4e42-903b-e5ae07d85cff tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:16.304180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-58a46098-951f-4e42-903b-e5ae07d85cff tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 2c48ebaf-655b-4b2e-a141-a68c9e026c96] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:16.310352 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-58a46098-951f-4e42-903b-e5ae07d85cff tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:16.310806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-58a46098-951f-4e42-903b-e5ae07d85cff tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:16.311599 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-58a46098-951f-4e42-903b-e5ae07d85cff tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:16.312039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-58a46098-951f-4e42-903b-e5ae07d85cff tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:16.438779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-58a46098-951f-4e42-903b-e5ae07d85cff tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0c9edad1444469a9a31988ac49730f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:16.446253 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-58a46098-951f-4e42-903b-e5ae07d85cff tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96" status: 200 len: 1314 microversion: 2.1 time: 0.147472 May 10 21:45:16.446821 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2792/3568] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:16 2022] GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:45:17.462512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-428e0f28-d17d-47c7-ae64-323ad447ddd8 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:17.463219 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-428e0f28-d17d-47c7-ae64-323ad447ddd8 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 2c48ebaf-655b-4b2e-a141-a68c9e026c96] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:17.469511 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-428e0f28-d17d-47c7-ae64-323ad447ddd8 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:17.470206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-428e0f28-d17d-47c7-ae64-323ad447ddd8 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:17.470964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-428e0f28-d17d-47c7-ae64-323ad447ddd8 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:17.471484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-428e0f28-d17d-47c7-ae64-323ad447ddd8 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:17.601806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-428e0f28-d17d-47c7-ae64-323ad447ddd8 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0c9edad1444469a9a31988ac49730f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:17.609328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-428e0f28-d17d-47c7-ae64-323ad447ddd8 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96" status: 200 len: 1498 microversion: 2.1 time: 0.150650 May 10 21:45:17.609840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2793/3569] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:17 2022] GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96 => generated 1498 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:45:18.401736 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b52502fe-a66e-4b20-a6af-804f25f81c23 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:18.402234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b52502fe-a66e-4b20-a6af-804f25f81c23 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 2c48ebaf-655b-4b2e-a141-a68c9e026c96] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:18.408086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b52502fe-a66e-4b20-a6af-804f25f81c23 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:18.408529 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b52502fe-a66e-4b20-a6af-804f25f81c23 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:18.409344 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b52502fe-a66e-4b20-a6af-804f25f81c23 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:18.409785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b52502fe-a66e-4b20-a6af-804f25f81c23 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:18.434143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b52502fe-a66e-4b20-a6af-804f25f81c23 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 2c48ebaf-655b-4b2e-a141-a68c9e026c96] Going to try to terminate instance {{(pid=117714) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:45:18.692360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b52502fe-a66e-4b20-a6af-804f25f81c23 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96" status: 204 len: 0 microversion: 2.1 time: 0.294152 May 10 21:45:18.693059 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2794/3570] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 21:45:18 2022] DELETE /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 21:45:18.701390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0f6d0e5c-4e8d-4be1-bcf4-2e6e7a28c62a tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:18.702099 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0f6d0e5c-4e8d-4be1-bcf4-2e6e7a28c62a tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 2c48ebaf-655b-4b2e-a141-a68c9e026c96] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:18.708193 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f6d0e5c-4e8d-4be1-bcf4-2e6e7a28c62a tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:18.708649 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f6d0e5c-4e8d-4be1-bcf4-2e6e7a28c62a tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:18.709421 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f6d0e5c-4e8d-4be1-bcf4-2e6e7a28c62a tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:18.709871 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0f6d0e5c-4e8d-4be1-bcf4-2e6e7a28c62a tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:18.838726 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0f6d0e5c-4e8d-4be1-bcf4-2e6e7a28c62a tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0c9edad1444469a9a31988ac49730f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:18.846179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0f6d0e5c-4e8d-4be1-bcf4-2e6e7a28c62a tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96" status: 200 len: 1504 microversion: 2.1 time: 0.148901 May 10 21:45:18.847269 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2795/3571] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:18 2022] GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:45:19.863681 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d3909dec-ec84-4ab8-8e52-87334ddcce88 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:19.864321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d3909dec-ec84-4ab8-8e52-87334ddcce88 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 2c48ebaf-655b-4b2e-a141-a68c9e026c96] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:19.870391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d3909dec-ec84-4ab8-8e52-87334ddcce88 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:19.870833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d3909dec-ec84-4ab8-8e52-87334ddcce88 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:19.871620 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d3909dec-ec84-4ab8-8e52-87334ddcce88 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:19.872058 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d3909dec-ec84-4ab8-8e52-87334ddcce88 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:19.999553 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-d3909dec-ec84-4ab8-8e52-87334ddcce88 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0c9edad1444469a9a31988ac49730f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:20.007695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d3909dec-ec84-4ab8-8e52-87334ddcce88 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96" status: 200 len: 1504 microversion: 2.1 time: 0.148511 May 10 21:45:20.008279 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2796/3572] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:19 2022] GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:45:20.540618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-389d6067-c19b-4694-9c34-14c1443e70f2 req-76462107-bd9d-4a60-922e-fda3a516a3e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c48ebaf-655b-4b2e-a141-a68c9e026c96", "name": "network-vif-deleted", "tag": "9ee6d047-a056-4571-b65e-fc5d447f624d"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:45:20.548699 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-389d6067-c19b-4694-9c34-14c1443e70f2 req-76462107-bd9d-4a60-922e-fda3a516a3e2 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:20.549146 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-389d6067-c19b-4694-9c34-14c1443e70f2 req-76462107-bd9d-4a60-922e-fda3a516a3e2 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:20.560209 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-389d6067-c19b-4694-9c34-14c1443e70f2 req-76462107-bd9d-4a60-922e-fda3a516a3e2 service nova] Creating event network-vif-deleted:9ee6d047-a056-4571-b65e-fc5d447f624d for instance 2c48ebaf-655b-4b2e-a141-a68c9e026c96 on hv-cinder-82880 May 10 21:45:20.565101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-389d6067-c19b-4694-9c34-14c1443e70f2 req-76462107-bd9d-4a60-922e-fda3a516a3e2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028250 May 10 21:45:20.565966 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2797/3573] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:45:21.026251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-861dcbf7-11e5-465a-9fbc-6cb7a591eca0 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:21.026893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-861dcbf7-11e5-465a-9fbc-6cb7a591eca0 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 2c48ebaf-655b-4b2e-a141-a68c9e026c96] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:21.033101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-861dcbf7-11e5-465a-9fbc-6cb7a591eca0 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:21.033558 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-861dcbf7-11e5-465a-9fbc-6cb7a591eca0 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:21.034828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-861dcbf7-11e5-465a-9fbc-6cb7a591eca0 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:21.035224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-861dcbf7-11e5-465a-9fbc-6cb7a591eca0 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:21.065019 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-861dcbf7-11e5-465a-9fbc-6cb7a591eca0 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:21.066081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-861dcbf7-11e5-465a-9fbc-6cb7a591eca0 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:21.066533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.objects.instance [None req-861dcbf7-11e5-465a-9fbc-6cb7a591eca0 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lazy-loading 'fault' on Instance uuid 2c48ebaf-655b-4b2e-a141-a68c9e026c96 {{(pid=117714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:45:21.107659 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-861dcbf7-11e5-465a-9fbc-6cb7a591eca0 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0c9edad1444469a9a31988ac49730f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:21.115257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-861dcbf7-11e5-465a-9fbc-6cb7a591eca0 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96" status: 200 len: 1304 microversion: 2.1 time: 0.093835 May 10 21:45:21.116026 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2798/3574] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:21 2022] GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:45:22.132500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0577f40d-aead-4d23-9b63-2a4ad1036515 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:22.133202 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0577f40d-aead-4d23-9b63-2a4ad1036515 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 2c48ebaf-655b-4b2e-a141-a68c9e026c96] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:22.138995 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0577f40d-aead-4d23-9b63-2a4ad1036515 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:22.139474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0577f40d-aead-4d23-9b63-2a4ad1036515 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:22.140228 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0577f40d-aead-4d23-9b63-2a4ad1036515 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:22.140661 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0577f40d-aead-4d23-9b63-2a4ad1036515 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:22.154131 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-0577f40d-aead-4d23-9b63-2a4ad1036515 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] HTTP exception thrown: Instance 2c48ebaf-655b-4b2e-a141-a68c9e026c96 could not be found. May 10 21:45:22.155784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0577f40d-aead-4d23-9b63-2a4ad1036515 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Request method failure captured: May 10 21:45:22.155784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96 HTTP/1.1 May 10 21:45:22.155784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:45:22.155784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:45:22.155784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:45:22.155784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:45:22.155784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:45:22.155784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:45:22.155784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:45:22.155784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:45:22.155784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietzfNTJoOtJgG97X0nO-CeaFAqvKOuKohb7TSiNqISK39TZrPWnKHWgvH8fhBxnD9s4lFI_DYKN44ANpzV86kQTdKzTNrAFfitD1ZkiYkJRIfySxemTl1W-o5D6dbK_drTO1b0n3ckIF3AhNSPb_OfOTOAzQS7Igy6oKpye8tz1HA0M May 10 21:45:22.155784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:45:22.155784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:45:22.155784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:45:22.155784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:45:22.155784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:45:22.155784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:45:22.155784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: e84b33f24f6d4a46b1e5ee4ed74ed39e May 10 21:45:22.155784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-VolumesActionsTest-1684518181 May 10 21:45:22.155784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:45:22.155784 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:45:22.157694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e84b33f24f6d4a46b1e5ee4ed74ed39e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e84b33f24f6d4a46b1e5ee4ed74ed39e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e84b33f24f6d4a46b1e5ee4ed74ed39e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e84b33f24f6d4a46b1e5ee4ed74ed39e", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:45:22.157694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-VolumesActionsTest-1684518181 May 10 21:45:22.157694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: e84b33f24f6d4a46b1e5ee4ed74ed39e May 10 21:45:22.157694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-VolumesActionsTest-1684518181 May 10 21:45:22.157694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-VolumesActionsTest-1684518181-project May 10 21:45:22.157694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:45:22.157694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:45:22.157694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 0a0c9edad1444469a9a31988ac49730f May 10 21:45:22.157694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-VolumesActionsTest-1684518181-project May 10 21:45:22.157694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:45:22.157694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance 2c48ebaf-655b-4b2e-a141-a68c9e026c96 could not be found. May 10 21:45:22.157694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': '2c48ebaf-655b-4b2e-a141-a68c9e026c96'} May 10 21:45:22.158861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:45:22.158861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:22.158861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:45:22.158861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:45:22.158861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:45:22.158861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:45:22.158861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:45:22.158861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:45:22.158861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:45:22.158861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:45:22.158861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c48ebaf-655b-4b2e-a141-a68c9e026c96 could not be found. May 10 21:45:22.158861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:22.158861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:45:22.158861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:22.158861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:22.158861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:45:22.158861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:45:22.158861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:45:22.158861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:45:22.158861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:45:22.161358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:45:22.161358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:45:22.161358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:45:22.161358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:45:22.161358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:45:22.161358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:45:22.161358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:45:22.161358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c48ebaf-655b-4b2e-a141-a68c9e026c96 could not be found. May 10 21:45:22.161358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:22.161358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:45:22.161358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:22.161358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:22.161358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:45:22.161358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:45:22.161358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:45:22.161358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:45:22.161358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c48ebaf-655b-4b2e-a141-a68c9e026c96 could not be found. May 10 21:45:22.161358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:22.162973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0577f40d-aead-4d23-9b63-2a4ad1036515 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Returning 404 to user: Instance 2c48ebaf-655b-4b2e-a141-a68c9e026c96 could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:45:22.162973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0577f40d-aead-4d23-9b63-2a4ad1036515 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96" status: 404 len: 111 microversion: 2.1 time: 0.029202 May 10 21:45:22.162973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2799/3575] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:22 2022] GET /compute/v2.1/servers/2c48ebaf-655b-4b2e-a141-a68c9e026c96 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 21:45:22.256178 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1a70352e-9f21-4db9-862c-0cabf672ecc4 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-863748921", "imageRef": "cb321ccf-1ce7-4dda-90d0-f05332eb6fe1", "flavorRef": "452", "networks": [{"uuid": "4f584610-52e7-42d8-8e6a-f2c0e47df726"}]}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:45:22.309321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.network.neutron [None req-1a70352e-9f21-4db9-862c-0cabf672ecc4 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] validate_networks() for [('4f584610-52e7-42d8-8e6a-f2c0e47df726', None, None, None, None, None)] {{(pid=117714) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:45:22.900395 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-1a70352e-9f21-4db9-862c-0cabf672ecc4 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Flavor limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:45:22.900817 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-1a70352e-9f21-4db9-862c-0cabf672ecc4 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Image limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:45:22.901290 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-1a70352e-9f21-4db9-862c-0cabf672ecc4 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Flavor pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:45:22.901696 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-1a70352e-9f21-4db9-862c-0cabf672ecc4 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Image pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:45:22.902103 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-1a70352e-9f21-4db9-862c-0cabf672ecc4 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:45:22.911435 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1a70352e-9f21-4db9-862c-0cabf672ecc4 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:22.911881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1a70352e-9f21-4db9-862c-0cabf672ecc4 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:22.912694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1a70352e-9f21-4db9-862c-0cabf672ecc4 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:22.913125 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1a70352e-9f21-4db9-862c-0cabf672ecc4 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:22.928866 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-1a70352e-9f21-4db9-862c-0cabf672ecc4 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Getting quotas for project e84b33f24f6d4a46b1e5ee4ed74ed39e. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:45:22.932806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-1a70352e-9f21-4db9-862c-0cabf672ecc4 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Getting quotas for user 0a0c9edad1444469a9a31988ac49730f and project e84b33f24f6d4a46b1e5ee4ed74ed39e. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:45:22.943921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1a70352e-9f21-4db9-862c-0cabf672ecc4 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Going to run 1 instances... {{(pid=117714) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:45:22.946155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1a70352e-9f21-4db9-862c-0cabf672ecc4 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 03ade262-9711-4288-87e3-296276034296] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb321ccf-1ce7-4dda-90d0-f05332eb6fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117714) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:45:23.083216 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1a70352e-9f21-4db9-862c-0cabf672ecc4 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.831468 May 10 21:45:23.083794 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2800/3576] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 21:45:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 21:45:23.089465 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d479f596-6c59-4996-8d9f-d9ee9366dcf7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:23.090004 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d479f596-6c59-4996-8d9f-d9ee9366dcf7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: d43e9057-6151-4874-bf54-cacf91b0d7bc] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:23.096227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d479f596-6c59-4996-8d9f-d9ee9366dcf7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:23.096796 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d479f596-6c59-4996-8d9f-d9ee9366dcf7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:23.097589 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d479f596-6c59-4996-8d9f-d9ee9366dcf7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:23.098025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d479f596-6c59-4996-8d9f-d9ee9366dcf7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:23.179296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.objects.instance [None req-d479f596-6c59-4996-8d9f-d9ee9366dcf7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lazy-loading 'services' on Instance uuid d43e9057-6151-4874-bf54-cacf91b0d7bc {{(pid=117714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:45:23.576875 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d479f596-6c59-4996-8d9f-d9ee9366dcf7 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc/os-volume_attachments/0bf01c94-0e2a-4555-9072-43156a0491a6" status: 202 len: 0 microversion: 2.1 time: 0.491164 May 10 21:45:23.577499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2801/3577] 10.222.0.49 () {58 vars in 1415 bytes} [Tue May 10 21:45:23 2022] DELETE /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc/os-volume_attachments/0bf01c94-0e2a-4555-9072-43156a0491a6 => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 21:45:23.582651 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8e40111a-337a-4e9e-a69d-6b5b2008238e tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:23.583381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8e40111a-337a-4e9e-a69d-6b5b2008238e tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 03ade262-9711-4288-87e3-296276034296] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:23.642064 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8e40111a-337a-4e9e-a69d-6b5b2008238e tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0c9edad1444469a9a31988ac49730f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:23.649203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8e40111a-337a-4e9e-a69d-6b5b2008238e tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296" status: 200 len: 1213 microversion: 2.1 time: 0.070516 May 10 21:45:23.649777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2802/3578] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:23 2022] GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296 => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:45:23.654590 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bec653d7-67d0-489f-aaf4-87b8aab8a3fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:23.655596 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bec653d7-67d0-489f-aaf4-87b8aab8a3fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: d43e9057-6151-4874-bf54-cacf91b0d7bc] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:23.662426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bec653d7-67d0-489f-aaf4-87b8aab8a3fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:23.663031 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bec653d7-67d0-489f-aaf4-87b8aab8a3fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:23.663876 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bec653d7-67d0-489f-aaf4-87b8aab8a3fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:23.664501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bec653d7-67d0-489f-aaf4-87b8aab8a3fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:23.696863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bec653d7-67d0-489f-aaf4-87b8aab8a3fe tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045697 May 10 21:45:23.700823 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2803/3579] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:45:23 2022] GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:45:24.665469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b4dc96eb-ca51-415f-9f51-d4e30555d732 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:24.666171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b4dc96eb-ca51-415f-9f51-d4e30555d732 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 03ade262-9711-4288-87e3-296276034296] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:24.672581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b4dc96eb-ca51-415f-9f51-d4e30555d732 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:24.673030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b4dc96eb-ca51-415f-9f51-d4e30555d732 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:24.673793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b4dc96eb-ca51-415f-9f51-d4e30555d732 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:24.674230 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b4dc96eb-ca51-415f-9f51-d4e30555d732 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:24.735491 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b4dc96eb-ca51-415f-9f51-d4e30555d732 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0c9edad1444469a9a31988ac49730f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:24.743857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b4dc96eb-ca51-415f-9f51-d4e30555d732 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296" status: 200 len: 1265 microversion: 2.1 time: 0.082297 May 10 21:45:24.744435 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2804/3580] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:24 2022] GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296 => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:45:24.748981 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ace4c798-552b-4210-811a-383a301365b3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:24.749899 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ace4c798-552b-4210-811a-383a301365b3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: d43e9057-6151-4874-bf54-cacf91b0d7bc] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:24.756457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ace4c798-552b-4210-811a-383a301365b3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:24.756909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ace4c798-552b-4210-811a-383a301365b3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:24.757680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ace4c798-552b-4210-811a-383a301365b3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:24.758148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ace4c798-552b-4210-811a-383a301365b3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:24.789428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ace4c798-552b-4210-811a-383a301365b3 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043906 May 10 21:45:24.790030 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2805/3581] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:45:24 2022] GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 21:45:24.853695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-91259985-019f-4768-8e05-b8125a44c0cb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:24.854333 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-91259985-019f-4768-8e05-b8125a44c0cb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: d43e9057-6151-4874-bf54-cacf91b0d7bc] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:24.860301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91259985-019f-4768-8e05-b8125a44c0cb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:24.860835 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91259985-019f-4768-8e05-b8125a44c0cb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:24.861618 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91259985-019f-4768-8e05-b8125a44c0cb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:24.862062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91259985-019f-4768-8e05-b8125a44c0cb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:24.889249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-91259985-019f-4768-8e05-b8125a44c0cb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: d43e9057-6151-4874-bf54-cacf91b0d7bc] Going to try to terminate instance {{(pid=117714) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:45:25.194636 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-91259985-019f-4768-8e05-b8125a44c0cb tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc" status: 204 len: 0 microversion: 2.1 time: 0.344541 May 10 21:45:25.198616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2806/3582] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 21:45:24 2022] DELETE /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 21:45:25.203993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ab57ff62-5d1d-46b1-bfe0-451072f14d2a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:25.204704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ab57ff62-5d1d-46b1-bfe0-451072f14d2a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: d43e9057-6151-4874-bf54-cacf91b0d7bc] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:25.211395 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab57ff62-5d1d-46b1-bfe0-451072f14d2a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:25.212318 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab57ff62-5d1d-46b1-bfe0-451072f14d2a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:25.212605 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab57ff62-5d1d-46b1-bfe0-451072f14d2a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:25.213048 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ab57ff62-5d1d-46b1-bfe0-451072f14d2a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:25.353690 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ab57ff62-5d1d-46b1-bfe0-451072f14d2a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:25.361377 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ab57ff62-5d1d-46b1-bfe0-451072f14d2a tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc" status: 200 len: 1681 microversion: 2.1 time: 0.161509 May 10 21:45:25.361953 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2807/3583] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:25 2022] GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:45:25.761021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-46aa93b0-2aa5-41ae-93d1-2754bffbadbe tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:25.761686 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-46aa93b0-2aa5-41ae-93d1-2754bffbadbe tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 03ade262-9711-4288-87e3-296276034296] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:25.768094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-46aa93b0-2aa5-41ae-93d1-2754bffbadbe tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:25.768550 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-46aa93b0-2aa5-41ae-93d1-2754bffbadbe tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:25.769834 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-46aa93b0-2aa5-41ae-93d1-2754bffbadbe tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:25.770747 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-46aa93b0-2aa5-41ae-93d1-2754bffbadbe tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:25.899801 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-46aa93b0-2aa5-41ae-93d1-2754bffbadbe tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0c9edad1444469a9a31988ac49730f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:25.907226 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-46aa93b0-2aa5-41ae-93d1-2754bffbadbe tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296" status: 200 len: 1313 microversion: 2.1 time: 0.150033 May 10 21:45:25.907789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2808/3584] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:25 2022] GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:45:26.380489 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-32728a9a-5843-4128-b958-0d43b6a7dd7f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:26.380810 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-32728a9a-5843-4128-b958-0d43b6a7dd7f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: d43e9057-6151-4874-bf54-cacf91b0d7bc] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:26.387137 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-32728a9a-5843-4128-b958-0d43b6a7dd7f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:26.388184 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-32728a9a-5843-4128-b958-0d43b6a7dd7f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:26.388804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-32728a9a-5843-4128-b958-0d43b6a7dd7f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:26.389252 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-32728a9a-5843-4128-b958-0d43b6a7dd7f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:26.527070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-32728a9a-5843-4128-b958-0d43b6a7dd7f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:26.534616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-32728a9a-5843-4128-b958-0d43b6a7dd7f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc" status: 200 len: 1681 microversion: 2.1 time: 0.159230 May 10 21:45:26.535669 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2809/3585] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:26 2022] GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:45:26.926389 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9a7fdd1f-9623-4db5-be38-d3d09c2260c3 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:26.928060 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9a7fdd1f-9623-4db5-be38-d3d09c2260c3 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 03ade262-9711-4288-87e3-296276034296] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:26.935349 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9a7fdd1f-9623-4db5-be38-d3d09c2260c3 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:26.935754 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9a7fdd1f-9623-4db5-be38-d3d09c2260c3 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:26.936538 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9a7fdd1f-9623-4db5-be38-d3d09c2260c3 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:26.936982 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9a7fdd1f-9623-4db5-be38-d3d09c2260c3 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:27.168195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9a7fdd1f-9623-4db5-be38-d3d09c2260c3 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0c9edad1444469a9a31988ac49730f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:27.178566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9a7fdd1f-9623-4db5-be38-d3d09c2260c3 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296" status: 200 len: 1313 microversion: 2.1 time: 0.256729 May 10 21:45:27.187246 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2810/3586] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:26 2022] GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:45:27.311710 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-de85378d-4de5-4105-962f-5236363ce1b6 req-68527aa0-974d-497f-a4b1-4611186087f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03ade262-9711-4288-87e3-296276034296", "tag": "b2c472bd-837d-4551-85fe-61e1e34450a4"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:45:27.320381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-de85378d-4de5-4105-962f-5236363ce1b6 req-68527aa0-974d-497f-a4b1-4611186087f0 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:27.320833 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-de85378d-4de5-4105-962f-5236363ce1b6 req-68527aa0-974d-497f-a4b1-4611186087f0 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:27.332620 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-de85378d-4de5-4105-962f-5236363ce1b6 req-68527aa0-974d-497f-a4b1-4611186087f0 service nova] Creating event network-changed:b2c472bd-837d-4551-85fe-61e1e34450a4 for instance 03ade262-9711-4288-87e3-296276034296 on hv-cinder-82880 May 10 21:45:27.338336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-de85378d-4de5-4105-962f-5236363ce1b6 req-68527aa0-974d-497f-a4b1-4611186087f0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157420 May 10 21:45:27.339062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2811/3587] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:45:27.559779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-58c35860-8411-4efb-918f-1cada4601d4d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:27.561239 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-58c35860-8411-4efb-918f-1cada4601d4d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: d43e9057-6151-4874-bf54-cacf91b0d7bc] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:27.570761 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-58c35860-8411-4efb-918f-1cada4601d4d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:27.571488 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-58c35860-8411-4efb-918f-1cada4601d4d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:27.572432 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-58c35860-8411-4efb-918f-1cada4601d4d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:27.573070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-58c35860-8411-4efb-918f-1cada4601d4d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:27.685092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-58c35860-8411-4efb-918f-1cada4601d4d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:27.693743 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-58c35860-8411-4efb-918f-1cada4601d4d tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc" status: 200 len: 1614 microversion: 2.1 time: 0.145419 May 10 21:45:27.694357 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2812/3588] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:27 2022] GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc => generated 1614 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:45:27.870330 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-17e6b7ba-161f-4aff-b1ab-3dcf57bdf96d req-0b3cc113-01cd-4708-9fd9-c75726285bce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d43e9057-6151-4874-bf54-cacf91b0d7bc", "name": "network-vif-deleted", "tag": "b601c84b-c3bf-4921-859a-92a0aaefdc8f"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:45:27.878223 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-17e6b7ba-161f-4aff-b1ab-3dcf57bdf96d req-0b3cc113-01cd-4708-9fd9-c75726285bce service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:27.879372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-17e6b7ba-161f-4aff-b1ab-3dcf57bdf96d req-0b3cc113-01cd-4708-9fd9-c75726285bce service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:27.890923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-17e6b7ba-161f-4aff-b1ab-3dcf57bdf96d req-0b3cc113-01cd-4708-9fd9-c75726285bce service nova] Creating event network-vif-deleted:b601c84b-c3bf-4921-859a-92a0aaefdc8f for instance d43e9057-6151-4874-bf54-cacf91b0d7bc on hv-cinder-82880 May 10 21:45:27.896788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-17e6b7ba-161f-4aff-b1ab-3dcf57bdf96d req-0b3cc113-01cd-4708-9fd9-c75726285bce service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030519 May 10 21:45:27.897584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2813/3589] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:45:28.198763 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5ac1d596-88b8-484c-9908-664abd15c3ad tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:28.199473 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5ac1d596-88b8-484c-9908-664abd15c3ad tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 03ade262-9711-4288-87e3-296276034296] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:28.205693 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ac1d596-88b8-484c-9908-664abd15c3ad tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:28.206138 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ac1d596-88b8-484c-9908-664abd15c3ad tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:28.207023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ac1d596-88b8-484c-9908-664abd15c3ad tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:28.207729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5ac1d596-88b8-484c-9908-664abd15c3ad tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:28.341898 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5ac1d596-88b8-484c-9908-664abd15c3ad tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0c9edad1444469a9a31988ac49730f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:28.350005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5ac1d596-88b8-484c-9908-664abd15c3ad tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296" status: 200 len: 1313 microversion: 2.1 time: 0.156963 May 10 21:45:28.350574 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2814/3590] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:28 2022] GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:45:28.712473 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b6cb8b3a-4f7a-442f-8c97-0fb188681c2e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:28.713254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b6cb8b3a-4f7a-442f-8c97-0fb188681c2e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: d43e9057-6151-4874-bf54-cacf91b0d7bc] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:28.720029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b6cb8b3a-4f7a-442f-8c97-0fb188681c2e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:28.720558 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b6cb8b3a-4f7a-442f-8c97-0fb188681c2e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:28.721399 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b6cb8b3a-4f7a-442f-8c97-0fb188681c2e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:28.722077 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b6cb8b3a-4f7a-442f-8c97-0fb188681c2e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:28.814582 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b6cb8b3a-4f7a-442f-8c97-0fb188681c2e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bc5605a22d408f9b4bac69a0f5f486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9582743483fa4fb88f4e91d3f787c945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:28.822944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b6cb8b3a-4f7a-442f-8c97-0fb188681c2e tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc" status: 200 len: 1326 microversion: 2.1 time: 0.115877 May 10 21:45:28.823934 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2815/3591] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:28 2022] GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc => generated 1326 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:45:29.367135 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-038aafbe-b2e7-48c9-a1a6-324f4001386b tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:29.367832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-038aafbe-b2e7-48c9-a1a6-324f4001386b tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 03ade262-9711-4288-87e3-296276034296] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:29.374125 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-038aafbe-b2e7-48c9-a1a6-324f4001386b tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:29.374578 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-038aafbe-b2e7-48c9-a1a6-324f4001386b tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:29.375399 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-038aafbe-b2e7-48c9-a1a6-324f4001386b tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:29.375844 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-038aafbe-b2e7-48c9-a1a6-324f4001386b tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:29.510655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-038aafbe-b2e7-48c9-a1a6-324f4001386b tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0c9edad1444469a9a31988ac49730f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:29.518051 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-038aafbe-b2e7-48c9-a1a6-324f4001386b tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296" status: 200 len: 1313 microversion: 2.1 time: 0.155258 May 10 21:45:29.518620 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2816/3592] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:29 2022] GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:45:29.840585 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ec113f29-83eb-4f42-80d0-b559dfac03b9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:29.841197 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ec113f29-83eb-4f42-80d0-b559dfac03b9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: d43e9057-6151-4874-bf54-cacf91b0d7bc] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:29.847921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec113f29-83eb-4f42-80d0-b559dfac03b9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:29.848392 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec113f29-83eb-4f42-80d0-b559dfac03b9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:29.849121 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec113f29-83eb-4f42-80d0-b559dfac03b9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:29.849549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ec113f29-83eb-4f42-80d0-b559dfac03b9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:29.864851 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-ec113f29-83eb-4f42-80d0-b559dfac03b9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] HTTP exception thrown: Instance d43e9057-6151-4874-bf54-cacf91b0d7bc could not be found. May 10 21:45:29.866462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ec113f29-83eb-4f42-80d0-b559dfac03b9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Request method failure captured: May 10 21:45:29.866462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc HTTP/1.1 May 10 21:45:29.866462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:45:29.866462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:45:29.866462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:45:29.866462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:45:29.866462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:45:29.866462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:45:29.866462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:45:29.866462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:45:29.866462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietSE5zX3cUzqYcL4439JiFsqE4YiilwKjmw-zwJrvzsKCKk2V0t2rgnfCfWB9fMDqHcwDYx66Osidv5Nb3ivvjsId3P0K5BlinPK-pYoxdKcKRbo0A46AEZFFXEAkT7Vt_ZFHlOxIkEow-5P_dpFvNFYY0aq5XGlXkN1VnlT95XyJvw May 10 21:45:29.866462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:45:29.866462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:45:29.866462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:45:29.866462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:45:29.866462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:45:29.866462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:45:29.866462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 9582743483fa4fb88f4e91d3f787c945 May 10 21:45:29.866462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-AttachVolumeNegativeTest-297208105 May 10 21:45:29.866462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:45:29.866462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:45:29.868358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9582743483fa4fb88f4e91d3f787c945", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:45:29.868358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-AttachVolumeNegativeTest-297208105 May 10 21:45:29.868358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 9582743483fa4fb88f4e91d3f787c945 May 10 21:45:29.868358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-297208105 May 10 21:45:29.868358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-AttachVolumeNegativeTest-297208105-project May 10 21:45:29.868358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:45:29.868358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:45:29.868358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 62bc5605a22d408f9b4bac69a0f5f486 May 10 21:45:29.868358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-AttachVolumeNegativeTest-297208105-project May 10 21:45:29.868358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:45:29.868358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance d43e9057-6151-4874-bf54-cacf91b0d7bc could not be found. May 10 21:45:29.868358 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': 'd43e9057-6151-4874-bf54-cacf91b0d7bc'} May 10 21:45:29.869391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:45:29.869391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:29.869391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:45:29.869391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:45:29.869391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:45:29.869391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:45:29.869391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:45:29.869391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:45:29.869391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:45:29.869391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:45:29.869391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d43e9057-6151-4874-bf54-cacf91b0d7bc could not be found. May 10 21:45:29.869391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:29.869391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:45:29.869391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:29.869391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:29.869391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:45:29.869391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:45:29.869391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:45:29.869391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:45:29.869391 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:45:29.871177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:45:29.871177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:45:29.871177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:45:29.871177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:45:29.871177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:45:29.871177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:45:29.871177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:45:29.871177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d43e9057-6151-4874-bf54-cacf91b0d7bc could not be found. May 10 21:45:29.871177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:29.871177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:45:29.871177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:29.871177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:29.871177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:45:29.871177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:45:29.871177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:45:29.871177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:45:29.871177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d43e9057-6151-4874-bf54-cacf91b0d7bc could not be found. May 10 21:45:29.871177 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:29.872723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ec113f29-83eb-4f42-80d0-b559dfac03b9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Returning 404 to user: Instance d43e9057-6151-4874-bf54-cacf91b0d7bc could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:45:29.872723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ec113f29-83eb-4f42-80d0-b559dfac03b9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc" status: 404 len: 111 microversion: 2.1 time: 0.031124 May 10 21:45:29.872723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2817/3593] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:29 2022] GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 21:45:29.876212 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2ef1f671-24b1-4540-a7f4-adb57e19bff8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '.version_select at 0x7f85d54f19d0>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:29.967488 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2ef1f671-24b1-4540-a7f4-adb57e19bff8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1687651556" status: 202 len: 0 microversion: 2.1 time: 0.094582 May 10 21:45:29.968072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2818/3594] 10.222.0.49 () {58 vars in 1220 bytes} [Tue May 10 21:45:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1687651556 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 21:45:30.536625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bcb88b4d-350f-4b6e-a484-9078d565f4bd tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:30.537410 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bcb88b4d-350f-4b6e-a484-9078d565f4bd tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 03ade262-9711-4288-87e3-296276034296] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:30.544033 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bcb88b4d-350f-4b6e-a484-9078d565f4bd tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:30.544479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bcb88b4d-350f-4b6e-a484-9078d565f4bd tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:30.545260 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bcb88b4d-350f-4b6e-a484-9078d565f4bd tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:30.545698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bcb88b4d-350f-4b6e-a484-9078d565f4bd tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:30.692869 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bcb88b4d-350f-4b6e-a484-9078d565f4bd tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0c9edad1444469a9a31988ac49730f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:30.700404 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bcb88b4d-350f-4b6e-a484-9078d565f4bd tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296" status: 200 len: 1313 microversion: 2.1 time: 0.169282 May 10 21:45:30.700980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2819/3595] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:30 2022] GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:45:31.717331 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-20230c2d-fc3c-4754-800b-9b912fb0766c tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:31.718014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-20230c2d-fc3c-4754-800b-9b912fb0766c tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 03ade262-9711-4288-87e3-296276034296] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:31.725169 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20230c2d-fc3c-4754-800b-9b912fb0766c tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:31.725617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20230c2d-fc3c-4754-800b-9b912fb0766c tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:31.726375 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20230c2d-fc3c-4754-800b-9b912fb0766c tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:31.726817 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-20230c2d-fc3c-4754-800b-9b912fb0766c tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:31.854209 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-20230c2d-fc3c-4754-800b-9b912fb0766c tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0c9edad1444469a9a31988ac49730f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:31.861463 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-20230c2d-fc3c-4754-800b-9b912fb0766c tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296" status: 200 len: 1313 microversion: 2.1 time: 0.148034 May 10 21:45:31.862027 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2820/3596] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:31 2022] GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:45:32.167534 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-831e7dd0-a929-4dbe-9f09-03898b730a14 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:32.168065 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-831e7dd0-a929-4dbe-9f09-03898b730a14 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: d43e9057-6151-4874-bf54-cacf91b0d7bc] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:32.173972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-831e7dd0-a929-4dbe-9f09-03898b730a14 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:32.174423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-831e7dd0-a929-4dbe-9f09-03898b730a14 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:32.175224 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-831e7dd0-a929-4dbe-9f09-03898b730a14 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:32.175834 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-831e7dd0-a929-4dbe-9f09-03898b730a14 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:32.188844 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-831e7dd0-a929-4dbe-9f09-03898b730a14 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] HTTP exception thrown: Instance d43e9057-6151-4874-bf54-cacf91b0d7bc could not be found. May 10 21:45:32.190413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-831e7dd0-a929-4dbe-9f09-03898b730a14 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Request method failure captured: May 10 21:45:32.190413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: DELETE /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc HTTP/1.1 May 10 21:45:32.190413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:45:32.190413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:45:32.190413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:45:32.190413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:45:32.190413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:45:32.190413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:45:32.190413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:45:32.190413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:45:32.190413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietSE5zX3cUzqYcL4439JiFsqE4YiilwKjmw-zwJrvzsKCKk2V0t2rgnfCfWB9fMDqHcwDYx66Osidv5Nb3ivvjsId3P0K5BlinPK-pYoxdKcKRbo0A46AEZFFXEAkT7Vt_ZFHlOxIkEow-5P_dpFvNFYY0aq5XGlXkN1VnlT95XyJvw May 10 21:45:32.190413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:45:32.190413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:45:32.190413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:45:32.190413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:45:32.190413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:45:32.190413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:45:32.190413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 9582743483fa4fb88f4e91d3f787c945 May 10 21:45:32.190413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-AttachVolumeNegativeTest-297208105 May 10 21:45:32.190413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:45:32.190413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:45:32.193301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9582743483fa4fb88f4e91d3f787c945", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:45:32.193301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-AttachVolumeNegativeTest-297208105 May 10 21:45:32.193301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 9582743483fa4fb88f4e91d3f787c945 May 10 21:45:32.193301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-297208105 May 10 21:45:32.193301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-AttachVolumeNegativeTest-297208105-project May 10 21:45:32.193301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:45:32.193301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:45:32.193301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 62bc5605a22d408f9b4bac69a0f5f486 May 10 21:45:32.193301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-AttachVolumeNegativeTest-297208105-project May 10 21:45:32.193301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:45:32.193301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance d43e9057-6151-4874-bf54-cacf91b0d7bc could not be found. May 10 21:45:32.193301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': 'd43e9057-6151-4874-bf54-cacf91b0d7bc'} May 10 21:45:32.194416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:45:32.194416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:32.194416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:45:32.194416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:45:32.194416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:45:32.194416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:45:32.194416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:45:32.194416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:45:32.194416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:45:32.194416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:45:32.194416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d43e9057-6151-4874-bf54-cacf91b0d7bc could not be found. May 10 21:45:32.194416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:32.194416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:45:32.194416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:32.194416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:32.194416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:45:32.194416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:45:32.194416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:45:32.194416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:45:32.194416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:45:32.196094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:45:32.196094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 21:45:32.196094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 21:45:32.196094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 21:45:32.196094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 21:45:32.196094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:45:32.196094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:45:32.196094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:45:32.196094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:45:32.196094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d43e9057-6151-4874-bf54-cacf91b0d7bc could not be found. May 10 21:45:32.196094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:32.196094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:45:32.196094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:32.196094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:32.196094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:45:32.196094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:45:32.196094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:45:32.196094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:45:32.196094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d43e9057-6151-4874-bf54-cacf91b0d7bc could not be found. May 10 21:45:32.196094 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:32.197756 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-831e7dd0-a929-4dbe-9f09-03898b730a14 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Returning 404 to user: Instance d43e9057-6151-4874-bf54-cacf91b0d7bc could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:45:32.197756 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-831e7dd0-a929-4dbe-9f09-03898b730a14 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc" status: 404 len: 111 microversion: 2.1 time: 0.028722 May 10 21:45:32.197756 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2821/3597] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 21:45:32 2022] DELETE /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 21:45:32.200206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9f8b8633-8542-4bab-9e3d-e10e4ed714d4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:32.200813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9f8b8633-8542-4bab-9e3d-e10e4ed714d4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: d43e9057-6151-4874-bf54-cacf91b0d7bc] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:32.206447 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9f8b8633-8542-4bab-9e3d-e10e4ed714d4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:32.207701 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9f8b8633-8542-4bab-9e3d-e10e4ed714d4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:32.208473 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9f8b8633-8542-4bab-9e3d-e10e4ed714d4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:32.208919 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9f8b8633-8542-4bab-9e3d-e10e4ed714d4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:32.222099 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-9f8b8633-8542-4bab-9e3d-e10e4ed714d4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] HTTP exception thrown: Instance d43e9057-6151-4874-bf54-cacf91b0d7bc could not be found. May 10 21:45:32.224143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9f8b8633-8542-4bab-9e3d-e10e4ed714d4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Request method failure captured: May 10 21:45:32.224143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc HTTP/1.1 May 10 21:45:32.224143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:45:32.224143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:45:32.224143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:45:32.224143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:45:32.224143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:45:32.224143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:45:32.224143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:45:32.224143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:45:32.224143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietSE5zX3cUzqYcL4439JiFsqE4YiilwKjmw-zwJrvzsKCKk2V0t2rgnfCfWB9fMDqHcwDYx66Osidv5Nb3ivvjsId3P0K5BlinPK-pYoxdKcKRbo0A46AEZFFXEAkT7Vt_ZFHlOxIkEow-5P_dpFvNFYY0aq5XGlXkN1VnlT95XyJvw May 10 21:45:32.224143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:45:32.224143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:45:32.224143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:45:32.224143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:45:32.224143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:45:32.224143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:45:32.224143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 9582743483fa4fb88f4e91d3f787c945 May 10 21:45:32.224143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-AttachVolumeNegativeTest-297208105 May 10 21:45:32.224143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:45:32.224143 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:45:32.225910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9582743483fa4fb88f4e91d3f787c945", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:45:32.225910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-AttachVolumeNegativeTest-297208105 May 10 21:45:32.225910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 9582743483fa4fb88f4e91d3f787c945 May 10 21:45:32.225910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-297208105 May 10 21:45:32.225910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-AttachVolumeNegativeTest-297208105-project May 10 21:45:32.225910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:45:32.225910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:45:32.225910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 62bc5605a22d408f9b4bac69a0f5f486 May 10 21:45:32.225910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-AttachVolumeNegativeTest-297208105-project May 10 21:45:32.225910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:45:32.225910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance d43e9057-6151-4874-bf54-cacf91b0d7bc could not be found. May 10 21:45:32.225910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': 'd43e9057-6151-4874-bf54-cacf91b0d7bc'} May 10 21:45:32.226988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:45:32.226988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:32.226988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:45:32.226988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:45:32.226988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:45:32.226988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:45:32.226988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:45:32.226988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:45:32.226988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:45:32.226988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:45:32.226988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d43e9057-6151-4874-bf54-cacf91b0d7bc could not be found. May 10 21:45:32.226988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:32.226988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:45:32.226988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:32.226988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:32.226988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:45:32.226988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:45:32.226988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:45:32.226988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:45:32.226988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:45:32.228729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:45:32.228729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:45:32.228729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:45:32.228729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:45:32.228729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:45:32.228729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:45:32.228729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:45:32.228729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d43e9057-6151-4874-bf54-cacf91b0d7bc could not be found. May 10 21:45:32.228729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:32.228729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:45:32.228729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:32.228729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:32.228729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:45:32.228729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:45:32.228729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:45:32.228729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:45:32.228729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d43e9057-6151-4874-bf54-cacf91b0d7bc could not be found. May 10 21:45:32.228729 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:32.230654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9f8b8633-8542-4bab-9e3d-e10e4ed714d4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Returning 404 to user: Instance d43e9057-6151-4874-bf54-cacf91b0d7bc could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:45:32.230654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9f8b8633-8542-4bab-9e3d-e10e4ed714d4 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc" status: 404 len: 111 microversion: 2.1 time: 0.028318 May 10 21:45:32.230654 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2822/3598] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:32 2022] GET /compute/v2.1/servers/d43e9057-6151-4874-bf54-cacf91b0d7bc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 21:45:32.878847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3ae8b82f-13df-496a-9d2f-020b77b01921 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:32.879623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3ae8b82f-13df-496a-9d2f-020b77b01921 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 03ade262-9711-4288-87e3-296276034296] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:32.886005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ae8b82f-13df-496a-9d2f-020b77b01921 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:32.886460 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ae8b82f-13df-496a-9d2f-020b77b01921 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:32.887250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ae8b82f-13df-496a-9d2f-020b77b01921 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:32.887694 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3ae8b82f-13df-496a-9d2f-020b77b01921 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:33.024393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3ae8b82f-13df-496a-9d2f-020b77b01921 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0c9edad1444469a9a31988ac49730f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:33.031805 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3ae8b82f-13df-496a-9d2f-020b77b01921 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296" status: 200 len: 1313 microversion: 2.1 time: 0.157025 May 10 21:45:33.032371 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2823/3599] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:32 2022] GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:45:33.222013 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-0518476f-a72f-48ea-94eb-fe119a2a9cf1 req-9800641d-f7ee-4cdb-9e23-a0b42a9aec77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03ade262-9711-4288-87e3-296276034296", "name": "network-vif-plugged", "status": "completed", "tag": "b2c472bd-837d-4551-85fe-61e1e34450a4"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:45:33.230015 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-0518476f-a72f-48ea-94eb-fe119a2a9cf1 req-9800641d-f7ee-4cdb-9e23-a0b42a9aec77 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:33.230459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-0518476f-a72f-48ea-94eb-fe119a2a9cf1 req-9800641d-f7ee-4cdb-9e23-a0b42a9aec77 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:33.241812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-0518476f-a72f-48ea-94eb-fe119a2a9cf1 req-9800641d-f7ee-4cdb-9e23-a0b42a9aec77 service nova] Creating event network-vif-plugged:b2c472bd-837d-4551-85fe-61e1e34450a4 for instance 03ade262-9711-4288-87e3-296276034296 on hv-cinder-82880 May 10 21:45:33.246628 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-0518476f-a72f-48ea-94eb-fe119a2a9cf1 req-9800641d-f7ee-4cdb-9e23-a0b42a9aec77 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028696 May 10 21:45:33.247233 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2824/3600] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:45:33.507236 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a7aef3c1-46e8-44c2-9ff0-6556c9340b51 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:33.507927 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a7aef3c1-46e8-44c2-9ff0-6556c9340b51 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4674fb54-efa1-4bed-a2a2-49f3b1184874] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:33.514423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a7aef3c1-46e8-44c2-9ff0-6556c9340b51 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:33.514873 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a7aef3c1-46e8-44c2-9ff0-6556c9340b51 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:33.515690 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a7aef3c1-46e8-44c2-9ff0-6556c9340b51 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:33.516133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a7aef3c1-46e8-44c2-9ff0-6556c9340b51 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:33.530438 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-a7aef3c1-46e8-44c2-9ff0-6556c9340b51 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] HTTP exception thrown: Instance 4674fb54-efa1-4bed-a2a2-49f3b1184874 could not be found. May 10 21:45:33.532148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a7aef3c1-46e8-44c2-9ff0-6556c9340b51 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Request method failure captured: May 10 21:45:33.532148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: DELETE /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874 HTTP/1.1 May 10 21:45:33.532148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:45:33.532148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:45:33.532148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:45:33.532148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:45:33.532148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:45:33.532148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:45:33.532148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:45:33.532148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:45:33.532148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietSE5zX3cUzqYcL4439JiFsqE4YiilwKjmw-zwJrvzsKCKk2V0t2rgnfCfWB9fMDqHcwDYx66Osidv5Nb3ivvjsId3P0K5BlinPK-pYoxdKcKRbo0A46AEZFFXEAkT7Vt_ZFHlOxIkEow-5P_dpFvNFYY0aq5XGlXkN1VnlT95XyJvw May 10 21:45:33.532148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:45:33.532148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:45:33.532148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:45:33.532148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:45:33.532148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:45:33.532148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:45:33.532148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 9582743483fa4fb88f4e91d3f787c945 May 10 21:45:33.532148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-AttachVolumeNegativeTest-297208105 May 10 21:45:33.532148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:45:33.532148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:45:33.533996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9582743483fa4fb88f4e91d3f787c945", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:45:33.533996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-AttachVolumeNegativeTest-297208105 May 10 21:45:33.533996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 9582743483fa4fb88f4e91d3f787c945 May 10 21:45:33.533996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-297208105 May 10 21:45:33.533996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-AttachVolumeNegativeTest-297208105-project May 10 21:45:33.533996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:45:33.533996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:45:33.533996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 62bc5605a22d408f9b4bac69a0f5f486 May 10 21:45:33.533996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-AttachVolumeNegativeTest-297208105-project May 10 21:45:33.533996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:45:33.533996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance 4674fb54-efa1-4bed-a2a2-49f3b1184874 could not be found. May 10 21:45:33.533996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': '4674fb54-efa1-4bed-a2a2-49f3b1184874'} May 10 21:45:33.534951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:45:33.534951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:33.534951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:45:33.534951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:45:33.534951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:45:33.534951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:45:33.534951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:45:33.534951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:45:33.534951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:45:33.534951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:45:33.534951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4674fb54-efa1-4bed-a2a2-49f3b1184874 could not be found. May 10 21:45:33.534951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:33.534951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:45:33.534951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:33.534951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:33.534951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:45:33.534951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:45:33.534951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:45:33.534951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:45:33.534951 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:45:33.537186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:45:33.537186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 21:45:33.537186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 21:45:33.537186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 21:45:33.537186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 21:45:33.537186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:45:33.537186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:45:33.537186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:45:33.537186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:45:33.537186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4674fb54-efa1-4bed-a2a2-49f3b1184874 could not be found. May 10 21:45:33.537186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:33.537186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:45:33.537186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:33.537186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:33.537186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:45:33.537186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:45:33.537186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:45:33.537186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:45:33.537186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4674fb54-efa1-4bed-a2a2-49f3b1184874 could not be found. May 10 21:45:33.537186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:33.538731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a7aef3c1-46e8-44c2-9ff0-6556c9340b51 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Returning 404 to user: Instance 4674fb54-efa1-4bed-a2a2-49f3b1184874 could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:45:33.538731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a7aef3c1-46e8-44c2-9ff0-6556c9340b51 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874" status: 404 len: 111 microversion: 2.1 time: 0.031463 May 10 21:45:33.538731 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2825/3601] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 21:45:33 2022] DELETE /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:45:33.542158 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7ff6fbf3-780b-4a92-a71c-56d4bd47edd8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:33.542765 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7ff6fbf3-780b-4a92-a71c-56d4bd47edd8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4674fb54-efa1-4bed-a2a2-49f3b1184874] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:33.548764 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ff6fbf3-780b-4a92-a71c-56d4bd47edd8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:33.549214 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ff6fbf3-780b-4a92-a71c-56d4bd47edd8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:33.549977 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ff6fbf3-780b-4a92-a71c-56d4bd47edd8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:33.550408 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7ff6fbf3-780b-4a92-a71c-56d4bd47edd8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:33.564315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-7ff6fbf3-780b-4a92-a71c-56d4bd47edd8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] HTTP exception thrown: Instance 4674fb54-efa1-4bed-a2a2-49f3b1184874 could not be found. May 10 21:45:33.565877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7ff6fbf3-780b-4a92-a71c-56d4bd47edd8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Request method failure captured: May 10 21:45:33.565877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874 HTTP/1.1 May 10 21:45:33.565877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:45:33.565877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:45:33.565877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:45:33.565877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:45:33.565877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:45:33.565877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:45:33.565877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:45:33.565877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:45:33.565877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietSE5zX3cUzqYcL4439JiFsqE4YiilwKjmw-zwJrvzsKCKk2V0t2rgnfCfWB9fMDqHcwDYx66Osidv5Nb3ivvjsId3P0K5BlinPK-pYoxdKcKRbo0A46AEZFFXEAkT7Vt_ZFHlOxIkEow-5P_dpFvNFYY0aq5XGlXkN1VnlT95XyJvw May 10 21:45:33.565877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:45:33.565877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:45:33.565877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:45:33.565877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:45:33.565877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:45:33.565877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:45:33.565877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 9582743483fa4fb88f4e91d3f787c945 May 10 21:45:33.565877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-AttachVolumeNegativeTest-297208105 May 10 21:45:33.565877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:45:33.565877 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:45:33.568859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9582743483fa4fb88f4e91d3f787c945", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:45:33.568859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-AttachVolumeNegativeTest-297208105 May 10 21:45:33.568859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 9582743483fa4fb88f4e91d3f787c945 May 10 21:45:33.568859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-297208105 May 10 21:45:33.568859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-AttachVolumeNegativeTest-297208105-project May 10 21:45:33.568859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:45:33.568859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:45:33.568859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 62bc5605a22d408f9b4bac69a0f5f486 May 10 21:45:33.568859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-AttachVolumeNegativeTest-297208105-project May 10 21:45:33.568859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:45:33.568859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance 4674fb54-efa1-4bed-a2a2-49f3b1184874 could not be found. May 10 21:45:33.568859 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': '4674fb54-efa1-4bed-a2a2-49f3b1184874'} May 10 21:45:33.569943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:45:33.569943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:33.569943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:45:33.569943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:45:33.569943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:45:33.569943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:45:33.569943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:45:33.569943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:45:33.569943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:45:33.569943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:45:33.569943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4674fb54-efa1-4bed-a2a2-49f3b1184874 could not be found. May 10 21:45:33.569943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:33.569943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:45:33.569943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:33.569943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:33.569943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:45:33.569943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:45:33.569943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:45:33.569943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:45:33.569943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:45:33.571809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:45:33.571809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:45:33.571809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:45:33.571809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:45:33.571809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:45:33.571809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:45:33.571809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:45:33.571809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4674fb54-efa1-4bed-a2a2-49f3b1184874 could not be found. May 10 21:45:33.571809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:33.571809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:45:33.571809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:33.571809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:33.571809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:45:33.571809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:45:33.571809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:45:33.571809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:45:33.571809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4674fb54-efa1-4bed-a2a2-49f3b1184874 could not be found. May 10 21:45:33.571809 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:33.573310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7ff6fbf3-780b-4a92-a71c-56d4bd47edd8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Returning 404 to user: Instance 4674fb54-efa1-4bed-a2a2-49f3b1184874 could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:45:33.573310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7ff6fbf3-780b-4a92-a71c-56d4bd47edd8 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874" status: 404 len: 111 microversion: 2.1 time: 0.029053 May 10 21:45:33.573310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2826/3602] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:33 2022] GET /compute/v2.1/servers/4674fb54-efa1-4bed-a2a2-49f3b1184874 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:45:33.576705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d569b98a-f0b2-4b0b-83ed-58e4ab595442 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:33.577194 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-d569b98a-f0b2-4b0b-83ed-58e4ab595442 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:33.583252 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d569b98a-f0b2-4b0b-83ed-58e4ab595442 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:33.583651 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d569b98a-f0b2-4b0b-83ed-58e4ab595442 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:33.584413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d569b98a-f0b2-4b0b-83ed-58e4ab595442 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:33.584852 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-d569b98a-f0b2-4b0b-83ed-58e4ab595442 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:33.600575 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-d569b98a-f0b2-4b0b-83ed-58e4ab595442 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] HTTP exception thrown: Instance f2a9d425-c6f1-4f23-8fb7-7311ca431fdf could not be found. May 10 21:45:33.602128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d569b98a-f0b2-4b0b-83ed-58e4ab595442 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Request method failure captured: May 10 21:45:33.602128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: DELETE /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf HTTP/1.1 May 10 21:45:33.602128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:45:33.602128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:45:33.602128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:45:33.602128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:45:33.602128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:45:33.602128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:45:33.602128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:45:33.602128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:45:33.602128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietSE5zX3cUzqYcL4439JiFsqE4YiilwKjmw-zwJrvzsKCKk2V0t2rgnfCfWB9fMDqHcwDYx66Osidv5Nb3ivvjsId3P0K5BlinPK-pYoxdKcKRbo0A46AEZFFXEAkT7Vt_ZFHlOxIkEow-5P_dpFvNFYY0aq5XGlXkN1VnlT95XyJvw May 10 21:45:33.602128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:45:33.602128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:45:33.602128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:45:33.602128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:45:33.602128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:45:33.602128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:45:33.602128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 9582743483fa4fb88f4e91d3f787c945 May 10 21:45:33.602128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-AttachVolumeNegativeTest-297208105 May 10 21:45:33.602128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:45:33.602128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:45:33.603818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9582743483fa4fb88f4e91d3f787c945", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:45:33.603818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-AttachVolumeNegativeTest-297208105 May 10 21:45:33.603818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 9582743483fa4fb88f4e91d3f787c945 May 10 21:45:33.603818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-297208105 May 10 21:45:33.603818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-AttachVolumeNegativeTest-297208105-project May 10 21:45:33.603818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:45:33.603818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:45:33.603818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 62bc5605a22d408f9b4bac69a0f5f486 May 10 21:45:33.603818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-AttachVolumeNegativeTest-297208105-project May 10 21:45:33.603818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:45:33.603818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance f2a9d425-c6f1-4f23-8fb7-7311ca431fdf could not be found. May 10 21:45:33.603818 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': 'f2a9d425-c6f1-4f23-8fb7-7311ca431fdf'} May 10 21:45:33.604682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:45:33.604682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:33.604682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:45:33.604682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:45:33.604682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:45:33.604682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:45:33.604682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:45:33.604682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:45:33.604682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:45:33.604682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:45:33.604682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2a9d425-c6f1-4f23-8fb7-7311ca431fdf could not be found. May 10 21:45:33.604682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:33.604682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:45:33.604682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:33.604682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:33.604682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:45:33.604682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:45:33.604682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:45:33.604682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:45:33.604682 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:45:33.606179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:45:33.606179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 21:45:33.606179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 21:45:33.606179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 21:45:33.606179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 21:45:33.606179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:45:33.606179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:45:33.606179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:45:33.606179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:45:33.606179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2a9d425-c6f1-4f23-8fb7-7311ca431fdf could not be found. May 10 21:45:33.606179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:33.606179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:45:33.606179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:33.606179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:33.606179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:45:33.606179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:45:33.606179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:45:33.606179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:45:33.606179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2a9d425-c6f1-4f23-8fb7-7311ca431fdf could not be found. May 10 21:45:33.606179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:33.607847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d569b98a-f0b2-4b0b-83ed-58e4ab595442 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Returning 404 to user: Instance f2a9d425-c6f1-4f23-8fb7-7311ca431fdf could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:45:33.607847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d569b98a-f0b2-4b0b-83ed-58e4ab595442 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 404 len: 111 microversion: 2.1 time: 0.030401 May 10 21:45:33.607847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2827/3603] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 21:45:33 2022] DELETE /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:45:33.612355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cf5cac5f-4c15-40ab-9ed0-401c412dd96f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:33.612954 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cf5cac5f-4c15-40ab-9ed0-401c412dd96f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: f2a9d425-c6f1-4f23-8fb7-7311ca431fdf] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:33.619690 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cf5cac5f-4c15-40ab-9ed0-401c412dd96f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:33.620150 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cf5cac5f-4c15-40ab-9ed0-401c412dd96f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:33.620924 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cf5cac5f-4c15-40ab-9ed0-401c412dd96f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:33.621366 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cf5cac5f-4c15-40ab-9ed0-401c412dd96f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:33.635087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-cf5cac5f-4c15-40ab-9ed0-401c412dd96f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] HTTP exception thrown: Instance f2a9d425-c6f1-4f23-8fb7-7311ca431fdf could not be found. May 10 21:45:33.636655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cf5cac5f-4c15-40ab-9ed0-401c412dd96f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Request method failure captured: May 10 21:45:33.636655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf HTTP/1.1 May 10 21:45:33.636655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:45:33.636655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:45:33.636655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:45:33.636655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:45:33.636655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:45:33.636655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:45:33.636655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:45:33.636655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:45:33.636655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietSE5zX3cUzqYcL4439JiFsqE4YiilwKjmw-zwJrvzsKCKk2V0t2rgnfCfWB9fMDqHcwDYx66Osidv5Nb3ivvjsId3P0K5BlinPK-pYoxdKcKRbo0A46AEZFFXEAkT7Vt_ZFHlOxIkEow-5P_dpFvNFYY0aq5XGlXkN1VnlT95XyJvw May 10 21:45:33.636655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:45:33.636655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:45:33.636655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:45:33.636655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:45:33.636655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:45:33.636655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:45:33.636655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 9582743483fa4fb88f4e91d3f787c945 May 10 21:45:33.636655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-AttachVolumeNegativeTest-297208105 May 10 21:45:33.636655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:45:33.636655 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:45:33.638584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9582743483fa4fb88f4e91d3f787c945", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:45:33.638584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-AttachVolumeNegativeTest-297208105 May 10 21:45:33.638584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 9582743483fa4fb88f4e91d3f787c945 May 10 21:45:33.638584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-297208105 May 10 21:45:33.638584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-AttachVolumeNegativeTest-297208105-project May 10 21:45:33.638584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:45:33.638584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:45:33.638584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 62bc5605a22d408f9b4bac69a0f5f486 May 10 21:45:33.638584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-AttachVolumeNegativeTest-297208105-project May 10 21:45:33.638584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:45:33.638584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance f2a9d425-c6f1-4f23-8fb7-7311ca431fdf could not be found. May 10 21:45:33.638584 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': 'f2a9d425-c6f1-4f23-8fb7-7311ca431fdf'} May 10 21:45:33.639670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:45:33.639670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:33.639670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:45:33.639670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:45:33.639670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:45:33.639670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:45:33.639670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:45:33.639670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:45:33.639670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:45:33.639670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:45:33.639670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2a9d425-c6f1-4f23-8fb7-7311ca431fdf could not be found. May 10 21:45:33.639670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:33.639670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:45:33.639670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:33.639670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:33.639670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:45:33.639670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:45:33.639670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:45:33.639670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:45:33.639670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:45:33.641382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:45:33.641382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:45:33.641382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:45:33.641382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:45:33.641382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:45:33.641382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:45:33.641382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:45:33.641382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2a9d425-c6f1-4f23-8fb7-7311ca431fdf could not be found. May 10 21:45:33.641382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:33.641382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:45:33.641382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:33.641382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:33.641382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:45:33.641382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:45:33.641382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:45:33.641382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:45:33.641382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2a9d425-c6f1-4f23-8fb7-7311ca431fdf could not be found. May 10 21:45:33.641382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:33.642910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cf5cac5f-4c15-40ab-9ed0-401c412dd96f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Returning 404 to user: Instance f2a9d425-c6f1-4f23-8fb7-7311ca431fdf could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:45:33.642910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cf5cac5f-4c15-40ab-9ed0-401c412dd96f tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf" status: 404 len: 111 microversion: 2.1 time: 0.029221 May 10 21:45:33.642910 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2828/3604] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:33 2022] GET /compute/v2.1/servers/f2a9d425-c6f1-4f23-8fb7-7311ca431fdf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:45:34.049475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-538239ea-7ad9-4809-95d7-f901628d2eb8 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:34.050169 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-538239ea-7ad9-4809-95d7-f901628d2eb8 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 03ade262-9711-4288-87e3-296276034296] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:34.056598 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-538239ea-7ad9-4809-95d7-f901628d2eb8 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:34.057039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-538239ea-7ad9-4809-95d7-f901628d2eb8 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:34.057798 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-538239ea-7ad9-4809-95d7-f901628d2eb8 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:34.058227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-538239ea-7ad9-4809-95d7-f901628d2eb8 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:34.191165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-538239ea-7ad9-4809-95d7-f901628d2eb8 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0c9edad1444469a9a31988ac49730f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:34.196695 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-538239ea-7ad9-4809-95d7-f901628d2eb8 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296" status: 200 len: 1313 microversion: 2.1 time: 0.151109 May 10 21:45:34.197306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2829/3605] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:34 2022] GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:45:34.943166 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0c68d82a-e031-4264-b849-fd49e7dd65e9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:34.943657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0c68d82a-e031-4264-b849-fd49e7dd65e9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:34.949870 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c68d82a-e031-4264-b849-fd49e7dd65e9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:34.950361 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c68d82a-e031-4264-b849-fd49e7dd65e9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:34.951135 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c68d82a-e031-4264-b849-fd49e7dd65e9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:34.951573 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0c68d82a-e031-4264-b849-fd49e7dd65e9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:34.965104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-0c68d82a-e031-4264-b849-fd49e7dd65e9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] HTTP exception thrown: Instance 4b28c992-788d-4e37-b194-aaf2fb61577b could not be found. May 10 21:45:34.966638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0c68d82a-e031-4264-b849-fd49e7dd65e9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Request method failure captured: May 10 21:45:34.966638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: DELETE /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b HTTP/1.1 May 10 21:45:34.966638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:45:34.966638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:45:34.966638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:45:34.966638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:45:34.966638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:45:34.966638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:45:34.966638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:45:34.966638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:45:34.966638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietSE5zX3cUzqYcL4439JiFsqE4YiilwKjmw-zwJrvzsKCKk2V0t2rgnfCfWB9fMDqHcwDYx66Osidv5Nb3ivvjsId3P0K5BlinPK-pYoxdKcKRbo0A46AEZFFXEAkT7Vt_ZFHlOxIkEow-5P_dpFvNFYY0aq5XGlXkN1VnlT95XyJvw May 10 21:45:34.966638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:45:34.966638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:45:34.966638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:45:34.966638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:45:34.966638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:45:34.966638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:45:34.966638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 9582743483fa4fb88f4e91d3f787c945 May 10 21:45:34.966638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-AttachVolumeNegativeTest-297208105 May 10 21:45:34.966638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:45:34.966638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:45:34.968450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9582743483fa4fb88f4e91d3f787c945", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:45:34.968450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-AttachVolumeNegativeTest-297208105 May 10 21:45:34.968450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 9582743483fa4fb88f4e91d3f787c945 May 10 21:45:34.968450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-297208105 May 10 21:45:34.968450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-AttachVolumeNegativeTest-297208105-project May 10 21:45:34.968450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:45:34.968450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:45:34.968450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 62bc5605a22d408f9b4bac69a0f5f486 May 10 21:45:34.968450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-AttachVolumeNegativeTest-297208105-project May 10 21:45:34.968450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:45:34.968450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance 4b28c992-788d-4e37-b194-aaf2fb61577b could not be found. May 10 21:45:34.968450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': '4b28c992-788d-4e37-b194-aaf2fb61577b'} May 10 21:45:34.969401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:45:34.969401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:34.969401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:45:34.969401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:45:34.969401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:45:34.969401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:45:34.969401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:45:34.969401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:45:34.969401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:45:34.969401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:45:34.969401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b28c992-788d-4e37-b194-aaf2fb61577b could not be found. May 10 21:45:34.969401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:34.969401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:45:34.969401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:34.969401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:34.969401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:45:34.969401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:45:34.969401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:45:34.969401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:45:34.969401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:45:34.971100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:45:34.971100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 21:45:34.971100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 21:45:34.971100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 21:45:34.971100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 21:45:34.971100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:45:34.971100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:45:34.971100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:45:34.971100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:45:34.971100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b28c992-788d-4e37-b194-aaf2fb61577b could not be found. May 10 21:45:34.971100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:34.971100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:45:34.971100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:34.971100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:34.971100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:45:34.971100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:45:34.971100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:45:34.971100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:45:34.971100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b28c992-788d-4e37-b194-aaf2fb61577b could not be found. May 10 21:45:34.971100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:34.972625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0c68d82a-e031-4264-b849-fd49e7dd65e9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Returning 404 to user: Instance 4b28c992-788d-4e37-b194-aaf2fb61577b could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:45:34.972625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0c68d82a-e031-4264-b849-fd49e7dd65e9 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 404 len: 111 microversion: 2.1 time: 0.029709 May 10 21:45:34.972625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2830/3606] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 21:45:34 2022] DELETE /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 21:45:34.977179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9f75dda6-1360-4886-8230-d4bb9a36f656 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:34.977786 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9f75dda6-1360-4886-8230-d4bb9a36f656 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] [instance: 4b28c992-788d-4e37-b194-aaf2fb61577b] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:34.983760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9f75dda6-1360-4886-8230-d4bb9a36f656 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:34.984205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9f75dda6-1360-4886-8230-d4bb9a36f656 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:34.984990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9f75dda6-1360-4886-8230-d4bb9a36f656 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:34.985423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9f75dda6-1360-4886-8230-d4bb9a36f656 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:34.999189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-9f75dda6-1360-4886-8230-d4bb9a36f656 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] HTTP exception thrown: Instance 4b28c992-788d-4e37-b194-aaf2fb61577b could not be found. May 10 21:45:35.000700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9f75dda6-1360-4886-8230-d4bb9a36f656 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Request method failure captured: May 10 21:45:35.000700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b HTTP/1.1 May 10 21:45:35.000700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:45:35.000700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:45:35.000700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:45:35.000700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:45:35.000700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:45:35.000700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:45:35.000700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:45:35.000700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:45:35.000700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietSE5zX3cUzqYcL4439JiFsqE4YiilwKjmw-zwJrvzsKCKk2V0t2rgnfCfWB9fMDqHcwDYx66Osidv5Nb3ivvjsId3P0K5BlinPK-pYoxdKcKRbo0A46AEZFFXEAkT7Vt_ZFHlOxIkEow-5P_dpFvNFYY0aq5XGlXkN1VnlT95XyJvw May 10 21:45:35.000700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:45:35.000700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:45:35.000700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:45:35.000700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:45:35.000700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:45:35.000700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:45:35.000700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 9582743483fa4fb88f4e91d3f787c945 May 10 21:45:35.000700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-AttachVolumeNegativeTest-297208105 May 10 21:45:35.000700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:45:35.000700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:45:35.002505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9582743483fa4fb88f4e91d3f787c945"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9582743483fa4fb88f4e91d3f787c945", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:45:35.002505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-AttachVolumeNegativeTest-297208105 May 10 21:45:35.002505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 9582743483fa4fb88f4e91d3f787c945 May 10 21:45:35.002505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-297208105 May 10 21:45:35.002505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-AttachVolumeNegativeTest-297208105-project May 10 21:45:35.002505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:45:35.002505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:45:35.002505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 62bc5605a22d408f9b4bac69a0f5f486 May 10 21:45:35.002505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-AttachVolumeNegativeTest-297208105-project May 10 21:45:35.002505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:45:35.002505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance 4b28c992-788d-4e37-b194-aaf2fb61577b could not be found. May 10 21:45:35.002505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': '4b28c992-788d-4e37-b194-aaf2fb61577b'} May 10 21:45:35.003454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:45:35.003454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:35.003454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:45:35.003454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:45:35.003454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:45:35.003454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:45:35.003454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:45:35.003454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:45:35.003454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:45:35.003454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:45:35.003454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b28c992-788d-4e37-b194-aaf2fb61577b could not be found. May 10 21:45:35.003454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:35.003454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:45:35.003454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:35.003454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:35.003454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:45:35.003454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:45:35.003454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:45:35.003454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:45:35.003454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:45:35.006360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:45:35.006360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:45:35.006360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:45:35.006360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:45:35.006360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:45:35.006360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:45:35.006360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:45:35.006360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b28c992-788d-4e37-b194-aaf2fb61577b could not be found. May 10 21:45:35.006360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:35.006360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:45:35.006360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:35.006360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:35.006360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:45:35.006360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:45:35.006360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:45:35.006360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:45:35.006360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b28c992-788d-4e37-b194-aaf2fb61577b could not be found. May 10 21:45:35.006360 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:35.007926 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9f75dda6-1360-4886-8230-d4bb9a36f656 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] Returning 404 to user: Instance 4b28c992-788d-4e37-b194-aaf2fb61577b could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:45:35.007926 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9f75dda6-1360-4886-8230-d4bb9a36f656 tempest-AttachVolumeNegativeTest-297208105 tempest-AttachVolumeNegativeTest-297208105-project] 10.222.0.49 "GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b" status: 404 len: 111 microversion: 2.1 time: 0.029164 May 10 21:45:35.007926 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2831/3607] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:34 2022] GET /compute/v2.1/servers/4b28c992-788d-4e37-b194-aaf2fb61577b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 21:45:35.213828 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-26839eb1-5058-4a1d-a7ca-8781abef6d74 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:35.214701 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-26839eb1-5058-4a1d-a7ca-8781abef6d74 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 03ade262-9711-4288-87e3-296276034296] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:35.222771 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-26839eb1-5058-4a1d-a7ca-8781abef6d74 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:35.223251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-26839eb1-5058-4a1d-a7ca-8781abef6d74 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:35.225333 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-26839eb1-5058-4a1d-a7ca-8781abef6d74 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:35.225777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-26839eb1-5058-4a1d-a7ca-8781abef6d74 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:35.428730 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-26839eb1-5058-4a1d-a7ca-8781abef6d74 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0c9edad1444469a9a31988ac49730f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:35.436058 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-26839eb1-5058-4a1d-a7ca-8781abef6d74 tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296" status: 200 len: 1496 microversion: 2.1 time: 0.226089 May 10 21:45:35.436734 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2832/3608] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:35 2022] GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296 => generated 1496 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:45:36.151456 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4d8273d7-bd34-4c8e-a610-9df402d6f89e tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:36.152137 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4d8273d7-bd34-4c8e-a610-9df402d6f89e tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 03ade262-9711-4288-87e3-296276034296] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:36.158210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4d8273d7-bd34-4c8e-a610-9df402d6f89e tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:36.158799 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4d8273d7-bd34-4c8e-a610-9df402d6f89e tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:36.159597 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4d8273d7-bd34-4c8e-a610-9df402d6f89e tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:36.160034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4d8273d7-bd34-4c8e-a610-9df402d6f89e tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:36.185380 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4d8273d7-bd34-4c8e-a610-9df402d6f89e tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 03ade262-9711-4288-87e3-296276034296] Going to try to terminate instance {{(pid=117714) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:45:36.497764 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4d8273d7-bd34-4c8e-a610-9df402d6f89e tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "DELETE /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296" status: 204 len: 0 microversion: 2.1 time: 0.350018 May 10 21:45:36.499929 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2833/3609] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 21:45:36 2022] DELETE /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 21:45:36.514399 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-94a377a2-233d-4245-a9ba-2b71af602ecc tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:36.515319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-94a377a2-233d-4245-a9ba-2b71af602ecc tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 03ade262-9711-4288-87e3-296276034296] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:36.523280 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-94a377a2-233d-4245-a9ba-2b71af602ecc tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:36.523893 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-94a377a2-233d-4245-a9ba-2b71af602ecc tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:36.524697 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-94a377a2-233d-4245-a9ba-2b71af602ecc tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:36.525138 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-94a377a2-233d-4245-a9ba-2b71af602ecc tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:36.758501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-94a377a2-233d-4245-a9ba-2b71af602ecc tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0c9edad1444469a9a31988ac49730f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:36.765886 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-94a377a2-233d-4245-a9ba-2b71af602ecc tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296" status: 200 len: 1502 microversion: 2.1 time: 0.256034 May 10 21:45:36.766457 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2834/3610] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:36 2022] GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296 => generated 1502 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:45:37.790087 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-69da1be2-34ba-4f93-979b-74c6f83816dd tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:37.790774 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-69da1be2-34ba-4f93-979b-74c6f83816dd tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 03ade262-9711-4288-87e3-296276034296] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:37.797259 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-69da1be2-34ba-4f93-979b-74c6f83816dd tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:37.797723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-69da1be2-34ba-4f93-979b-74c6f83816dd tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:37.798502 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-69da1be2-34ba-4f93-979b-74c6f83816dd tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:37.798945 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-69da1be2-34ba-4f93-979b-74c6f83816dd tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:38.103625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-69da1be2-34ba-4f93-979b-74c6f83816dd tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0c9edad1444469a9a31988ac49730f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:38.105687 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-69da1be2-34ba-4f93-979b-74c6f83816dd tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296" status: 200 len: 1502 microversion: 2.1 time: 0.320001 May 10 21:45:38.106190 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2835/3611] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:37 2022] GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296 => generated 1502 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:45:38.563104 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-e02aafd6-9e7d-40a8-8917-6caa9002a339 req-4c644ac3-f1bf-4148-abc0-0d2701981e6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03ade262-9711-4288-87e3-296276034296", "name": "network-vif-deleted", "tag": "b2c472bd-837d-4551-85fe-61e1e34450a4"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:45:38.577316 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-e02aafd6-9e7d-40a8-8917-6caa9002a339 req-4c644ac3-f1bf-4148-abc0-0d2701981e6d service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:38.578137 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-e02aafd6-9e7d-40a8-8917-6caa9002a339 req-4c644ac3-f1bf-4148-abc0-0d2701981e6d service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:38.601315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-e02aafd6-9e7d-40a8-8917-6caa9002a339 req-4c644ac3-f1bf-4148-abc0-0d2701981e6d service nova] Creating event network-vif-deleted:b2c472bd-837d-4551-85fe-61e1e34450a4 for instance 03ade262-9711-4288-87e3-296276034296 on hv-cinder-82880 May 10 21:45:38.606990 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-e02aafd6-9e7d-40a8-8917-6caa9002a339 req-4c644ac3-f1bf-4148-abc0-0d2701981e6d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054876 May 10 21:45:38.607656 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2836/3612] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:45:39.124350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6cc30990-5cfc-4946-a777-a445dad4f92a tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:39.125072 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6cc30990-5cfc-4946-a777-a445dad4f92a tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 03ade262-9711-4288-87e3-296276034296] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:39.132703 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6cc30990-5cfc-4946-a777-a445dad4f92a tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:39.133148 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6cc30990-5cfc-4946-a777-a445dad4f92a tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:39.133964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6cc30990-5cfc-4946-a777-a445dad4f92a tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:39.134397 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6cc30990-5cfc-4946-a777-a445dad4f92a tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:39.168231 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6cc30990-5cfc-4946-a777-a445dad4f92a tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:39.168692 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6cc30990-5cfc-4946-a777-a445dad4f92a tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:39.169185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.objects.instance [None req-6cc30990-5cfc-4946-a777-a445dad4f92a tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lazy-loading 'fault' on Instance uuid 03ade262-9711-4288-87e3-296276034296 {{(pid=117714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:45:39.213353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6cc30990-5cfc-4946-a777-a445dad4f92a tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0c9edad1444469a9a31988ac49730f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:45:39.222579 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6cc30990-5cfc-4946-a777-a445dad4f92a tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296" status: 200 len: 1303 microversion: 2.1 time: 0.102545 May 10 21:45:39.223321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2837/3613] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:39 2022] GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:45:40.240058 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-210b1e78-06f6-4e35-8083-76219bf7fcfd tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:45:40.240792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-210b1e78-06f6-4e35-8083-76219bf7fcfd tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] [instance: 03ade262-9711-4288-87e3-296276034296] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:45:40.247038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-210b1e78-06f6-4e35-8083-76219bf7fcfd tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:40.247550 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-210b1e78-06f6-4e35-8083-76219bf7fcfd tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:40.248331 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-210b1e78-06f6-4e35-8083-76219bf7fcfd tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:45:40.248776 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-210b1e78-06f6-4e35-8083-76219bf7fcfd tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:45:40.262342 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-210b1e78-06f6-4e35-8083-76219bf7fcfd tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] HTTP exception thrown: Instance 03ade262-9711-4288-87e3-296276034296 could not be found. May 10 21:45:40.263907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-210b1e78-06f6-4e35-8083-76219bf7fcfd tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Request method failure captured: May 10 21:45:40.263907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296 HTTP/1.1 May 10 21:45:40.263907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:45:40.263907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:45:40.263907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:45:40.263907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:45:40.263907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:45:40.263907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:45:40.263907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:45:40.263907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:45:40.263907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietzfNTJoOtJgG97X0nO-CeaFAqvKOuKohb7TSiNqISK39TZrPWnKHWgvH8fhBxnD9s4lFI_DYKN44ANpzV86kQTdKzTNrAFfitD1ZkiYkJRIfySxemTl1W-o5D6dbK_drTO1b0n3ckIF3AhNSPb_OfOTOAzQS7Igy6oKpye8tz1HA0M May 10 21:45:40.263907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:45:40.263907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:45:40.263907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:45:40.263907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:45:40.263907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:45:40.263907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:45:40.263907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: e84b33f24f6d4a46b1e5ee4ed74ed39e May 10 21:45:40.263907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-VolumesActionsTest-1684518181 May 10 21:45:40.263907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:45:40.263907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:45:40.265874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e84b33f24f6d4a46b1e5ee4ed74ed39e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e84b33f24f6d4a46b1e5ee4ed74ed39e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e84b33f24f6d4a46b1e5ee4ed74ed39e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e84b33f24f6d4a46b1e5ee4ed74ed39e", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:45:40.265874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-VolumesActionsTest-1684518181 May 10 21:45:40.265874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: e84b33f24f6d4a46b1e5ee4ed74ed39e May 10 21:45:40.265874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-VolumesActionsTest-1684518181 May 10 21:45:40.265874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-VolumesActionsTest-1684518181-project May 10 21:45:40.265874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:45:40.265874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:45:40.265874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 0a0c9edad1444469a9a31988ac49730f May 10 21:45:40.265874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-VolumesActionsTest-1684518181-project May 10 21:45:40.265874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:45:40.265874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance 03ade262-9711-4288-87e3-296276034296 could not be found. May 10 21:45:40.265874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': '03ade262-9711-4288-87e3-296276034296'} May 10 21:45:40.266996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:45:40.266996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:40.266996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:45:40.266996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:45:40.266996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:45:40.266996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:45:40.266996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:45:40.266996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:45:40.266996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:45:40.266996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:45:40.266996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03ade262-9711-4288-87e3-296276034296 could not be found. May 10 21:45:40.266996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:40.266996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:45:40.266996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:40.266996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:40.266996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:45:40.266996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:45:40.266996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:45:40.266996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:45:40.266996 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:45:40.269210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:45:40.269210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:45:40.269210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:45:40.269210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:45:40.269210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:45:40.269210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:45:40.269210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:45:40.269210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03ade262-9711-4288-87e3-296276034296 could not be found. May 10 21:45:40.269210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:40.269210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:45:40.269210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:40.269210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:45:40.269210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:45:40.269210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:45:40.269210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:45:40.269210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:45:40.269210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03ade262-9711-4288-87e3-296276034296 could not be found. May 10 21:45:40.269210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:45:40.270500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-210b1e78-06f6-4e35-8083-76219bf7fcfd tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] Returning 404 to user: Instance 03ade262-9711-4288-87e3-296276034296 could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:45:40.270500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-210b1e78-06f6-4e35-8083-76219bf7fcfd tempest-VolumesActionsTest-1684518181 tempest-VolumesActionsTest-1684518181-project] 10.222.0.49 "GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296" status: 404 len: 111 microversion: 2.1 time: 0.029690 May 10 21:45:40.270500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2838/3614] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:45:40 2022] GET /compute/v2.1/servers/03ade262-9711-4288-87e3-296276034296 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 21:46:30.859998 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-318d3921-49aa-4171-9d49-b4b934618a31 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Action: 'create', calling method: .version_select at 0x7f85d5d66790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-339895925", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRin8nOnsMsQFXGp437v/SedNRRRc1kPJCeHgyUocxVcEHbQEKUiPOHDVMSJxQ+fbwm90mjXqdURSJtlwMjU91jTgP1j9e7CYvqp/oCNelNX7yWmuJcD4Hv7iNJt5hHaw=="}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:46:30.874424 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-318d3921-49aa-4171-9d49-b4b934618a31 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Getting quotas for project 1c8ec5d0210746a081edaf4a94b7b187. Resources: {'key_pairs'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:46:30.878205 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-318d3921-49aa-4171-9d49-b4b934618a31 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Getting quotas for user c8cae921e3984e0ab0338798785da0c2 and project 1c8ec5d0210746a081edaf4a94b7b187. Resources: {'key_pairs'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:46:30.976140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-318d3921-49aa-4171-9d49-b4b934618a31 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.116333 May 10 21:46:30.976140 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2839/3615] 10.222.0.49 () {60 vars in 1158 bytes} [Tue May 10 21:46:30 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:46:31.082000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a836d8d1-fb3f-4ec2-a01a-a416941777f2 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-349906926", "imageRef": "f07e5952-347e-4f0d-8ca1-30372fc76411", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-339895925", "networks": [{"uuid": "db7125ad-ec1f-4b4f-9993-dd32e3b1c91f"}]}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:46:31.136961 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.network.neutron [None req-a836d8d1-fb3f-4ec2-a01a-a416941777f2 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] validate_networks() for [('db7125ad-ec1f-4b4f-9993-dd32e3b1c91f', None, None, None, None, None)] {{(pid=117714) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 21:46:31.505515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-a836d8d1-fb3f-4ec2-a01a-a416941777f2 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Flavor limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 21:46:31.506022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-a836d8d1-fb3f-4ec2-a01a-a416941777f2 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Image limits 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 21:46:31.506537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-a836d8d1-fb3f-4ec2-a01a-a416941777f2 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Flavor pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 21:46:31.506971 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-a836d8d1-fb3f-4ec2-a01a-a416941777f2 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Image pref 0:0:0 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 21:46:31.507561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.virt.hardware [None req-a836d8d1-fb3f-4ec2-a01a-a416941777f2 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117714) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 21:46:31.516537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a836d8d1-fb3f-4ec2-a01a-a416941777f2 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:31.516988 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a836d8d1-fb3f-4ec2-a01a-a416941777f2 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:31.517912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a836d8d1-fb3f-4ec2-a01a-a416941777f2 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:31.518359 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a836d8d1-fb3f-4ec2-a01a-a416941777f2 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:31.535633 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-a836d8d1-fb3f-4ec2-a01a-a416941777f2 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Getting quotas for project 1c8ec5d0210746a081edaf4a94b7b187. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 21:46:31.540526 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.quota [None req-a836d8d1-fb3f-4ec2-a01a-a416941777f2 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Getting quotas for user c8cae921e3984e0ab0338798785da0c2 and project 1c8ec5d0210746a081edaf4a94b7b187. Resources: {'instances', 'cores', 'ram'} {{(pid=117714) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 21:46:31.551473 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a836d8d1-fb3f-4ec2-a01a-a416941777f2 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Going to run 1 instances... {{(pid=117714) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 21:46:31.554526 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a836d8d1-fb3f-4ec2-a01a-a416941777f2 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f07e5952-347e-4f0d-8ca1-30372fc76411',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117714) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 21:46:31.705547 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a836d8d1-fb3f-4ec2-a01a-a416941777f2 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.627357 May 10 21:46:31.706185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2840/3616] 10.222.0.49 () {60 vars in 1146 bytes} [Tue May 10 21:46:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 21:46:31.719801 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-60832289-422c-4593-9f0a-10ace26d3eff tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:46:31.719801 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-60832289-422c-4593-9f0a-10ace26d3eff tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:46:31.791068 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-60832289-422c-4593-9f0a-10ace26d3eff tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:46:31.799413 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-60832289-422c-4593-9f0a-10ace26d3eff tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1257 microversion: 2.1 time: 0.086127 May 10 21:46:31.809262 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2841/3617] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:46:31 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1257 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:46:32.816958 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-32c59dee-4cd7-49db-85bf-e245a75b1561 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:46:32.817689 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-32c59dee-4cd7-49db-85bf-e245a75b1561 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:46:32.824706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-32c59dee-4cd7-49db-85bf-e245a75b1561 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:32.825273 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-32c59dee-4cd7-49db-85bf-e245a75b1561 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:32.826211 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-32c59dee-4cd7-49db-85bf-e245a75b1561 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:32.826750 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-32c59dee-4cd7-49db-85bf-e245a75b1561 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:32.892756 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-32c59dee-4cd7-49db-85bf-e245a75b1561 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:46:32.900257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-32c59dee-4cd7-49db-85bf-e245a75b1561 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1261 microversion: 2.1 time: 0.087502 May 10 21:46:32.906868 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2842/3618] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:46:32 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1261 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:46:33.918246 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-362de8ca-c605-41e9-8f81-ef1ce9b1d70b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:46:33.919676 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-362de8ca-c605-41e9-8f81-ef1ce9b1d70b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:46:33.926547 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-362de8ca-c605-41e9-8f81-ef1ce9b1d70b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:33.927161 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-362de8ca-c605-41e9-8f81-ef1ce9b1d70b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:33.927962 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-362de8ca-c605-41e9-8f81-ef1ce9b1d70b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:33.929079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-362de8ca-c605-41e9-8f81-ef1ce9b1d70b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:34.186380 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-362de8ca-c605-41e9-8f81-ef1ce9b1d70b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:46:34.195306 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-362de8ca-c605-41e9-8f81-ef1ce9b1d70b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1317 microversion: 2.1 time: 0.281803 May 10 21:46:34.195912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2843/3619] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:46:33 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:46:35.214142 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9b6c4747-8397-4128-a499-1a2e4237941b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:46:35.215944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9b6c4747-8397-4128-a499-1a2e4237941b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:46:35.222863 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9b6c4747-8397-4128-a499-1a2e4237941b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:35.223339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9b6c4747-8397-4128-a499-1a2e4237941b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:35.224461 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9b6c4747-8397-4128-a499-1a2e4237941b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:35.224602 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9b6c4747-8397-4128-a499-1a2e4237941b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:35.433638 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9b6c4747-8397-4128-a499-1a2e4237941b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:46:35.458787 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9b6c4747-8397-4128-a499-1a2e4237941b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1357 microversion: 2.1 time: 0.249691 May 10 21:46:35.471372 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2844/3620] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:46:35 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1357 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:46:36.476840 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5f1ddfce-6a70-4d2e-8589-02529b8ebbeb tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:46:36.477540 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5f1ddfce-6a70-4d2e-8589-02529b8ebbeb tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:46:36.490454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f1ddfce-6a70-4d2e-8589-02529b8ebbeb tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:36.492670 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f1ddfce-6a70-4d2e-8589-02529b8ebbeb tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:36.493704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f1ddfce-6a70-4d2e-8589-02529b8ebbeb tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:36.494332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5f1ddfce-6a70-4d2e-8589-02529b8ebbeb tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:36.718742 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5f1ddfce-6a70-4d2e-8589-02529b8ebbeb tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:46:36.730607 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5f1ddfce-6a70-4d2e-8589-02529b8ebbeb tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1357 microversion: 2.1 time: 0.258188 May 10 21:46:36.731215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2845/3621] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:46:36 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1357 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:46:37.753757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-fbb048c7-3205-4695-81c7-24c85200f33f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:46:37.754522 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-fbb048c7-3205-4695-81c7-24c85200f33f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:46:37.763050 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fbb048c7-3205-4695-81c7-24c85200f33f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:37.763537 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fbb048c7-3205-4695-81c7-24c85200f33f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:37.764334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fbb048c7-3205-4695-81c7-24c85200f33f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:37.764767 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-fbb048c7-3205-4695-81c7-24c85200f33f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:37.985487 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-fbb048c7-3205-4695-81c7-24c85200f33f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:46:37.993110 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-fbb048c7-3205-4695-81c7-24c85200f33f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1357 microversion: 2.1 time: 0.249867 May 10 21:46:37.993699 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2846/3622] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:46:37 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1357 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:46:39.010161 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-76672be5-f239-459c-8507-2f69b9fc7b77 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:46:39.011931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-76672be5-f239-459c-8507-2f69b9fc7b77 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:46:39.019402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76672be5-f239-459c-8507-2f69b9fc7b77 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:39.020299 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76672be5-f239-459c-8507-2f69b9fc7b77 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:39.021266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76672be5-f239-459c-8507-2f69b9fc7b77 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:39.021933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-76672be5-f239-459c-8507-2f69b9fc7b77 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:39.164700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-76672be5-f239-459c-8507-2f69b9fc7b77 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:46:39.174409 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-76672be5-f239-459c-8507-2f69b9fc7b77 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1357 microversion: 2.1 time: 0.168338 May 10 21:46:39.175555 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2847/3623] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:46:39 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:46:40.191528 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3597159f-f378-40fb-a734-cc9d6439a67f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:46:40.193131 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3597159f-f378-40fb-a734-cc9d6439a67f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:46:40.202025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3597159f-f378-40fb-a734-cc9d6439a67f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:40.205138 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3597159f-f378-40fb-a734-cc9d6439a67f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:40.205138 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3597159f-f378-40fb-a734-cc9d6439a67f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:40.205138 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3597159f-f378-40fb-a734-cc9d6439a67f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:40.375313 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3597159f-f378-40fb-a734-cc9d6439a67f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:46:40.384466 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3597159f-f378-40fb-a734-cc9d6439a67f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1357 microversion: 2.1 time: 0.196750 May 10 21:46:40.385055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2848/3624] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:46:40 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1357 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:46:41.406220 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0ae6558e-0ae9-4abb-ac3e-039fb8332c7b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:46:41.406950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0ae6558e-0ae9-4abb-ac3e-039fb8332c7b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:46:41.413933 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ae6558e-0ae9-4abb-ac3e-039fb8332c7b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:41.414706 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ae6558e-0ae9-4abb-ac3e-039fb8332c7b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:41.415759 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ae6558e-0ae9-4abb-ac3e-039fb8332c7b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:41.416196 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ae6558e-0ae9-4abb-ac3e-039fb8332c7b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:41.563864 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0ae6558e-0ae9-4abb-ac3e-039fb8332c7b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:46:41.572422 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0ae6558e-0ae9-4abb-ac3e-039fb8332c7b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1357 microversion: 2.1 time: 0.174404 May 10 21:46:41.572997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2849/3625] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:46:41 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:46:42.590748 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7f376012-896f-4e0f-bd24-925bbce4fa2f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:46:42.591491 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7f376012-896f-4e0f-bd24-925bbce4fa2f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:46:42.598980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7f376012-896f-4e0f-bd24-925bbce4fa2f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:42.599462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7f376012-896f-4e0f-bd24-925bbce4fa2f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:42.600450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7f376012-896f-4e0f-bd24-925bbce4fa2f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:42.600892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7f376012-896f-4e0f-bd24-925bbce4fa2f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:42.737106 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7f376012-896f-4e0f-bd24-925bbce4fa2f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:46:42.744993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7f376012-896f-4e0f-bd24-925bbce4fa2f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1357 microversion: 2.1 time: 0.158203 May 10 21:46:42.745565 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2850/3626] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:46:42 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:46:43.763011 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-44da9773-49c1-49cc-80b3-767dc2007ead tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:46:43.763718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-44da9773-49c1-49cc-80b3-767dc2007ead tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:46:43.771393 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44da9773-49c1-49cc-80b3-767dc2007ead tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:43.773032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44da9773-49c1-49cc-80b3-767dc2007ead tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:43.773032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44da9773-49c1-49cc-80b3-767dc2007ead tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:43.773714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-44da9773-49c1-49cc-80b3-767dc2007ead tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:43.977514 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-44da9773-49c1-49cc-80b3-767dc2007ead tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:46:43.984847 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-44da9773-49c1-49cc-80b3-767dc2007ead tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1357 microversion: 2.1 time: 0.226430 May 10 21:46:43.985423 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2851/3627] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:46:43 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1357 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:46:44.389074 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-d706479f-c8a4-48c4-805c-c37837977ab9 req-3932f28d-e28f-4bb6-9932-4f9f4355d2aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cd303db-4b57-42ae-a64c-62c9549d988c", "tag": "3b9e0bd2-a3c7-4609-a738-153615fa1400"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:46:44.402744 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-d706479f-c8a4-48c4-805c-c37837977ab9 req-3932f28d-e28f-4bb6-9932-4f9f4355d2aa service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:44.403225 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-d706479f-c8a4-48c4-805c-c37837977ab9 req-3932f28d-e28f-4bb6-9932-4f9f4355d2aa service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:44.415151 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-d706479f-c8a4-48c4-805c-c37837977ab9 req-3932f28d-e28f-4bb6-9932-4f9f4355d2aa service nova] Creating event network-changed:3b9e0bd2-a3c7-4609-a738-153615fa1400 for instance 2cd303db-4b57-42ae-a64c-62c9549d988c on hv-cinder-82880 May 10 21:46:44.423474 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-d706479f-c8a4-48c4-805c-c37837977ab9 req-3932f28d-e28f-4bb6-9932-4f9f4355d2aa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039446 May 10 21:46:44.424084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2852/3628] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:46:45.006215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-74422180-6ebc-4d38-ac85-5d80c55a541c tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:46:45.007672 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-74422180-6ebc-4d38-ac85-5d80c55a541c tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:46:45.014045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74422180-6ebc-4d38-ac85-5d80c55a541c tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:45.014510 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74422180-6ebc-4d38-ac85-5d80c55a541c tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:45.015340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74422180-6ebc-4d38-ac85-5d80c55a541c tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:45.015792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-74422180-6ebc-4d38-ac85-5d80c55a541c tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:45.209037 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-74422180-6ebc-4d38-ac85-5d80c55a541c tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:46:45.216617 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-74422180-6ebc-4d38-ac85-5d80c55a541c tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1357 microversion: 2.1 time: 0.218046 May 10 21:46:45.217202 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2853/3629] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:46:44 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1357 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:46:46.233826 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1a4f1f64-48a1-440a-9cd2-fa8508e2c928 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:46:46.234459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1a4f1f64-48a1-440a-9cd2-fa8508e2c928 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:46:46.241619 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1a4f1f64-48a1-440a-9cd2-fa8508e2c928 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:46.242341 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1a4f1f64-48a1-440a-9cd2-fa8508e2c928 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:46.243136 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1a4f1f64-48a1-440a-9cd2-fa8508e2c928 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:46.243621 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1a4f1f64-48a1-440a-9cd2-fa8508e2c928 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:46.374081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-1a4f1f64-48a1-440a-9cd2-fa8508e2c928 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:46:46.389462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1a4f1f64-48a1-440a-9cd2-fa8508e2c928 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1357 microversion: 2.1 time: 0.151751 May 10 21:46:46.389462 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2854/3630] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:46:46 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:46:47.399718 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-bc7d692c-8665-4b99-afba-ee698d9f67c6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:46:47.400367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-bc7d692c-8665-4b99-afba-ee698d9f67c6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:46:47.406572 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bc7d692c-8665-4b99-afba-ee698d9f67c6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:47.407021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bc7d692c-8665-4b99-afba-ee698d9f67c6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:47.407813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bc7d692c-8665-4b99-afba-ee698d9f67c6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:47.408248 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-bc7d692c-8665-4b99-afba-ee698d9f67c6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:47.549213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-bc7d692c-8665-4b99-afba-ee698d9f67c6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:46:47.556778 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-bc7d692c-8665-4b99-afba-ee698d9f67c6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1357 microversion: 2.1 time: 0.161367 May 10 21:46:47.557914 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2855/3631] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:46:47 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:46:48.573329 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-50584bf4-6642-4c46-9243-5bbfbb8a6515 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:46:48.574009 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-50584bf4-6642-4c46-9243-5bbfbb8a6515 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:46:48.580452 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50584bf4-6642-4c46-9243-5bbfbb8a6515 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:48.580937 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50584bf4-6642-4c46-9243-5bbfbb8a6515 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:48.581724 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50584bf4-6642-4c46-9243-5bbfbb8a6515 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:48.582159 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-50584bf4-6642-4c46-9243-5bbfbb8a6515 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:48.709648 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-50584bf4-6642-4c46-9243-5bbfbb8a6515 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:46:48.717248 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-50584bf4-6642-4c46-9243-5bbfbb8a6515 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1357 microversion: 2.1 time: 0.147810 May 10 21:46:48.717938 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2856/3632] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:46:48 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:46:49.664234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-4219fbfe-230f-418c-bf1f-0484ed3322fc req-089eb20f-1dba-4958-ae14-8b3ea1fc0ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cd303db-4b57-42ae-a64c-62c9549d988c", "name": "network-vif-plugged", "status": "completed", "tag": "3b9e0bd2-a3c7-4609-a738-153615fa1400"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:46:49.673346 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-4219fbfe-230f-418c-bf1f-0484ed3322fc req-089eb20f-1dba-4958-ae14-8b3ea1fc0ab7 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:49.673787 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-4219fbfe-230f-418c-bf1f-0484ed3322fc req-089eb20f-1dba-4958-ae14-8b3ea1fc0ab7 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:49.685882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-4219fbfe-230f-418c-bf1f-0484ed3322fc req-089eb20f-1dba-4958-ae14-8b3ea1fc0ab7 service nova] Creating event network-vif-plugged:3b9e0bd2-a3c7-4609-a738-153615fa1400 for instance 2cd303db-4b57-42ae-a64c-62c9549d988c on hv-cinder-82880 May 10 21:46:49.691308 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-4219fbfe-230f-418c-bf1f-0484ed3322fc req-089eb20f-1dba-4958-ae14-8b3ea1fc0ab7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030921 May 10 21:46:49.691941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2857/3633] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:46:49.735512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8e116a2d-8323-4f9d-b536-c6e9ea7e094b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:46:49.736222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8e116a2d-8323-4f9d-b536-c6e9ea7e094b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:46:49.743084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e116a2d-8323-4f9d-b536-c6e9ea7e094b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:49.743770 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e116a2d-8323-4f9d-b536-c6e9ea7e094b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:49.744533 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e116a2d-8323-4f9d-b536-c6e9ea7e094b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:49.744970 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8e116a2d-8323-4f9d-b536-c6e9ea7e094b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:49.879800 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8e116a2d-8323-4f9d-b536-c6e9ea7e094b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:46:49.887307 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8e116a2d-8323-4f9d-b536-c6e9ea7e094b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1357 microversion: 2.1 time: 0.156040 May 10 21:46:49.887861 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2858/3634] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:46:49 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:46:50.905005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6419332b-f1e0-4343-a11a-61976b35c8f5 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:46:50.905774 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6419332b-f1e0-4343-a11a-61976b35c8f5 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:46:50.912187 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6419332b-f1e0-4343-a11a-61976b35c8f5 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:50.912495 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6419332b-f1e0-4343-a11a-61976b35c8f5 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:50.914058 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6419332b-f1e0-4343-a11a-61976b35c8f5 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:50.914499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6419332b-f1e0-4343-a11a-61976b35c8f5 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:51.050415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6419332b-f1e0-4343-a11a-61976b35c8f5 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:46:51.058488 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6419332b-f1e0-4343-a11a-61976b35c8f5 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1357 microversion: 2.1 time: 0.157386 May 10 21:46:51.059066 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2859/3635] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:46:50 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:46:52.075624 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7606de67-2070-4efe-b8b6-3bb5c815438a tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:46:52.076284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-7606de67-2070-4efe-b8b6-3bb5c815438a tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:46:52.082737 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7606de67-2070-4efe-b8b6-3bb5c815438a tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:52.083222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7606de67-2070-4efe-b8b6-3bb5c815438a tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:52.083980 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7606de67-2070-4efe-b8b6-3bb5c815438a tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:52.084415 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-7606de67-2070-4efe-b8b6-3bb5c815438a tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:52.222733 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-7606de67-2070-4efe-b8b6-3bb5c815438a tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:46:52.231026 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7606de67-2070-4efe-b8b6-3bb5c815438a tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1548 microversion: 2.1 time: 0.159247 May 10 21:46:52.231631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2860/3636] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:46:52 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:46:52.247339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-93504798-48c1-4ad1-880d-5a1e2cc7176d tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:46:52.249079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-93504798-48c1-4ad1-880d-5a1e2cc7176d tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:46:52.253979 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-93504798-48c1-4ad1-880d-5a1e2cc7176d tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:52.254428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-93504798-48c1-4ad1-880d-5a1e2cc7176d tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:52.255241 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-93504798-48c1-4ad1-880d-5a1e2cc7176d tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:52.255678 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-93504798-48c1-4ad1-880d-5a1e2cc7176d tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:52.392317 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-93504798-48c1-4ad1-880d-5a1e2cc7176d tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:46:52.399959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-93504798-48c1-4ad1-880d-5a1e2cc7176d tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1548 microversion: 2.1 time: 0.156324 May 10 21:46:52.400534 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2861/3637] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:46:52 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:46:52.415026 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8c9f16cb-b6db-410a-b02c-473f52b8489b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:46:52.418378 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-8c9f16cb-b6db-410a-b02c-473f52b8489b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:46:52.419166 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8c9f16cb-b6db-410a-b02c-473f52b8489b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Searching by: {'deleted': False, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187'} {{(pid=117714) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 21:46:52.425606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c9f16cb-b6db-410a-b02c-473f52b8489b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:52.426079 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c9f16cb-b6db-410a-b02c-473f52b8489b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:52.426968 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c9f16cb-b6db-410a-b02c-473f52b8489b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:52.427430 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8c9f16cb-b6db-410a-b02c-473f52b8489b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:52.517806 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.multi_cell_list [None req-8c9f16cb-b6db-410a-b02c-473f52b8489b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117714) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 21:46:52.615155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8c9f16cb-b6db-410a-b02c-473f52b8489b tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.203520 May 10 21:46:52.616570 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2862/3638] 10.222.0.49 () {58 vars in 1124 bytes} [Tue May 10 21:46:52 2022] GET /compute/v2.1/servers => generated 342 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:46:52.633979 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cbba46cd-97e4-4244-a94f-858f2b40350f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:46:52.633979 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cbba46cd-97e4-4244-a94f-858f2b40350f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:46:52.634568 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbba46cd-97e4-4244-a94f-858f2b40350f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:52.634997 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbba46cd-97e4-4244-a94f-858f2b40350f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:52.635812 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbba46cd-97e4-4244-a94f-858f2b40350f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:52.636254 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cbba46cd-97e4-4244-a94f-858f2b40350f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:52.768887 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-cbba46cd-97e4-4244-a94f-858f2b40350f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:46:52.776316 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cbba46cd-97e4-4244-a94f-858f2b40350f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1548 microversion: 2.1 time: 0.153698 May 10 21:46:52.776889 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2863/3639] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:46:52 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:46:54.639973 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1d1f454c-f014-4d7a-aa7f-9643bc97f14d tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0bface7-eb18-4807-962f-196e38ec86ec"}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:46:54.644606 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-1d1f454c-f014-4d7a-aa7f-9643bc97f14d tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:46:54.648601 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d1f454c-f014-4d7a-aa7f-9643bc97f14d tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:54.649037 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d1f454c-f014-4d7a-aa7f-9643bc97f14d tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:54.649936 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d1f454c-f014-4d7a-aa7f-9643bc97f14d tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:46:54.650386 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-1d1f454c-f014-4d7a-aa7f-9643bc97f14d tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:46:55.330353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1d1f454c-f014-4d7a-aa7f-9643bc97f14d tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "POST /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.694201 May 10 21:46:55.331285 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2864/3640] 10.222.0.49 () {60 vars in 1322 bytes} [Tue May 10 21:46:54 2022] POST /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c/os-volume_attachments => generated 194 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:47:02.871098 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-53d35898-98d4-4e3a-9086-7dc029d150b8 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:02.871837 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-53d35898-98d4-4e3a-9086-7dc029d150b8 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:47:02.878440 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-53d35898-98d4-4e3a-9086-7dc029d150b8 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:02.878898 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-53d35898-98d4-4e3a-9086-7dc029d150b8 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:02.879726 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-53d35898-98d4-4e3a-9086-7dc029d150b8 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:02.880165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-53d35898-98d4-4e3a-9086-7dc029d150b8 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:03.012934 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-53d35898-98d4-4e3a-9086-7dc029d150b8 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:47:03.020941 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-53d35898-98d4-4e3a-9086-7dc029d150b8 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1594 microversion: 2.1 time: 0.154655 May 10 21:47:03.021508 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2865/3641] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:47:02 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1594 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:47:05.469930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-366146bc-baf9-49ee-b132-deaad3ebd11f req-44919c98-d7a3-400c-a7a2-1e53cf5ef87f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cd303db-4b57-42ae-a64c-62c9549d988c", "tag": "3b9e0bd2-a3c7-4609-a738-153615fa1400"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:47:05.487380 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-366146bc-baf9-49ee-b132-deaad3ebd11f req-44919c98-d7a3-400c-a7a2-1e53cf5ef87f service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:05.487950 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-366146bc-baf9-49ee-b132-deaad3ebd11f req-44919c98-d7a3-400c-a7a2-1e53cf5ef87f service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:05.500012 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-366146bc-baf9-49ee-b132-deaad3ebd11f req-44919c98-d7a3-400c-a7a2-1e53cf5ef87f service nova] Creating event network-changed:3b9e0bd2-a3c7-4609-a738-153615fa1400 for instance 2cd303db-4b57-42ae-a64c-62c9549d988c on hv-cinder-82880 May 10 21:47:05.505166 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-366146bc-baf9-49ee-b132-deaad3ebd11f req-44919c98-d7a3-400c-a7a2-1e53cf5ef87f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038972 May 10 21:47:05.505777 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2866/3642] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:47:07.887067 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8bdadf1c-3192-48a4-9556-99ad90b30722 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2030136987"}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:47:07.887830 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8bdadf1c-3192-48a4-9556-99ad90b30722 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:47:07.894062 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8bdadf1c-3192-48a4-9556-99ad90b30722 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:07.894514 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8bdadf1c-3192-48a4-9556-99ad90b30722 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:07.895328 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8bdadf1c-3192-48a4-9556-99ad90b30722 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:07.895922 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8bdadf1c-3192-48a4-9556-99ad90b30722 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:08.038427 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.network.security_group_api [None req-8bdadf1c-3192-48a4-9556-99ad90b30722 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Adding security group b4452f4e-f999-40c0-917a-439c4976710e to port 3b9e0bd2-a3c7-4609-a738-153615fa1400 May 10 21:47:09.047362 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8bdadf1c-3192-48a4-9556-99ad90b30722 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "POST /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c/action" status: 202 len: 0 microversion: 2.1 time: 1.166201 May 10 21:47:09.049197 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2867/3643] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 21:47:07 2022] POST /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c/action => generated 0 bytes in 1169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 21:47:09.057473 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-38196df8-befe-4b08-808e-2c694f7392b8 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:09.058093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-38196df8-befe-4b08-808e-2c694f7392b8 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:47:09.064761 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38196df8-befe-4b08-808e-2c694f7392b8 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:09.065467 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38196df8-befe-4b08-808e-2c694f7392b8 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:09.066475 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38196df8-befe-4b08-808e-2c694f7392b8 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:09.066923 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-38196df8-befe-4b08-808e-2c694f7392b8 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:09.246203 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-38196df8-befe-4b08-808e-2c694f7392b8 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:47:09.254637 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-38196df8-befe-4b08-808e-2c694f7392b8 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1760 microversion: 2.1 time: 0.201316 May 10 21:47:09.255513 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2868/3644] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:47:09 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1760 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:47:09.271824 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-5407d1a7-ebca-4537-b545-3ae20f850587 req-c5bb8e96-215c-4165-b011-92bdef6a4d36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cd303db-4b57-42ae-a64c-62c9549d988c", "tag": "3b9e0bd2-a3c7-4609-a738-153615fa1400"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:47:09.280234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-5407d1a7-ebca-4537-b545-3ae20f850587 req-c5bb8e96-215c-4165-b011-92bdef6a4d36 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:09.280677 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-5407d1a7-ebca-4537-b545-3ae20f850587 req-c5bb8e96-215c-4165-b011-92bdef6a4d36 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:09.291651 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-5407d1a7-ebca-4537-b545-3ae20f850587 req-c5bb8e96-215c-4165-b011-92bdef6a4d36 service nova] Creating event network-changed:3b9e0bd2-a3c7-4609-a738-153615fa1400 for instance 2cd303db-4b57-42ae-a64c-62c9549d988c on hv-cinder-82880 May 10 21:47:09.297192 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-5407d1a7-ebca-4537-b545-3ae20f850587 req-c5bb8e96-215c-4165-b011-92bdef6a4d36 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028990 May 10 21:47:09.297792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2869/3645] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:47:41.124516 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2c2ec122-0fcf-436f-808b-98528ff7330c tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:47:41.125497 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2c2ec122-0fcf-436f-808b-98528ff7330c tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:47:41.131700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c2ec122-0fcf-436f-808b-98528ff7330c tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:41.132155 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c2ec122-0fcf-436f-808b-98528ff7330c tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:41.132922 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c2ec122-0fcf-436f-808b-98528ff7330c tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:41.133366 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2c2ec122-0fcf-436f-808b-98528ff7330c tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:41.343957 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2c2ec122-0fcf-436f-808b-98528ff7330c tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "POST /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c/action" status: 202 len: 0 microversion: 2.1 time: 0.223108 May 10 21:47:41.344989 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2870/3646] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 21:47:41 2022] POST /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 21:47:41.354513 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-af6bbdbb-64a3-4504-b91b-a42f34754ea5 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:41.355282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-af6bbdbb-64a3-4504-b91b-a42f34754ea5 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:47:41.361454 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af6bbdbb-64a3-4504-b91b-a42f34754ea5 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:41.361912 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af6bbdbb-64a3-4504-b91b-a42f34754ea5 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:41.362699 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af6bbdbb-64a3-4504-b91b-a42f34754ea5 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:41.363161 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-af6bbdbb-64a3-4504-b91b-a42f34754ea5 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:41.560891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-af6bbdbb-64a3-4504-b91b-a42f34754ea5 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:47:41.573031 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-af6bbdbb-64a3-4504-b91b-a42f34754ea5 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1752 microversion: 2.1 time: 0.222821 May 10 21:47:41.573623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2871/3647] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:47:41 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1752 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:47:42.594142 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9b0532c6-4167-4121-aa28-1aa2a01b907a tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:42.594755 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9b0532c6-4167-4121-aa28-1aa2a01b907a tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:47:42.601583 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9b0532c6-4167-4121-aa28-1aa2a01b907a tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:42.602069 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9b0532c6-4167-4121-aa28-1aa2a01b907a tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:42.605625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9b0532c6-4167-4121-aa28-1aa2a01b907a tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:42.605625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9b0532c6-4167-4121-aa28-1aa2a01b907a tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:42.747668 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9b0532c6-4167-4121-aa28-1aa2a01b907a tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:47:42.755425 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9b0532c6-4167-4121-aa28-1aa2a01b907a tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1757 microversion: 2.1 time: 0.165579 May 10 21:47:42.756005 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2872/3648] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:47:42 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:47:43.773350 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-4b395b3f-82f6-4bd6-b4c7-4d3ed4ab0169 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:43.774007 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-4b395b3f-82f6-4bd6-b4c7-4d3ed4ab0169 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:47:43.780752 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4b395b3f-82f6-4bd6-b4c7-4d3ed4ab0169 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:43.781227 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4b395b3f-82f6-4bd6-b4c7-4d3ed4ab0169 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:43.782083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4b395b3f-82f6-4bd6-b4c7-4d3ed4ab0169 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:43.782525 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-4b395b3f-82f6-4bd6-b4c7-4d3ed4ab0169 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:43.928647 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-4b395b3f-82f6-4bd6-b4c7-4d3ed4ab0169 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:47:43.936719 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-4b395b3f-82f6-4bd6-b4c7-4d3ed4ab0169 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1757 microversion: 2.1 time: 0.167176 May 10 21:47:43.937469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2873/3649] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:47:43 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:47:44.249773 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0ed50182-ac01-487f-9185-d11fa8944bc1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:44.250404 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0ed50182-ac01-487f-9185-d11fa8944bc1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:47:44.256381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ed50182-ac01-487f-9185-d11fa8944bc1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:44.256826 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ed50182-ac01-487f-9185-d11fa8944bc1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:44.257583 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ed50182-ac01-487f-9185-d11fa8944bc1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:44.258018 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0ed50182-ac01-487f-9185-d11fa8944bc1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:44.286348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0ed50182-ac01-487f-9185-d11fa8944bc1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Going to try to terminate instance {{(pid=117714) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:47:44.526217 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0ed50182-ac01-487f-9185-d11fa8944bc1 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 204 len: 0 microversion: 2.1 time: 0.279916 May 10 21:47:44.527221 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2874/3650] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 21:47:44 2022] DELETE /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 21:47:44.536932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e47d52dd-68f3-41fc-8d3b-1c390be5ca29 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:44.537641 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e47d52dd-68f3-41fc-8d3b-1c390be5ca29 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:47:44.543882 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e47d52dd-68f3-41fc-8d3b-1c390be5ca29 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:44.544315 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e47d52dd-68f3-41fc-8d3b-1c390be5ca29 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:44.545157 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e47d52dd-68f3-41fc-8d3b-1c390be5ca29 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:44.545595 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e47d52dd-68f3-41fc-8d3b-1c390be5ca29 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:44.683747 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-e47d52dd-68f3-41fc-8d3b-1c390be5ca29 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:47:44.691709 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e47d52dd-68f3-41fc-8d3b-1c390be5ca29 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1508 microversion: 2.1 time: 0.159300 May 10 21:47:44.692351 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2875/3651] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:47:44 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:47:44.954704 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-57014825-cd43-412f-8bd0-5b840bbf580e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:44.955382 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-57014825-cd43-412f-8bd0-5b840bbf580e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:47:44.961779 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-57014825-cd43-412f-8bd0-5b840bbf580e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:44.962229 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-57014825-cd43-412f-8bd0-5b840bbf580e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:44.962991 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-57014825-cd43-412f-8bd0-5b840bbf580e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:44.963461 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-57014825-cd43-412f-8bd0-5b840bbf580e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:45.142039 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-57014825-cd43-412f-8bd0-5b840bbf580e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:47:45.150081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-57014825-cd43-412f-8bd0-5b840bbf580e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1757 microversion: 2.1 time: 0.200236 May 10 21:47:45.150680 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2876/3652] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:47:44 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1757 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:47:45.603700 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-b1ceec81-23b1-42cc-80ac-ec2952589691 req-4353ad04-d476-4d67-9d5b-6350a986179c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87", "name": "network-vif-deleted", "tag": "40e484fd-855a-4680-a2ef-45c93b616ec9"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:47:45.612984 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-b1ceec81-23b1-42cc-80ac-ec2952589691 req-4353ad04-d476-4d67-9d5b-6350a986179c service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:45.614121 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-b1ceec81-23b1-42cc-80ac-ec2952589691 req-4353ad04-d476-4d67-9d5b-6350a986179c service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:45.630188 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-b1ceec81-23b1-42cc-80ac-ec2952589691 req-4353ad04-d476-4d67-9d5b-6350a986179c service nova] Creating event network-vif-deleted:40e484fd-855a-4680-a2ef-45c93b616ec9 for instance cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 on hv-cinder-82880 May 10 21:47:45.635571 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-b1ceec81-23b1-42cc-80ac-ec2952589691 req-4353ad04-d476-4d67-9d5b-6350a986179c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037390 May 10 21:47:45.636166 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2877/3653] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:47:45.710182 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2f78a47e-153a-449a-a99d-0922317c3ddf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:45.710886 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2f78a47e-153a-449a-a99d-0922317c3ddf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:47:45.717133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2f78a47e-153a-449a-a99d-0922317c3ddf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:45.717629 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2f78a47e-153a-449a-a99d-0922317c3ddf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:45.719504 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2f78a47e-153a-449a-a99d-0922317c3ddf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:45.719983 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2f78a47e-153a-449a-a99d-0922317c3ddf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:45.785092 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2f78a47e-153a-449a-a99d-0922317c3ddf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:47:45.792581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2f78a47e-153a-449a-a99d-0922317c3ddf tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 200 len: 1466 microversion: 2.1 time: 0.086688 May 10 21:47:45.793371 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2878/3654] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:47:45 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 1466 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:47:46.167831 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2b3a15ec-f19a-415a-92b3-caa5cbdb3121 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:46.168436 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2b3a15ec-f19a-415a-92b3-caa5cbdb3121 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:47:46.175199 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2b3a15ec-f19a-415a-92b3-caa5cbdb3121 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:46.175643 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2b3a15ec-f19a-415a-92b3-caa5cbdb3121 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:46.176402 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2b3a15ec-f19a-415a-92b3-caa5cbdb3121 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:46.176971 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2b3a15ec-f19a-415a-92b3-caa5cbdb3121 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:46.325470 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2b3a15ec-f19a-415a-92b3-caa5cbdb3121 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:47:46.334014 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2b3a15ec-f19a-415a-92b3-caa5cbdb3121 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1757 microversion: 2.1 time: 0.170080 May 10 21:47:46.334663 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2879/3655] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:47:46 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:47:46.809630 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f621fcc0-af47-4a7d-bc3e-dbbf50379f25 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:46.810242 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-f621fcc0-af47-4a7d-bc3e-dbbf50379f25 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:47:46.816336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f621fcc0-af47-4a7d-bc3e-dbbf50379f25 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:46.816787 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f621fcc0-af47-4a7d-bc3e-dbbf50379f25 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:46.817551 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f621fcc0-af47-4a7d-bc3e-dbbf50379f25 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:46.817986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-f621fcc0-af47-4a7d-bc3e-dbbf50379f25 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:46.831390 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-f621fcc0-af47-4a7d-bc3e-dbbf50379f25 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] HTTP exception thrown: Instance cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 could not be found. May 10 21:47:46.833000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f621fcc0-af47-4a7d-bc3e-dbbf50379f25 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Request method failure captured: May 10 21:47:46.833000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 HTTP/1.1 May 10 21:47:46.833000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:47:46.833000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:47:46.833000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:47:46.833000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:47:46.833000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:47:46.833000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:47:46.833000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:47:46.833000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:47:46.833000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietRu9ss3zgPFeC7849fUJOM8Q7EL5_flR4rJLt-W88oUCLUpwLmWbh98c8K1xLUyN74oKQGClHuOnEt6Xj1A1n_QZ5oD8Vcsq78BUnvY-1ELPjE6x7POzOrC2wKu1Ebpq6A7wmyq8_x_zbC73jSynu5MTHLRXN5eyRUhQ9bV1BQSx8s May 10 21:47:46.833000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:47:46.833000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:47:46.833000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:47:46.833000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:47:46.833000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:47:46.833000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:47:46.833000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: bba0283b32bc4c54ae7cfcb1f984db42 May 10 21:47:46.833000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-171931591 May 10 21:47:46.833000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:47:46.833000 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:47:46.834208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bba0283b32bc4c54ae7cfcb1f984db42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bba0283b32bc4c54ae7cfcb1f984db42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bba0283b32bc4c54ae7cfcb1f984db42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bba0283b32bc4c54ae7cfcb1f984db42", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:47:46.834208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-ServerRescueNegativeTestJSON-171931591 May 10 21:47:46.834208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: bba0283b32bc4c54ae7cfcb1f984db42 May 10 21:47:46.834208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-171931591 May 10 21:47:46.834208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-ServerRescueNegativeTestJSON-171931591-project May 10 21:47:46.834208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:47:46.834208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:47:46.834208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: fe93eb8c93fb4cb4bec6f7cc2c03e1eb May 10 21:47:46.834208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-ServerRescueNegativeTestJSON-171931591-project May 10 21:47:46.834208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:47:46.834208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 could not be found. May 10 21:47:46.834208 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': 'cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87'} May 10 21:47:46.834928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:47:46.834928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:47:46.834928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:47:46.834928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:47:46.834928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:47:46.834928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:47:46.834928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:47:46.834928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:47:46.834928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:47:46.834928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:47:46.834928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 could not be found. May 10 21:47:46.834928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:47:46.834928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:47:46.834928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:47:46.834928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:47:46.834928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:47:46.834928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:47:46.834928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:47:46.834928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:47:46.834928 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:47:46.836022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:47:46.836022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:47:46.836022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:47:46.836022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:47:46.836022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:47:46.836022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:47:46.836022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:47:46.836022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 could not be found. May 10 21:47:46.836022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:47:46.836022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:47:46.836022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:47:46.836022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:47:46.836022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:47:46.836022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:47:46.836022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:47:46.836022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:47:46.836022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 could not be found. May 10 21:47:46.836022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:47:46.837061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f621fcc0-af47-4a7d-bc3e-dbbf50379f25 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Returning 404 to user: Instance cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:47:46.837061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f621fcc0-af47-4a7d-bc3e-dbbf50379f25 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87" status: 404 len: 111 microversion: 2.1 time: 0.028616 May 10 21:47:46.837061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2880/3656] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:47:46 2022] GET /compute/v2.1/servers/cdf8dedc-a0b7-474a-8ef7-c3c8b47e2a87 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 21:47:46.842226 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9c60fcb2-718e-4505-803e-137ca85f7ad0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:46.842715 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9c60fcb2-718e-4505-803e-137ca85f7ad0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:47:46.849147 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c60fcb2-718e-4505-803e-137ca85f7ad0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:46.849596 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c60fcb2-718e-4505-803e-137ca85f7ad0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:46.850353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c60fcb2-718e-4505-803e-137ca85f7ad0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:46.850789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c60fcb2-718e-4505-803e-137ca85f7ad0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:46.877797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9c60fcb2-718e-4505-803e-137ca85f7ad0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Going to try to terminate instance {{(pid=117714) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:47:47.114365 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9c60fcb2-718e-4505-803e-137ca85f7ad0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 204 len: 0 microversion: 2.1 time: 0.275232 May 10 21:47:47.114943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2881/3657] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 21:47:46 2022] DELETE /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 21:47:47.122829 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a4ac3bd6-785b-41cb-b15e-b5e33df4c722 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:47.123543 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a4ac3bd6-785b-41cb-b15e-b5e33df4c722 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:47:47.129492 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a4ac3bd6-785b-41cb-b15e-b5e33df4c722 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:47.129883 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a4ac3bd6-785b-41cb-b15e-b5e33df4c722 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:47.130644 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a4ac3bd6-785b-41cb-b15e-b5e33df4c722 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:47.131084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a4ac3bd6-785b-41cb-b15e-b5e33df4c722 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:47.259978 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a4ac3bd6-785b-41cb-b15e-b5e33df4c722 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:47:47.268512 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a4ac3bd6-785b-41cb-b15e-b5e33df4c722 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1522 microversion: 2.1 time: 0.149487 May 10 21:47:47.269084 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2882/3658] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:47:47 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:47:47.351356 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-2b6319aa-0a04-4fec-b8f4-472a91202ad5 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:47.352068 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-2b6319aa-0a04-4fec-b8f4-472a91202ad5 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:47:47.358032 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2b6319aa-0a04-4fec-b8f4-472a91202ad5 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:47.358480 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2b6319aa-0a04-4fec-b8f4-472a91202ad5 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:47.359296 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2b6319aa-0a04-4fec-b8f4-472a91202ad5 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:47.359748 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-2b6319aa-0a04-4fec-b8f4-472a91202ad5 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:47.497166 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-2b6319aa-0a04-4fec-b8f4-472a91202ad5 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:47:47.505025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-2b6319aa-0a04-4fec-b8f4-472a91202ad5 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1757 microversion: 2.1 time: 0.157883 May 10 21:47:47.505589 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2883/3659] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:47:47 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1757 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:47:48.062717 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-6ae32944-5b4b-4c52-892f-d71829f1bfeb req-96c62d30-ab79-4b65-96d9-5de132c8cecc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee5480a-213a-489e-a366-5ffa59cf5487", "name": "network-vif-deleted", "tag": "e1708824-bd48-4216-a98b-629b26d874f1"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:47:48.071310 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-6ae32944-5b4b-4c52-892f-d71829f1bfeb req-96c62d30-ab79-4b65-96d9-5de132c8cecc service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:48.076444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-6ae32944-5b4b-4c52-892f-d71829f1bfeb req-96c62d30-ab79-4b65-96d9-5de132c8cecc service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:48.082586 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-6ae32944-5b4b-4c52-892f-d71829f1bfeb req-96c62d30-ab79-4b65-96d9-5de132c8cecc service nova] Creating event network-vif-deleted:e1708824-bd48-4216-a98b-629b26d874f1 for instance 2ee5480a-213a-489e-a366-5ffa59cf5487 on hv-cinder-82880 May 10 21:47:48.087469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-6ae32944-5b4b-4c52-892f-d71829f1bfeb req-96c62d30-ab79-4b65-96d9-5de132c8cecc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028383 May 10 21:47:48.088053 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2884/3660] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:47:48.286515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-def1271c-0784-4331-b2cf-7590aad78ea0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:48.287215 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-def1271c-0784-4331-b2cf-7590aad78ea0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:47:48.293416 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-def1271c-0784-4331-b2cf-7590aad78ea0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:48.293866 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-def1271c-0784-4331-b2cf-7590aad78ea0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:48.294642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-def1271c-0784-4331-b2cf-7590aad78ea0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:48.295078 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-def1271c-0784-4331-b2cf-7590aad78ea0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:48.328010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-def1271c-0784-4331-b2cf-7590aad78ea0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:48.328478 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-def1271c-0784-4331-b2cf-7590aad78ea0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:48.328959 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.objects.instance [None req-def1271c-0784-4331-b2cf-7590aad78ea0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lazy-loading 'fault' on Instance uuid 2ee5480a-213a-489e-a366-5ffa59cf5487 {{(pid=117714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:47:48.373352 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-def1271c-0784-4331-b2cf-7590aad78ea0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba0283b32bc4c54ae7cfcb1f984db42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:47:48.381289 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-def1271c-0784-4331-b2cf-7590aad78ea0 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 200 len: 1312 microversion: 2.1 time: 0.100451 May 10 21:47:48.381879 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2885/3661] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:47:48 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:47:48.521195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-5228d672-2151-4c96-ab6f-9bd122265ddb tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:48.521815 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-5228d672-2151-4c96-ab6f-9bd122265ddb tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:47:48.527850 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5228d672-2151-4c96-ab6f-9bd122265ddb tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:48.528301 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5228d672-2151-4c96-ab6f-9bd122265ddb tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:48.529061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5228d672-2151-4c96-ab6f-9bd122265ddb tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:48.529499 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-5228d672-2151-4c96-ab6f-9bd122265ddb tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:48.674332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-5228d672-2151-4c96-ab6f-9bd122265ddb tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:47:48.682518 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-5228d672-2151-4c96-ab6f-9bd122265ddb tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1757 microversion: 2.1 time: 0.165305 May 10 21:47:48.683093 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2886/3662] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:47:48 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:47:49.398842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cabfd711-126c-4f72-8e81-c09286de8ed4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:49.399566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-cabfd711-126c-4f72-8e81-c09286de8ed4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] [instance: 2ee5480a-213a-489e-a366-5ffa59cf5487] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:47:49.405960 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cabfd711-126c-4f72-8e81-c09286de8ed4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:49.406418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cabfd711-126c-4f72-8e81-c09286de8ed4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:49.407213 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cabfd711-126c-4f72-8e81-c09286de8ed4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:49.408339 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-cabfd711-126c-4f72-8e81-c09286de8ed4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:49.421493 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-cabfd711-126c-4f72-8e81-c09286de8ed4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] HTTP exception thrown: Instance 2ee5480a-213a-489e-a366-5ffa59cf5487 could not be found. May 10 21:47:49.423171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cabfd711-126c-4f72-8e81-c09286de8ed4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Request method failure captured: May 10 21:47:49.423171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 HTTP/1.1 May 10 21:47:49.423171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:47:49.423171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:47:49.423171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:47:49.423171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:47:49.423171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:47:49.423171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:47:49.423171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:47:49.423171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:47:49.423171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABietRu9ss3zgPFeC7849fUJOM8Q7EL5_flR4rJLt-W88oUCLUpwLmWbh98c8K1xLUyN74oKQGClHuOnEt6Xj1A1n_QZ5oD8Vcsq78BUnvY-1ELPjE6x7POzOrC2wKu1Ebpq6A7wmyq8_x_zbC73jSynu5MTHLRXN5eyRUhQ9bV1BQSx8s May 10 21:47:49.423171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:47:49.423171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:47:49.423171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:47:49.423171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:47:49.423171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:47:49.423171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:47:49.423171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: bba0283b32bc4c54ae7cfcb1f984db42 May 10 21:47:49.423171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-171931591 May 10 21:47:49.423171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:47:49.423171 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:47:49.424445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bba0283b32bc4c54ae7cfcb1f984db42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bba0283b32bc4c54ae7cfcb1f984db42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bba0283b32bc4c54ae7cfcb1f984db42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bba0283b32bc4c54ae7cfcb1f984db42", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:47:49.424445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-ServerRescueNegativeTestJSON-171931591 May 10 21:47:49.424445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: bba0283b32bc4c54ae7cfcb1f984db42 May 10 21:47:49.424445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-171931591 May 10 21:47:49.424445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-ServerRescueNegativeTestJSON-171931591-project May 10 21:47:49.424445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:47:49.424445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:47:49.424445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: fe93eb8c93fb4cb4bec6f7cc2c03e1eb May 10 21:47:49.424445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-ServerRescueNegativeTestJSON-171931591-project May 10 21:47:49.424445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:47:49.424445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance 2ee5480a-213a-489e-a366-5ffa59cf5487 could not be found. May 10 21:47:49.424445 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': '2ee5480a-213a-489e-a366-5ffa59cf5487'} May 10 21:47:49.425021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:47:49.425021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:47:49.425021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:47:49.425021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:47:49.425021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:47:49.425021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:47:49.425021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:47:49.425021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:47:49.425021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:47:49.425021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:47:49.425021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee5480a-213a-489e-a366-5ffa59cf5487 could not be found. May 10 21:47:49.425021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:47:49.425021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:47:49.425021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:47:49.425021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:47:49.425021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:47:49.425021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:47:49.425021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:47:49.425021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:47:49.425021 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:47:49.426083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:47:49.426083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:47:49.426083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:47:49.426083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:47:49.426083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:47:49.426083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:47:49.426083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:47:49.426083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee5480a-213a-489e-a366-5ffa59cf5487 could not be found. May 10 21:47:49.426083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:47:49.426083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:47:49.426083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:47:49.426083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:47:49.426083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:47:49.426083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:47:49.426083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:47:49.426083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:47:49.426083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee5480a-213a-489e-a366-5ffa59cf5487 could not be found. May 10 21:47:49.426083 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:47:49.427250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-cabfd711-126c-4f72-8e81-c09286de8ed4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] Returning 404 to user: Instance 2ee5480a-213a-489e-a366-5ffa59cf5487 could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:47:49.427250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-cabfd711-126c-4f72-8e81-c09286de8ed4 tempest-ServerRescueNegativeTestJSON-171931591 tempest-ServerRescueNegativeTestJSON-171931591-project] 10.222.0.49 "GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487" status: 404 len: 111 microversion: 2.1 time: 0.029594 May 10 21:47:49.427250 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2887/3663] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:47:49 2022] GET /compute/v2.1/servers/2ee5480a-213a-489e-a366-5ffa59cf5487 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 21:47:49.700873 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c0e07079-4128-4c20-9d91-eac25214eb85 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:49.701505 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c0e07079-4128-4c20-9d91-eac25214eb85 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:47:49.708623 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c0e07079-4128-4c20-9d91-eac25214eb85 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:49.709186 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c0e07079-4128-4c20-9d91-eac25214eb85 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:49.710045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c0e07079-4128-4c20-9d91-eac25214eb85 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:49.710581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c0e07079-4128-4c20-9d91-eac25214eb85 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:49.863721 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c0e07079-4128-4c20-9d91-eac25214eb85 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:47:49.872175 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c0e07079-4128-4c20-9d91-eac25214eb85 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1757 microversion: 2.1 time: 0.175177 May 10 21:47:49.872757 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2888/3664] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:47:49 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:47:50.889948 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3d9b112d-6f6d-4726-a002-6e02629b81b6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:50.890544 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-3d9b112d-6f6d-4726-a002-6e02629b81b6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:47:50.898433 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d9b112d-6f6d-4726-a002-6e02629b81b6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:50.898891 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d9b112d-6f6d-4726-a002-6e02629b81b6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:50.899787 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d9b112d-6f6d-4726-a002-6e02629b81b6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:50.900979 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-3d9b112d-6f6d-4726-a002-6e02629b81b6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:51.052045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-3d9b112d-6f6d-4726-a002-6e02629b81b6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:47:51.060211 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3d9b112d-6f6d-4726-a002-6e02629b81b6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1757 microversion: 2.1 time: 0.174138 May 10 21:47:51.060788 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2889/3665] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:47:50 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:47:52.077206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6853558e-fbfb-4efd-89d9-17ca59693707 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:52.077848 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6853558e-fbfb-4efd-89d9-17ca59693707 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:47:52.085370 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6853558e-fbfb-4efd-89d9-17ca59693707 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:52.085845 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6853558e-fbfb-4efd-89d9-17ca59693707 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:52.086613 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6853558e-fbfb-4efd-89d9-17ca59693707 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:52.087045 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6853558e-fbfb-4efd-89d9-17ca59693707 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:52.228371 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-6853558e-fbfb-4efd-89d9-17ca59693707 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:47:52.237801 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6853558e-fbfb-4efd-89d9-17ca59693707 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1757 microversion: 2.1 time: 0.164439 May 10 21:47:52.238386 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2890/3666] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:47:52 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:47:53.255194 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-0960edac-80e2-497d-a8e4-39ae12d73935 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:53.255800 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-0960edac-80e2-497d-a8e4-39ae12d73935 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:47:53.262070 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0960edac-80e2-497d-a8e4-39ae12d73935 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:53.262517 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0960edac-80e2-497d-a8e4-39ae12d73935 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:53.263332 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0960edac-80e2-497d-a8e4-39ae12d73935 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:53.263768 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-0960edac-80e2-497d-a8e4-39ae12d73935 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:53.485629 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-0960edac-80e2-497d-a8e4-39ae12d73935 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:47:53.493931 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-0960edac-80e2-497d-a8e4-39ae12d73935 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1757 microversion: 2.1 time: 0.242744 May 10 21:47:53.497334 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2891/3667] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:47:53 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1757 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:47:54.511543 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ee6bfa9c-25be-451e-8b6f-0477fd459d54 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:54.512152 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ee6bfa9c-25be-451e-8b6f-0477fd459d54 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:47:54.518321 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee6bfa9c-25be-451e-8b6f-0477fd459d54 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:54.518854 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee6bfa9c-25be-451e-8b6f-0477fd459d54 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:54.519539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee6bfa9c-25be-451e-8b6f-0477fd459d54 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:54.519975 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ee6bfa9c-25be-451e-8b6f-0477fd459d54 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:54.669196 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-ee6bfa9c-25be-451e-8b6f-0477fd459d54 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:47:54.677071 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ee6bfa9c-25be-451e-8b6f-0477fd459d54 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1757 microversion: 2.1 time: 0.169363 May 10 21:47:54.677631 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2892/3668] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:47:54 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:47:55.276797 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9d624ae8-671f-40c9-8433-f77f40c502da tempest-VolumesGetTestJSON-2006882917 tempest-VolumesGetTestJSON-2006882917-project] Action: 'create', calling method: .version_select at 0x7f85d5d4d280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1858020488", "metadata": {"Type": "work"}}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:47:55.934004 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9d624ae8-671f-40c9-8433-f77f40c502da tempest-VolumesGetTestJSON-2006882917 tempest-VolumesGetTestJSON-2006882917-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.787844 May 10 21:47:55.934953 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2893/3669] 10.222.0.49 () {60 vars in 1155 bytes} [Tue May 10 21:47:55 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 789 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 10 21:47:55.939549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-761528fb-514c-4290-a3da-115e8253f081 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:55.940179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-761528fb-514c-4290-a3da-115e8253f081 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:47:55.946336 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-761528fb-514c-4290-a3da-115e8253f081 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:55.946782 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-761528fb-514c-4290-a3da-115e8253f081 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:55.947576 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-761528fb-514c-4290-a3da-115e8253f081 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:55.948020 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-761528fb-514c-4290-a3da-115e8253f081 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:56.089435 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-761528fb-514c-4290-a3da-115e8253f081 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:47:56.098364 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-761528fb-514c-4290-a3da-115e8253f081 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1757 microversion: 2.1 time: 0.162362 May 10 21:47:56.098929 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2894/3670] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:47:55 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 21:47:56.103482 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e9320912-c337-4656-b8ec-509781ff5236 tempest-VolumesGetTestJSON-2006882917 tempest-VolumesGetTestJSON-2006882917-project] Calling method '.version_select at 0x7f85d5d86a60>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:56.152029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e9320912-c337-4656-b8ec-509781ff5236 tempest-VolumesGetTestJSON-2006882917 tempest-VolumesGetTestJSON-2006882917-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/95921465-d208-4990-9450-bf8cf00dce8d" status: 200 len: 353 microversion: 2.1 time: 0.051055 May 10 21:47:56.152029 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2895/3671] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 21:47:56 2022] GET /compute/v2.1/os-volumes/95921465-d208-4990-9450-bf8cf00dce8d => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:47:57.116355 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-c58bbd74-fdd5-48c1-abc4-3cc9f251ea32 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:57.117025 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-c58bbd74-fdd5-48c1-abc4-3cc9f251ea32 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:47:57.122972 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c58bbd74-fdd5-48c1-abc4-3cc9f251ea32 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:57.123510 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c58bbd74-fdd5-48c1-abc4-3cc9f251ea32 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:57.124265 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c58bbd74-fdd5-48c1-abc4-3cc9f251ea32 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:57.124696 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-c58bbd74-fdd5-48c1-abc4-3cc9f251ea32 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:57.263583 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-c58bbd74-fdd5-48c1-abc4-3cc9f251ea32 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:47:57.271481 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-c58bbd74-fdd5-48c1-abc4-3cc9f251ea32 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1757 microversion: 2.1 time: 0.160089 May 10 21:47:57.272042 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2896/3672] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:47:57 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:47:57.276302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-129dd9c1-9978-49fa-a7b4-5ba0299a73b9 tempest-VolumesGetTestJSON-2006882917 tempest-VolumesGetTestJSON-2006882917-project] Calling method '.version_select at 0x7f85d52a2b80>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:57.323262 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-129dd9c1-9978-49fa-a7b4-5ba0299a73b9 tempest-VolumesGetTestJSON-2006882917 tempest-VolumesGetTestJSON-2006882917-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/95921465-d208-4990-9450-bf8cf00dce8d" status: 200 len: 354 microversion: 2.1 time: 0.050141 May 10 21:47:57.323874 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2897/3673] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 21:47:57 2022] GET /compute/v2.1/os-volumes/95921465-d208-4990-9450-bf8cf00dce8d => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:47:57.334377 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a4b08af9-986e-4178-a0ce-6c1b31825ced tempest-VolumesGetTestJSON-2006882917 tempest-VolumesGetTestJSON-2006882917-project] Calling method '.version_select at 0x7f85d52d3d30>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:57.381668 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a4b08af9-986e-4178-a0ce-6c1b31825ced tempest-VolumesGetTestJSON-2006882917 tempest-VolumesGetTestJSON-2006882917-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/95921465-d208-4990-9450-bf8cf00dce8d" status: 200 len: 354 microversion: 2.1 time: 0.050853 May 10 21:47:57.382236 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2898/3674] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 21:47:57 2022] GET /compute/v2.1/os-volumes/95921465-d208-4990-9450-bf8cf00dce8d => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:47:57.393381 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-75ecef64-b831-4937-88f2-5bdcd8dc23a5 tempest-VolumesGetTestJSON-2006882917 tempest-VolumesGetTestJSON-2006882917-project] Calling method '.version_select at 0x7f85d52f84c0>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:57.588206 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-75ecef64-b831-4937-88f2-5bdcd8dc23a5 tempest-VolumesGetTestJSON-2006882917 tempest-VolumesGetTestJSON-2006882917-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/95921465-d208-4990-9450-bf8cf00dce8d" status: 202 len: 0 microversion: 2.1 time: 0.198473 May 10 21:47:57.588979 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2899/3675] 10.222.0.49 () {58 vars in 1247 bytes} [Tue May 10 21:47:57 2022] DELETE /compute/v2.1/os-volumes/95921465-d208-4990-9450-bf8cf00dce8d => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 21:47:57.596862 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-68d2d40c-564f-4a02-90cc-bc2d89e59038 tempest-VolumesGetTestJSON-2006882917 tempest-VolumesGetTestJSON-2006882917-project] Calling method '.version_select at 0x7f85d53cf310>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:57.645002 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-68d2d40c-564f-4a02-90cc-bc2d89e59038 tempest-VolumesGetTestJSON-2006882917 tempest-VolumesGetTestJSON-2006882917-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/95921465-d208-4990-9450-bf8cf00dce8d" status: 200 len: 353 microversion: 2.1 time: 0.052134 May 10 21:47:57.645651 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2900/3676] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 21:47:57 2022] GET /compute/v2.1/os-volumes/95921465-d208-4990-9450-bf8cf00dce8d => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:47:58.289240 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b752ce2c-f1c7-4c92-a253-f34b012a771e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:58.289897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b752ce2c-f1c7-4c92-a253-f34b012a771e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:47:58.296881 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b752ce2c-f1c7-4c92-a253-f34b012a771e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:58.297338 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b752ce2c-f1c7-4c92-a253-f34b012a771e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:58.298122 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b752ce2c-f1c7-4c92-a253-f34b012a771e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:58.298566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b752ce2c-f1c7-4c92-a253-f34b012a771e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:58.446263 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-b752ce2c-f1c7-4c92-a253-f34b012a771e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:47:58.454251 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b752ce2c-f1c7-4c92-a253-f34b012a771e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1757 microversion: 2.1 time: 0.169370 May 10 21:47:58.454811 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2901/3677] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:47:58 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:47:58.657827 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-af4be3b0-f2c0-4116-a05f-195d34518bf4 tempest-VolumesGetTestJSON-2006882917 tempest-VolumesGetTestJSON-2006882917-project] Calling method '.version_select at 0x7f85d52d3940>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:58.684258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-af4be3b0-f2c0-4116-a05f-195d34518bf4 tempest-VolumesGetTestJSON-2006882917 tempest-VolumesGetTestJSON-2006882917-project] HTTP exception thrown: Volume 95921465-d208-4990-9450-bf8cf00dce8d could not be found. May 10 21:47:58.686195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-af4be3b0-f2c0-4116-a05f-195d34518bf4 tempest-VolumesGetTestJSON-2006882917 tempest-VolumesGetTestJSON-2006882917-project] Request method failure captured: May 10 21:47:58.686195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: GET /compute/v2.1/os-volumes/95921465-d208-4990-9450-bf8cf00dce8d HTTP/1.1 May 10 21:47:58.686195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:47:58.686195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:47:58.686195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:47:58.686195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:47:58.686195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:47:58.686195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:47:58.686195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:47:58.686195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:47:58.686195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABiet2Lp39FT2n-p63EEFUPFXWWCvdO6_iE2is2YbDrw5u9sZ31XD7jXnRZK1JCrlAGu63roLnFY9jFSrOEV87Ykv38iabtjZ_wvVXwRvh83BapdibqaBI-xmwEF5ttyssnlumkjUr8wF2IT_VfXxzJBF_LdOBVSzabgpDirsboRyHiTng May 10 21:47:58.686195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:47:58.686195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:47:58.686195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:47:58.686195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:47:58.686195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:47:58.686195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:47:58.686195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 66bb2fef29db4b6a8857457086f0e78f May 10 21:47:58.686195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-VolumesGetTestJSON-2006882917 May 10 21:47:58.686195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:47:58.686195 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:47:58.687625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/66bb2fef29db4b6a8857457086f0e78f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/66bb2fef29db4b6a8857457086f0e78f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/66bb2fef29db4b6a8857457086f0e78f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_66bb2fef29db4b6a8857457086f0e78f", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:47:58.687625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-VolumesGetTestJSON-2006882917 May 10 21:47:58.687625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 66bb2fef29db4b6a8857457086f0e78f May 10 21:47:58.687625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-VolumesGetTestJSON-2006882917 May 10 21:47:58.687625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-VolumesGetTestJSON-2006882917-project May 10 21:47:58.687625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:47:58.687625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:47:58.687625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: 22cdb991bf6a41638fde0575ddda2503 May 10 21:47:58.687625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-VolumesGetTestJSON-2006882917-project May 10 21:47:58.687625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: May 10 21:47:58.687625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Volume 95921465-d208-4990-9450-bf8cf00dce8d could not be found. May 10 21:47:58.687625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': '95921465-d208-4990-9450-bf8cf00dce8d'} May 10 21:47:58.687625 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:47:58.688500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:47:58.688500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:47:58.688500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:47:58.688500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 21:47:58.688500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 21:47:58.688500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 21:47:58.688500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 21:47:58.688500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 21:47:58.688500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 21:47:58.688500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 21:47:58.688500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 21:47:58.688500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:47:58.688500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:47:58.688500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:47:58.688500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:47:58.688500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 95921465-d208-4990-9450-bf8cf00dce8d could not be found. (HTTP 404) (Request-ID: req-1cfe00c7-8345-456d-9257-eebf91b56ce6) May 10 21:47:58.688500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:47:58.688500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:47:58.688500 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:47:58.689566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:47:58.689566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 21:47:58.689566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 21:47:58.689566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 21:47:58.689566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 21:47:58.689566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 21:47:58.689566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 21:47:58.689566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 21:47:58.689566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 21:47:58.689566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 21:47:58.689566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 21:47:58.689566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 21:47:58.689566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 21:47:58.689566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 21:47:58.689566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 21:47:58.689566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 21:47:58.689566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 21:47:58.689566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 21:47:58.689566 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 21:47:58.691101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 21:47:58.691101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 21:47:58.691101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 21:47:58.691101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 21:47:58.691101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 95921465-d208-4990-9450-bf8cf00dce8d could not be found. May 10 21:47:58.691101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:47:58.691101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:47:58.691101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:47:58.691101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:47:58.691101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:47:58.691101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:47:58.691101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:47:58.691101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:47:58.691101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 21:47:58.691101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 21:47:58.691101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:47:58.691101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:47:58.691101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 21:47:58.691101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:47:58.692086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 95921465-d208-4990-9450-bf8cf00dce8d could not be found. May 10 21:47:58.692086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:47:58.692086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:47:58.692086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:47:58.692086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:47:58.692086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:47:58.692086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:47:58.692086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:47:58.692086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:47:58.692086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 95921465-d208-4990-9450-bf8cf00dce8d could not be found. May 10 21:47:58.692086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:47:58.692086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-af4be3b0-f2c0-4116-a05f-195d34518bf4 tempest-VolumesGetTestJSON-2006882917 tempest-VolumesGetTestJSON-2006882917-project] Returning 404 to user: Volume 95921465-d208-4990-9450-bf8cf00dce8d could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:47:58.692086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-af4be3b0-f2c0-4116-a05f-195d34518bf4 tempest-VolumesGetTestJSON-2006882917 tempest-VolumesGetTestJSON-2006882917-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/95921465-d208-4990-9450-bf8cf00dce8d" status: 404 len: 109 microversion: 2.1 time: 0.033873 May 10 21:47:58.692086 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2902/3678] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 21:47:58 2022] GET /compute/v2.1/os-volumes/95921465-d208-4990-9450-bf8cf00dce8d => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 21:47:59.472563 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-35589a61-2e03-4fbd-9297-d39ef65acf8f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:47:59.478230 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-35589a61-2e03-4fbd-9297-d39ef65acf8f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:47:59.481705 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-35589a61-2e03-4fbd-9297-d39ef65acf8f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:59.482156 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-35589a61-2e03-4fbd-9297-d39ef65acf8f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:59.482926 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-35589a61-2e03-4fbd-9297-d39ef65acf8f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:47:59.483450 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-35589a61-2e03-4fbd-9297-d39ef65acf8f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:47:59.630115 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-35589a61-2e03-4fbd-9297-d39ef65acf8f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:47:59.638234 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-35589a61-2e03-4fbd-9297-d39ef65acf8f tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1760 microversion: 2.1 time: 0.170846 May 10 21:47:59.638789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2903/3679] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:47:59 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1760 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:48:02.435255 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3dcbf810-952c-4470-831a-843dca4fef6c tempest-VolumesTestJSON-83557604 tempest-VolumesTestJSON-83557604-project] Calling method '.version_select at 0x7f85d52d3ee0>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:48:02.480723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3dcbf810-952c-4470-831a-843dca4fef6c tempest-VolumesTestJSON-83557604 tempest-VolumesTestJSON-83557604-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/016f11a6-fae5-49aa-8dd0-b0ffec3d8860" status: 200 len: 350 microversion: 2.1 time: 0.049201 May 10 21:48:02.481280 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2904/3680] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 21:48:02 2022] GET /compute/v2.1/os-volumes/016f11a6-fae5-49aa-8dd0-b0ffec3d8860 => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:48:04.290266 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e0b7dea3-ea1a-422b-9af2-288d7cabd33f tempest-VolumesTestJSON-83557604 tempest-VolumesTestJSON-83557604-project] Calling method '.version_select at 0x7f85d5d86700>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:48:04.336105 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e0b7dea3-ea1a-422b-9af2-288d7cabd33f tempest-VolumesTestJSON-83557604 tempest-VolumesTestJSON-83557604-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/fda0621c-b8d0-4ea0-b379-849612a6367f" status: 200 len: 350 microversion: 2.1 time: 0.050623 May 10 21:48:04.336732 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2905/3681] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 21:48:04 2022] GET /compute/v2.1/os-volumes/fda0621c-b8d0-4ea0-b379-849612a6367f => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:48:05.937529 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-f5e142c9-a782-47df-961e-483592bf5471 tempest-VolumesTestJSON-83557604 tempest-VolumesTestJSON-83557604-project] Calling method '.version_select at 0x7f85d5303dc0>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:48:05.984469 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-f5e142c9-a782-47df-961e-483592bf5471 tempest-VolumesTestJSON-83557604 tempest-VolumesTestJSON-83557604-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/73e34edd-3788-44e5-93dd-67f924badaba" status: 200 len: 350 microversion: 2.1 time: 0.051118 May 10 21:48:05.985022 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2906/3682] 10.222.0.49 () {58 vars in 1244 bytes} [Tue May 10 21:48:05 2022] GET /compute/v2.1/os-volumes/73e34edd-3788-44e5-93dd-67f924badaba => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:48:05.995581 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-808a8743-aa26-473f-b86b-47bdbf21ca5f tempest-VolumesTestJSON-83557604 tempest-VolumesTestJSON-83557604-project] Calling method '.version_select at 0x7f85d5274700>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:48:06.073616 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-808a8743-aa26-473f-b86b-47bdbf21ca5f tempest-VolumesTestJSON-83557604 tempest-VolumesTestJSON-83557604-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.081435 May 10 21:48:06.074174 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2907/3683] 10.222.0.49 () {58 vars in 1133 bytes} [Tue May 10 21:48:05 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:48:06.086579 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-35d34ec3-a870-4c84-9529-ad50422fb72b tempest-VolumesTestJSON-83557604 tempest-VolumesTestJSON-83557604-project] Calling method '.version_select at 0x7f85d53cf310>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:48:06.167588 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-35d34ec3-a870-4c84-9529-ad50422fb72b tempest-VolumesTestJSON-83557604 tempest-VolumesTestJSON-83557604-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.085069 May 10 21:48:06.168150 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2908/3684] 10.222.0.49 () {58 vars in 1148 bytes} [Tue May 10 21:48:06 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:48:06.179842 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d4f084ee-765b-4222-930c-61057c45da29 tempest-VolumesTestJSON-83557604 tempest-VolumesTestJSON-83557604-project] Calling method '.version_select at 0x7f85d52d3ee0>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:48:06.266165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d4f084ee-765b-4222-930c-61057c45da29 tempest-VolumesTestJSON-83557604 tempest-VolumesTestJSON-83557604-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.086265 May 10 21:48:06.266165 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2909/3685] 10.222.0.49 () {58 vars in 1133 bytes} [Tue May 10 21:48:06 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:48:06.276418 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-3f2b1a91-cca2-4637-a038-7517e51c4016 tempest-VolumesTestJSON-83557604 tempest-VolumesTestJSON-83557604-project] Calling method '.version_select at 0x7f85d52d30d0>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:48:06.355626 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-3f2b1a91-cca2-4637-a038-7517e51c4016 tempest-VolumesTestJSON-83557604 tempest-VolumesTestJSON-83557604-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.082866 May 10 21:48:06.356199 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2910/3686] 10.222.0.49 () {58 vars in 1166 bytes} [Tue May 10 21:48:06 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:48:06.367549 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8abcd001-dee6-46d9-b404-26a2521c4eb0 tempest-VolumesTestJSON-83557604 tempest-VolumesTestJSON-83557604-project] Calling method '.version_select at 0x7f85d52f80d0>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:48:06.446716 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8abcd001-dee6-46d9-b404-26a2521c4eb0 tempest-VolumesTestJSON-83557604 tempest-VolumesTestJSON-83557604-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.082324 May 10 21:48:06.446985 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2911/3687] 10.222.0.49 () {58 vars in 1169 bytes} [Tue May 10 21:48:06 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:48:06.458258 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-d4c8313f-90a1-4f9e-94d3-673ca7e2508b tempest-VolumesTestJSON-83557604 tempest-VolumesTestJSON-83557604-project] Calling method '.version_select at 0x7f85d52745e0>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:48:06.538844 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-d4c8313f-90a1-4f9e-94d3-673ca7e2508b tempest-VolumesTestJSON-83557604 tempest-VolumesTestJSON-83557604-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.084025 May 10 21:48:06.539444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2912/3688] 10.222.0.49 () {58 vars in 1154 bytes} [Tue May 10 21:48:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:48:06.549981 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-7ad25cfa-e012-4e0c-a6de-b57fb2638f4f tempest-VolumesTestJSON-83557604 tempest-VolumesTestJSON-83557604-project] Calling method '.version_select at 0x7f85d5d864c0>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:48:06.629142 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-7ad25cfa-e012-4e0c-a6de-b57fb2638f4f tempest-VolumesTestJSON-83557604 tempest-VolumesTestJSON-83557604-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.082526 May 10 21:48:06.629707 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2913/3689] 10.222.0.49 () {58 vars in 1187 bytes} [Tue May 10 21:48:06 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:48:06.641154 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-1dfba56e-57cb-464d-8c38-510384351e9f tempest-VolumesTestJSON-83557604 tempest-VolumesTestJSON-83557604-project] Calling method '.version_select at 0x7f85d5d4d280>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:48:06.721507 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-1dfba56e-57cb-464d-8c38-510384351e9f tempest-VolumesTestJSON-83557604 tempest-VolumesTestJSON-83557604-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.083838 May 10 21:48:06.722085 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2914/3690] 10.222.0.49 () {58 vars in 1154 bytes} [Tue May 10 21:48:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:48:32.802639 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-e6c4d56b-8448-4dc6-a318-effb610ba061 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2030136987"}} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:48:32.806210 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-e6c4d56b-8448-4dc6-a318-effb610ba061 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:48:32.809849 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e6c4d56b-8448-4dc6-a318-effb610ba061 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:32.810302 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e6c4d56b-8448-4dc6-a318-effb610ba061 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:32.811684 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e6c4d56b-8448-4dc6-a318-effb610ba061 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:32.812128 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-e6c4d56b-8448-4dc6-a318-effb610ba061 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:32.936530 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.network.security_group_api [None req-e6c4d56b-8448-4dc6-a318-effb610ba061 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Removing security group b4452f4e-f999-40c0-917a-439c4976710e from port 3b9e0bd2-a3c7-4609-a738-153615fa1400 May 10 21:48:33.363484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-e6c4d56b-8448-4dc6-a318-effb610ba061 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "POST /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c/action" status: 202 len: 0 microversion: 2.1 time: 0.563938 May 10 21:48:33.365034 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2915/3691] 10.222.0.49 () {60 vars in 1277 bytes} [Tue May 10 21:48:32 2022] POST /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c/action => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 21:48:33.371446 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-79d69dcc-47bc-4257-8fbc-6311ee41f08e req-65e2ecd0-7325-4197-a491-42a8c36f14ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cd303db-4b57-42ae-a64c-62c9549d988c", "tag": "3b9e0bd2-a3c7-4609-a738-153615fa1400"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:48:33.390789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-79d69dcc-47bc-4257-8fbc-6311ee41f08e req-65e2ecd0-7325-4197-a491-42a8c36f14ee service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:33.390789 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-79d69dcc-47bc-4257-8fbc-6311ee41f08e req-65e2ecd0-7325-4197-a491-42a8c36f14ee service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:33.410993 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-79d69dcc-47bc-4257-8fbc-6311ee41f08e req-65e2ecd0-7325-4197-a491-42a8c36f14ee service nova] Creating event network-changed:3b9e0bd2-a3c7-4609-a738-153615fa1400 for instance 2cd303db-4b57-42ae-a64c-62c9549d988c on hv-cinder-82880 May 10 21:48:33.417735 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-79d69dcc-47bc-4257-8fbc-6311ee41f08e req-65e2ecd0-7325-4197-a491-42a8c36f14ee service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051253 May 10 21:48:33.418785 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2916/3692] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:48:34.620479 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-b3dac1e8-dc7b-4806-9306-e8f01dafe6d8 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:48:34.625548 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-b3dac1e8-dc7b-4806-9306-e8f01dafe6d8 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:48:34.628943 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3dac1e8-dc7b-4806-9306-e8f01dafe6d8 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:34.629394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3dac1e8-dc7b-4806-9306-e8f01dafe6d8 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:34.630470 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3dac1e8-dc7b-4806-9306-e8f01dafe6d8 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:34.630907 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-b3dac1e8-dc7b-4806-9306-e8f01dafe6d8 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:34.713484 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.objects.instance [None req-b3dac1e8-dc7b-4806-9306-e8f01dafe6d8 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lazy-loading 'services' on Instance uuid 2cd303db-4b57-42ae-a64c-62c9549d988c {{(pid=117714) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 21:48:34.919267 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-b3dac1e8-dc7b-4806-9306-e8f01dafe6d8 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c/os-volume_attachments/b0bface7-eb18-4807-962f-196e38ec86ec" status: 202 len: 0 microversion: 2.1 time: 0.303304 May 10 21:48:34.920041 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2917/3693] 10.222.0.49 () {58 vars in 1415 bytes} [Tue May 10 21:48:34 2022] DELETE /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c/os-volume_attachments/b0bface7-eb18-4807-962f-196e38ec86ec => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 21:48:34.927038 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-f85b5b90-76cb-46af-9bd1-15c06be74911 req-5e972a71-ce5d-4994-be93-464703a70913 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cd303db-4b57-42ae-a64c-62c9549d988c", "tag": "3b9e0bd2-a3c7-4609-a738-153615fa1400"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:48:34.936061 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-f85b5b90-76cb-46af-9bd1-15c06be74911 req-5e972a71-ce5d-4994-be93-464703a70913 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:34.936650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-f85b5b90-76cb-46af-9bd1-15c06be74911 req-5e972a71-ce5d-4994-be93-464703a70913 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:34.947723 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-f85b5b90-76cb-46af-9bd1-15c06be74911 req-5e972a71-ce5d-4994-be93-464703a70913 service nova] Creating event network-changed:3b9e0bd2-a3c7-4609-a738-153615fa1400 for instance 2cd303db-4b57-42ae-a64c-62c9549d988c on hv-cinder-82880 May 10 21:48:34.953428 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-f85b5b90-76cb-46af-9bd1-15c06be74911 req-5e972a71-ce5d-4994-be93-464703a70913 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031811 May 10 21:48:34.954257 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2918/3694] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:48:34.959562 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-60107274-6eb1-4de6-bfce-258b88f44933 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:48:34.960561 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-60107274-6eb1-4de6-bfce-258b88f44933 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:48:34.966865 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-60107274-6eb1-4de6-bfce-258b88f44933 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:34.967657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-60107274-6eb1-4de6-bfce-258b88f44933 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:34.968459 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-60107274-6eb1-4de6-bfce-258b88f44933 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:34.968887 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-60107274-6eb1-4de6-bfce-258b88f44933 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:35.000813 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-60107274-6eb1-4de6-bfce-258b88f44933 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045253 May 10 21:48:35.003763 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2919/3695] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:48:34 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 21:48:36.012657 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9dccc374-ded2-477c-bd2b-e8eefbac37a6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:48:36.014199 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9dccc374-ded2-477c-bd2b-e8eefbac37a6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:48:36.020539 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9dccc374-ded2-477c-bd2b-e8eefbac37a6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:36.020985 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9dccc374-ded2-477c-bd2b-e8eefbac37a6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:36.021746 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9dccc374-ded2-477c-bd2b-e8eefbac37a6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:36.022183 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9dccc374-ded2-477c-bd2b-e8eefbac37a6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:36.050134 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9dccc374-ded2-477c-bd2b-e8eefbac37a6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041382 May 10 21:48:36.050675 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2920/3696] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:48:36 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:48:37.063189 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-8ae7af16-cba7-4f31-b04e-7f40eb97eb84 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:48:37.064118 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-8ae7af16-cba7-4f31-b04e-7f40eb97eb84 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:48:37.070449 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ae7af16-cba7-4f31-b04e-7f40eb97eb84 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:37.070906 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ae7af16-cba7-4f31-b04e-7f40eb97eb84 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:37.071698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ae7af16-cba7-4f31-b04e-7f40eb97eb84 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:37.072133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-8ae7af16-cba7-4f31-b04e-7f40eb97eb84 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:37.099851 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-8ae7af16-cba7-4f31-b04e-7f40eb97eb84 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041363 May 10 21:48:37.100394 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2921/3697] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:48:37 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:48:38.111832 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-373f80ea-c93a-46da-9cd2-3532dc17f920 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:48:38.112752 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-373f80ea-c93a-46da-9cd2-3532dc17f920 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:48:38.119023 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-373f80ea-c93a-46da-9cd2-3532dc17f920 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:38.119509 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-373f80ea-c93a-46da-9cd2-3532dc17f920 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:38.120650 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-373f80ea-c93a-46da-9cd2-3532dc17f920 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:38.120746 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-373f80ea-c93a-46da-9cd2-3532dc17f920 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:38.149420 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-373f80ea-c93a-46da-9cd2-3532dc17f920 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042070 May 10 21:48:38.149976 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2922/3698] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:48:38 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:48:39.161836 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ddfb626c-aff0-4752-9591-32c3320cb288 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:48:39.162792 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-ddfb626c-aff0-4752-9591-32c3320cb288 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:48:39.169065 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ddfb626c-aff0-4752-9591-32c3320cb288 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:39.172822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ddfb626c-aff0-4752-9591-32c3320cb288 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:39.172822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ddfb626c-aff0-4752-9591-32c3320cb288 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:39.172822 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-ddfb626c-aff0-4752-9591-32c3320cb288 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:39.201501 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ddfb626c-aff0-4752-9591-32c3320cb288 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043240 May 10 21:48:39.202075 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2923/3699] 10.222.0.49 () {58 vars in 1301 bytes} [Tue May 10 21:48:39 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 21:48:39.211752 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-49e076d4-1a1c-404b-ad34-29fd83058c61 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:48:39.212247 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-49e076d4-1a1c-404b-ad34-29fd83058c61 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:48:39.218857 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-49e076d4-1a1c-404b-ad34-29fd83058c61 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:39.219343 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-49e076d4-1a1c-404b-ad34-29fd83058c61 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:39.220100 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-49e076d4-1a1c-404b-ad34-29fd83058c61 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:39.220532 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-49e076d4-1a1c-404b-ad34-29fd83058c61 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:39.296222 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-49e076d4-1a1c-404b-ad34-29fd83058c61 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] HTTP exception thrown: Instance 2cd303db-4b57-42ae-a64c-62c9549d988c is not attached to volume b0bface7-eb18-4807-962f-196e38ec86ec May 10 21:48:39.298921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-49e076d4-1a1c-404b-ad34-29fd83058c61 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Request method failure captured: May 10 21:48:39.298921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: DELETE /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c/os-volume_attachments/b0bface7-eb18-4807-962f-196e38ec86ec HTTP/1.1 May 10 21:48:39.298921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:48:39.298921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:48:39.298921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:48:39.298921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:48:39.298921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:48:39.298921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:48:39.298921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:48:39.298921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:48:39.298921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABiet0kuf_9rJrYWch7ZfUEOxJOmpQfLd-kuv4LPpJnT12npdjzeBMwQNTszcCVKNTQ2p7pWrFXlsmZj-sHgx38pKalVbRxrRIDgwtXCOJjTw0TiS37JPoKc_JPayGanK4jnjZN4A-G-WjA5ImiGub4NwSZQbfbRHlJIGUKufLVH-_z_Xk May 10 21:48:39.298921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:48:39.298921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:48:39.298921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:48:39.298921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:48:39.298921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:48:39.298921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:48:39.298921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 1c8ec5d0210746a081edaf4a94b7b187 May 10 21:48:39.298921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-TestMinimumBasicScenario-663203300 May 10 21:48:39.298921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:48:39.298921 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:48:39.300282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c8ec5d0210746a081edaf4a94b7b187"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1c8ec5d0210746a081edaf4a94b7b187"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c8ec5d0210746a081edaf4a94b7b187"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1c8ec5d0210746a081edaf4a94b7b187", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:48:39.300282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-TestMinimumBasicScenario-663203300 May 10 21:48:39.300282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 1c8ec5d0210746a081edaf4a94b7b187 May 10 21:48:39.300282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-TestMinimumBasicScenario-663203300 May 10 21:48:39.300282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-TestMinimumBasicScenario-663203300-project May 10 21:48:39.300282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:48:39.300282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:48:39.300282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: c8cae921e3984e0ab0338798785da0c2 May 10 21:48:39.300282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-TestMinimumBasicScenario-663203300-project May 10 21:48:39.300282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:48:39.300282 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance 2cd303db-4b57-42ae-a64c-62c9549d988c is not attached to volume b0bface7-eb18-4807-962f-196e38ec86ec May 10 21:48:39.301010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'server_id': '2cd303db-4b57-42ae-a64c-62c9549d988c', 'id': 'b0bface7-eb18-4807-962f-196e38ec86ec'} May 10 21:48:39.301010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:48:39.301010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:48:39.301010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 10 21:48:39.301010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 10 21:48:39.301010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 21:48:39.301010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 21:48:39.301010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 10 21:48:39.301010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 10 21:48:39.301010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b0bface7-eb18-4807-962f-196e38ec86ec. May 10 21:48:39.301010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:48:39.301010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:48:39.301010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:48:39.301010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:48:39.301010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:48:39.301010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:48:39.301010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:48:39.301010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:48:39.301010 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:48:39.302274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:48:39.302274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 10 21:48:39.302274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 21:48:39.302274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cd303db-4b57-42ae-a64c-62c9549d988c is not attached to volume b0bface7-eb18-4807-962f-196e38ec86ec May 10 21:48:39.302274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:48:39.302274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:48:39.302274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:48:39.302274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:48:39.302274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:48:39.302274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:48:39.302274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:48:39.302274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:48:39.302274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cd303db-4b57-42ae-a64c-62c9549d988c is not attached to volume b0bface7-eb18-4807-962f-196e38ec86ec May 10 21:48:39.302274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:48:39.302274 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-49e076d4-1a1c-404b-ad34-29fd83058c61 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Returning 404 to user: Instance 2cd303db-4b57-42ae-a64c-62c9549d988c is not attached to volume b0bface7-eb18-4807-962f-196e38ec86ec {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:48:39.303260 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-49e076d4-1a1c-404b-ad34-29fd83058c61 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c/os-volume_attachments/b0bface7-eb18-4807-962f-196e38ec86ec" status: 404 len: 154 microversion: 2.1 time: 0.092641 May 10 21:48:39.303260 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2924/3700] 10.222.0.49 () {58 vars in 1415 bytes} [Tue May 10 21:48:39 2022] DELETE /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c/os-volume_attachments/b0bface7-eb18-4807-962f-196e38ec86ec => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 21:48:40.615909 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-701f36f7-8bfc-4c17-b8dc-083cf5258cd0 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:48:40.616426 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-701f36f7-8bfc-4c17-b8dc-083cf5258cd0 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:48:40.622714 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-701f36f7-8bfc-4c17-b8dc-083cf5258cd0 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:40.623246 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-701f36f7-8bfc-4c17-b8dc-083cf5258cd0 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:40.624249 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-701f36f7-8bfc-4c17-b8dc-083cf5258cd0 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:40.624690 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-701f36f7-8bfc-4c17-b8dc-083cf5258cd0 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:40.649160 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-701f36f7-8bfc-4c17-b8dc-083cf5258cd0 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Going to try to terminate instance {{(pid=117714) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 21:48:40.937579 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-701f36f7-8bfc-4c17-b8dc-083cf5258cd0 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 204 len: 0 microversion: 2.1 time: 0.325100 May 10 21:48:40.938090 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2925/3701] 10.222.0.49 () {58 vars in 1238 bytes} [Tue May 10 21:48:40 2022] DELETE /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 21:48:40.946353 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-844dce2e-975d-464e-9b16-16aa9940fa71 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:48:40.947055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-844dce2e-975d-464e-9b16-16aa9940fa71 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:48:40.953685 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-844dce2e-975d-464e-9b16-16aa9940fa71 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:40.954133 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-844dce2e-975d-464e-9b16-16aa9940fa71 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:40.954897 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-844dce2e-975d-464e-9b16-16aa9940fa71 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:40.955363 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-844dce2e-975d-464e-9b16-16aa9940fa71 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:41.099546 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-844dce2e-975d-464e-9b16-16aa9940fa71 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:48:41.106771 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-844dce2e-975d-464e-9b16-16aa9940fa71 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1554 microversion: 2.1 time: 0.164439 May 10 21:48:41.107365 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2926/3702] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:48:40 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:48:42.124184 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-a6944e80-8e36-4628-a994-a6b204b8cf44 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:48:42.124985 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-a6944e80-8e36-4628-a994-a6b204b8cf44 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:48:42.131698 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a6944e80-8e36-4628-a994-a6b204b8cf44 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:42.132154 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a6944e80-8e36-4628-a994-a6b204b8cf44 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:42.132934 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a6944e80-8e36-4628-a994-a6b204b8cf44 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:42.134764 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-a6944e80-8e36-4628-a994-a6b204b8cf44 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:42.268232 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-a6944e80-8e36-4628-a994-a6b204b8cf44 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:48:42.276179 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-a6944e80-8e36-4628-a994-a6b204b8cf44 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1554 microversion: 2.1 time: 0.156082 May 10 21:48:42.286081 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2927/3703] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:48:42 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:48:43.293781 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-9c00ab80-b592-4d26-b8c1-b3eb8041cda6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:48:43.294444 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-9c00ab80-b592-4d26-b8c1-b3eb8041cda6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:48:43.300961 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c00ab80-b592-4d26-b8c1-b3eb8041cda6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:43.301493 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c00ab80-b592-4d26-b8c1-b3eb8041cda6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:43.302348 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c00ab80-b592-4d26-b8c1-b3eb8041cda6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:43.302793 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-9c00ab80-b592-4d26-b8c1-b3eb8041cda6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:43.428270 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-9c00ab80-b592-4d26-b8c1-b3eb8041cda6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:48:43.435472 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-9c00ab80-b592-4d26-b8c1-b3eb8041cda6 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1554 microversion: 2.1 time: 0.145593 May 10 21:48:43.436180 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2928/3704] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:48:43 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1554 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:48:44.452424 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-91261660-5dd5-4b8f-b636-da4967bf7b3e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:48:44.453101 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-91261660-5dd5-4b8f-b636-da4967bf7b3e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:48:44.459515 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91261660-5dd5-4b8f-b636-da4967bf7b3e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:44.459964 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91261660-5dd5-4b8f-b636-da4967bf7b3e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:44.460720 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91261660-5dd5-4b8f-b636-da4967bf7b3e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:44.461154 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-91261660-5dd5-4b8f-b636-da4967bf7b3e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:44.594269 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-91261660-5dd5-4b8f-b636-da4967bf7b3e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:48:44.602044 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-91261660-5dd5-4b8f-b636-da4967bf7b3e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1554 microversion: 2.1 time: 0.153518 May 10 21:48:44.602908 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2929/3705] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:48:44 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:48:45.620900 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-65219a04-0a85-4e77-bcb6-180f42262a72 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:48:45.622267 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-65219a04-0a85-4e77-bcb6-180f42262a72 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:48:45.628892 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65219a04-0a85-4e77-bcb6-180f42262a72 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:45.629437 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65219a04-0a85-4e77-bcb6-180f42262a72 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:45.630319 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65219a04-0a85-4e77-bcb6-180f42262a72 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:45.630825 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-65219a04-0a85-4e77-bcb6-180f42262a72 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:45.775400 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.policy [None req-65219a04-0a85-4e77-bcb6-180f42262a72 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8cae921e3984e0ab0338798785da0c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8ec5d0210746a081edaf4a94b7b187', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117714) authorize /opt/stack/nova/nova/policy.py:199}} May 10 21:48:45.785920 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-65219a04-0a85-4e77-bcb6-180f42262a72 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 200 len: 1554 microversion: 2.1 time: 0.170360 May 10 21:48:45.796046 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2930/3706] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:48:45 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 1554 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 21:48:45.866800 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [req-f416719f-6426-406a-98c5-3918f020da30 req-1c15da80-0ca4-400f-bf09-2ba1bd3bbdc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cd303db-4b57-42ae-a64c-62c9549d988c", "name": "network-vif-deleted", "tag": "3b9e0bd2-a3c7-4609-a738-153615fa1400"}]} {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 21:48:45.875367 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-f416719f-6426-406a-98c5-3918f020da30 req-1c15da80-0ca4-400f-bf09-2ba1bd3bbdc9 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:45.875760 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [req-f416719f-6426-406a-98c5-3918f020da30 req-1c15da80-0ca4-400f-bf09-2ba1bd3bbdc9 service nova] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:45.886732 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.compute.server_external_events [req-f416719f-6426-406a-98c5-3918f020da30 req-1c15da80-0ca4-400f-bf09-2ba1bd3bbdc9 service nova] Creating event network-vif-deleted:3b9e0bd2-a3c7-4609-a738-153615fa1400 for instance 2cd303db-4b57-42ae-a64c-62c9549d988c on hv-cinder-82880 May 10 21:48:45.895437 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [req-f416719f-6426-406a-98c5-3918f020da30 req-1c15da80-0ca4-400f-bf09-2ba1bd3bbdc9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029363 May 10 21:48:45.895437 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2931/3707] 10.222.0.49 () {64 vars in 1317 bytes} [Tue May 10 21:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 21:48:46.803944 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6bd0eec9-49f8-4f04-ba17-e2b62f07d13e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:48:46.804642 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.compute.api [None req-6bd0eec9-49f8-4f04-ba17-e2b62f07d13e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [instance: 2cd303db-4b57-42ae-a64c-62c9549d988c] Fetching instance by UUID {{(pid=117714) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 21:48:46.811620 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6bd0eec9-49f8-4f04-ba17-e2b62f07d13e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:46.812113 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6bd0eec9-49f8-4f04-ba17-e2b62f07d13e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:46.812937 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6bd0eec9-49f8-4f04-ba17-e2b62f07d13e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 21:48:46.813379 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG oslo_concurrency.lockutils [None req-6bd0eec9-49f8-4f04-ba17-e2b62f07d13e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Lock "a9a66363-11d1-480a-8132-cac751fafba9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117714) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 21:48:46.827295 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.wsgi [None req-6bd0eec9-49f8-4f04-ba17-e2b62f07d13e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] HTTP exception thrown: Instance 2cd303db-4b57-42ae-a64c-62c9549d988c could not be found. May 10 21:48:46.828986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6bd0eec9-49f8-4f04-ba17-e2b62f07d13e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Request method failure captured: May 10 21:48:46.828986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: request: GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c HTTP/1.1 May 10 21:48:46.828986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept: application/json May 10 21:48:46.828986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Accept-Encoding: identity May 10 21:48:46.828986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Connection: close May 10 21:48:46.828986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Length: 0 May 10 21:48:46.828986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Content-Type: application/json May 10 21:48:46.828986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Host: 10.222.0.49 May 10 21:48:46.828986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Openstack-System-Scope: None May 10 21:48:46.828986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: User-Agent: python-urllib3/1.26.9 May 10 21:48:46.828986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Auth-Token: gAAAAABiet0kuf_9rJrYWch7ZfUEOxJOmpQfLd-kuv4LPpJnT12npdjzeBMwQNTszcCVKNTQ2p7pWrFXlsmZj-sHgx38pKalVbRxrRIDgwtXCOJjTw0TiS37JPoKc_JPayGanK4jnjZN4A-G-WjA5ImiGub4NwSZQbfbRHlJIGUKufLVH-_z_Xk May 10 21:48:46.828986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Id: None May 10 21:48:46.828986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Domain-Name: None May 10 21:48:46.828986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Identity-Status: Confirmed May 10 21:48:46.828986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Is-Admin-Project: True May 10 21:48:46.828986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Id: default May 10 21:48:46.828986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Domain-Name: Default May 10 21:48:46.828986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Id: 1c8ec5d0210746a081edaf4a94b7b187 May 10 21:48:46.828986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Project-Name: tempest-TestMinimumBasicScenario-663203300 May 10 21:48:46.828986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Role: reader,member May 10 21:48:46.828986 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Roles: reader,member May 10 21:48:46.830284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c8ec5d0210746a081edaf4a94b7b187"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1c8ec5d0210746a081edaf4a94b7b187"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c8ec5d0210746a081edaf4a94b7b187"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1c8ec5d0210746a081edaf4a94b7b187", "adminURL": "http://10.222.0.49:8080"}]}] May 10 21:48:46.830284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant: tempest-TestMinimumBasicScenario-663203300 May 10 21:48:46.830284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Id: 1c8ec5d0210746a081edaf4a94b7b187 May 10 21:48:46.830284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-Tenant-Name: tempest-TestMinimumBasicScenario-663203300 May 10 21:48:46.830284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User: tempest-TestMinimumBasicScenario-663203300-project May 10 21:48:46.830284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Id: default May 10 21:48:46.830284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Domain-Name: Default May 10 21:48:46.830284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Id: c8cae921e3984e0ab0338798785da0c2 May 10 21:48:46.830284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: X-User-Name: tempest-TestMinimumBasicScenario-663203300-project May 10 21:48:46.830284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: method: > May 10 21:48:46.830284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: exception: Instance 2cd303db-4b57-42ae-a64c-62c9549d988c could not be found. May 10 21:48:46.830284 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: action_args: {'id': '2cd303db-4b57-42ae-a64c-62c9549d988c'} May 10 21:48:46.831035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 21:48:46.831035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:48:46.831035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 21:48:46.831035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 21:48:46.831035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 21:48:46.831035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 21:48:46.831035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 21:48:46.831035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 21:48:46.831035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 21:48:46.831035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 21:48:46.831035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cd303db-4b57-42ae-a64c-62c9549d988c could not be found. May 10 21:48:46.831035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:48:46.831035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:48:46.831035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:48:46.831035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:48:46.831035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:48:46.831035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:48:46.831035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 21:48:46.831035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 21:48:46.831035 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 21:48:46.832185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 21:48:46.832185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 21:48:46.832185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 21:48:46.832185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 21:48:46.832185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 21:48:46.832185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 21:48:46.832185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 21:48:46.832185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cd303db-4b57-42ae-a64c-62c9549d988c could not be found. May 10 21:48:46.832185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:48:46.832185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 21:48:46.832185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:48:46.832185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 21:48:46.832185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 21:48:46.832185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 21:48:46.832185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 21:48:46.832185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 21:48:46.832185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cd303db-4b57-42ae-a64c-62c9549d988c could not be found. May 10 21:48:46.832185 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR nova.api.openstack.wsgi May 10 21:48:46.833055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-6bd0eec9-49f8-4f04-ba17-e2b62f07d13e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Returning 404 to user: Instance 2cd303db-4b57-42ae-a64c-62c9549d988c could not be found. {{(pid=117714) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 21:48:46.833055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-6bd0eec9-49f8-4f04-ba17-e2b62f07d13e tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c" status: 404 len: 111 microversion: 2.1 time: 0.031296 May 10 21:48:46.833055 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2932/3708] 10.222.0.49 () {58 vars in 1235 bytes} [Tue May 10 21:48:46 2022] GET /compute/v2.1/servers/2cd303db-4b57-42ae-a64c-62c9549d988c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 21:48:46.838520 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: DEBUG nova.api.openstack.wsgi [None req-ecd2cc04-65db-4b5a-b8e7-fd4193986140 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] Calling method '.version_select at 0x7f85d52a7430>' {{(pid=117714) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 21:48:46.841763 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ecd2cc04-65db-4b5a-b8e7-fd4193986140 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [118c1323-dfbc-4e28-8f15-11c153c28bc1] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 21:48:47.848804 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO oslo.messaging._drivers.impl_rabbit [None req-ecd2cc04-65db-4b5a-b8e7-fd4193986140 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] [118c1323-dfbc-4e28-8f15-11c153c28bc1] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 52894. May 10 21:48:47.917333 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO nova.api.openstack.requestlog [None req-ecd2cc04-65db-4b5a-b8e7-fd4193986140 tempest-TestMinimumBasicScenario-663203300 tempest-TestMinimumBasicScenario-663203300-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-339895925" status: 202 len: 0 microversion: 2.1 time: 1.082180 May 10 21:48:47.917903 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: [pid: 117714|app: 0|req: 2933/3709] 10.222.0.49 () {58 vars in 1268 bytes} [Tue May 10 21:48:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-339895925 => generated 0 bytes in 1083 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 21:49:06.708401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:49:06.708401 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Tue May 10 21:49:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 21:52:26.713745 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:52:26.714396 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Tue May 10 21:52:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 21:54:24.319340 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:54:24.319932 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Tue May 10 21:54:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 21:54:25.684775 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 21:54:25.685930 dv-cinder-828807-2-iscsi devstack@n-api.service[117714]: Tue May 10 21:54:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!